2024-04-26T12:16:14.387 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T12:16:14.387 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216 --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/orig.config.yaml 2024-04-26T12:16:14.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:16:14.509 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674216' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: rhel os_version: '8.6' overrides: admin_socket: branch: reef ceph: conf: global: osd_pg_log_dups_tracked: 10000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBNPUHl3CXNTWj1hEysxsoQ/uyh8xDUwi0pwdmOYt8MqX2UYDx6audub4hS2hCsWK4goJDsOvZSzkn6a2wdFPjI= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ10jdB8zyUpHgY/mgU6CQkPD3OkZ4tOCYHskGjeYuYl6O2ekgwypJnrtTFJvqD/jfaVJtJ9BCiEHekSAM05oio= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQkPYgybmgRwDMj2ry9gq8ocliVFUlr7m8bJyVpQfL1GwXhBif708m296Zcb38/lFS9vazlO8rUfAkrjcrG9WI= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKLEdV9K41uMJtqszRYDlHWMD02BejT081teB/Aq9Io1Acvw0wsp0WW7NnzlQwJ1FQMlXUor2ys8nT0ruL9g9Tc= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T12:16:14.509 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T12:16:14.510 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T12:16:14.510 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T12:16:14.512 INFO:teuthology.task.internal:Checking packages... 2024-04-26T12:16:14.536 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T12:16:14.536 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T12:16:14.536 INFO:teuthology.packaging:ref: None 2024-04-26T12:16:14.536 INFO:teuthology.packaging:tag: None 2024-04-26T12:16:14.536 INFO:teuthology.packaging:branch: reef 2024-04-26T12:16:14.536 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:16:14.536 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-26T12:16:14.855 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258.g7d2137f0 2024-04-26T12:16:14.856 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T12:16:14.863 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T12:16:14.863 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T12:16:14.921 INFO:teuthology.task.internal:Saving configuration 2024-04-26T12:16:14.933 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T12:16:14.966 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T12:16:14.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:10:56.627154', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBNPUHl3CXNTWj1hEysxsoQ/uyh8xDUwi0pwdmOYt8MqX2UYDx6audub4hS2hCsWK4goJDsOvZSzkn6a2wdFPjI='} 2024-04-26T12:16:15.014 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:10:56.625437', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ10jdB8zyUpHgY/mgU6CQkPD3OkZ4tOCYHskGjeYuYl6O2ekgwypJnrtTFJvqD/jfaVJtJ9BCiEHekSAM05oio='} 2024-04-26T12:16:15.039 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:10:56.628529', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQkPYgybmgRwDMj2ry9gq8ocliVFUlr7m8bJyVpQfL1GwXhBif708m296Zcb38/lFS9vazlO8rUfAkrjcrG9WI='} 2024-04-26T12:16:15.062 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:10:56.629956', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKLEdV9K41uMJtqszRYDlHWMD02BejT081teB/Aq9Io1Acvw0wsp0WW7NnzlQwJ1FQMlXUor2ys8nT0ruL9g9Tc='} 2024-04-26T12:16:15.063 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T12:16:15.069 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T12:16:15.069 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['osd.0'] 2024-04-26T12:16:15.069 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['osd.1'] 2024-04-26T12:16:15.069 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['osd.2'] 2024-04-26T12:16:15.070 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T12:16:15.218 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f254fe280d0>, signals=[15]) 2024-04-26T12:16:15.218 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T12:16:15.225 INFO:teuthology.task.internal:Opening connections... 2024-04-26T12:16:15.225 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2024-04-26T12:16:15.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:15.303 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T12:16:15.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:15.376 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-04-26T12:16:15.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:15.446 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-04-26T12:16:15.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:15.518 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T12:16:15.525 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-04-26T12:16:15.547 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-04-26T12:16:15.547 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-26T12:16:15.608 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-26T12:16:15.609 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-26T12:16:15.610 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-04-26T12:16:15.636 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-04-26T12:16:15.657 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-04-26T12:16:15.657 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-04-26T12:16:15.715 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T12:16:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-26T12:16:15.717 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-26T12:16:15.717 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-26T12:16:15.717 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-04-26T12:16:15.736 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-04-26T12:16:15.756 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-04-26T12:16:15.757 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)" 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6" 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-26T12:16:15.815 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2024-04-26T12:16:15.816 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-26T12:16:15.816 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:16:15.816 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:16:15.816 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T12:16:15.816 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-26T12:16:15.816 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-26T12:16:15.816 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-26T12:16:15.816 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-04-26T12:16:15.953 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-04-26T12:16:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-04-26T12:16:15.974 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-04-26T12:16:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-26T12:16:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:16:16.034 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:16:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T12:16:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-26T12:16:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-26T12:16:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-26T12:16:16.034 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-04-26T12:16:16.111 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T12:16:16.120 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T12:16:16.192 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T12:16:16.193 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:16:16.195 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:16:16.197 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:16:16.200 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:16:16.219 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T12:16:16.230 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T12:16:16.230 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:16:16.256 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:16:16.258 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:16:16.260 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:16:16.289 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T12:16:16.421 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T12:16:16.434 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T12:16:16.435 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T12:16:16.435 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:16:16.435 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:16:16.436 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:16:16.436 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:16:16.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:16:16.455 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-04-26T12:16:16.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:16:16.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:16:16.457 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-04-26T12:16:16.457 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-04-26T12:16:16.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:16:16.458 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2024-04-26T12:16:16.514 INFO:teuthology.orchestra.run.smithi116.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:16.515 INFO:teuthology.task.kernel:Running kernel on smithi116: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:16.515 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2024-04-26T12:16:16.516 INFO:teuthology.orchestra.run.smithi098.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:16.516 INFO:teuthology.task.kernel:Running kernel on smithi098: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:16.516 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2024-04-26T12:16:16.517 INFO:teuthology.orchestra.run.smithi133.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:16.517 INFO:teuthology.task.kernel:Running kernel on smithi133: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:16.517 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum install -y kernel 2024-04-26T12:16:16.520 INFO:teuthology.orchestra.run.smithi038.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:16.520 INFO:teuthology.task.kernel:Running kernel on smithi038: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:16.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2024-04-26T12:16:17.986 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:17.986 INFO:teuthology.orchestra.run.smithi098.stdout:Unable to read consumer identity 2024-04-26T12:16:18.105 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:18.106 INFO:teuthology.orchestra.run.smithi038.stdout:Unable to read consumer identity 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:18.121 INFO:teuthology.orchestra.run.smithi116.stdout:Unable to read consumer identity 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi098.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:16:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:16:18.385 INFO:teuthology.orchestra.run.smithi116.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:16:18.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:16:18.414 INFO:teuthology.orchestra.run.smithi038.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:18.414 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:16:18.428 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:16:18.428 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:18.428 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:16:20.036 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-26T12:16:20.123 INFO:teuthology.orchestra.run.smithi038.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-26T12:16:20.250 INFO:teuthology.orchestra.run.smithi116.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-26T12:16:20.331 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-04-26T12:16:21.203 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-04-26T12:16:21.281 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-26T12:16:22.182 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 16 MB 00:02 2024-04-26T12:16:22.409 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 16 MB 00:02 2024-04-26T12:16:24.818 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 649 kB/s | 24 kB 00:00 2024-04-26T12:16:24.921 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 294 kB/s | 24 kB 00:00 2024-04-26T12:16:25.496 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-26T12:16:25.496 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-26T12:16:25.567 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-04-26T12:16:25.568 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-04-26T12:16:25.568 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-04-26T12:16:25.673 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-26T12:16:25.673 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-26T12:16:25.716 DEBUG:teuthology.orchestra.run.smithi116:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:16:25.760 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-04-26T12:16:25.761 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-04-26T12:16:25.761 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-04-26T12:16:25.903 DEBUG:teuthology.orchestra.run.smithi098:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:16:26.023 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 436 kB/s | 24 kB 00:00 2024-04-26T12:16:26.054 INFO:teuthology.orchestra.run.smithi116.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:26.054 INFO:teuthology.orchestra.run.smithi116.stdout:Unable to read consumer identity 2024-04-26T12:16:26.241 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:26.241 INFO:teuthology.orchestra.run.smithi098.stdout:Unable to read consumer identity 2024-04-26T12:16:26.249 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 307 kB/s | 24 kB 00:00 2024-04-26T12:16:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:16:26.276 INFO:teuthology.orchestra.run.smithi116.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:16:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:16:26.467 INFO:teuthology.orchestra.run.smithi098.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:26.467 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:16:26.589 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 12:16:24 PM UTC. 2024-04-26T12:16:26.656 INFO:teuthology.orchestra.run.smithi116.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T12:16:26.672 INFO:teuthology.orchestra.run.smithi116.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T12:16:26.713 INFO:teuthology.orchestra.run.smithi116.stderr:Error: No packages marked for reinstall. 2024-04-26T12:16:26.760 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum reinstall -y kernel || true 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-26T12:16:26.767 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-26T12:16:26.783 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 12:16:24 PM UTC. 2024-04-26T12:16:26.846 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-04-26T12:16:26.847 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-04-26T12:16:26.847 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-04-26T12:16:26.870 INFO:teuthology.orchestra.run.smithi098.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T12:16:26.870 INFO:teuthology.orchestra.run.smithi098.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T12:16:26.922 INFO:teuthology.orchestra.run.smithi098.stderr:Error: No packages marked for reinstall. 2024-04-26T12:16:26.969 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum reinstall -y kernel || true 2024-04-26T12:16:27.006 DEBUG:teuthology.orchestra.run.smithi133:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:16:27.026 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-26T12:16:27.027 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-26T12:16:27.095 INFO:teuthology.orchestra.run.smithi116.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:27.095 INFO:teuthology.orchestra.run.smithi116.stdout:Unable to read consumer identity 2024-04-26T12:16:27.109 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-26T12:16:27.111 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2024-04-26T12:16:27.111 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-26T12:16:27.271 DEBUG:teuthology.orchestra.run.smithi038:> echo no | sudo yum reinstall kernel || true 2024-04-26T12:16:27.303 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:27.303 INFO:teuthology.orchestra.run.smithi098.stdout:Unable to read consumer identity 2024-04-26T12:16:27.345 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:27.345 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2024-04-26T12:16:27.346 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:16:27.346 INFO:teuthology.orchestra.run.smithi116.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:27.346 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi098.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:27.508 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:16:27.521 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:16:27.522 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:27.522 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:16:27.654 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:16:24 PM UTC. 2024-04-26T12:16:27.660 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:27.660 INFO:teuthology.orchestra.run.smithi038.stdout:Unable to read consumer identity 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi116.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T12:16:27.717 INFO:teuthology.orchestra.run.smithi116.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T12:16:27.767 INFO:teuthology.orchestra.run.smithi116.stderr:Error: No packages marked for reinstall. 2024-04-26T12:16:27.815 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:16:24 PM UTC. 2024-04-26T12:16:27.816 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:16:27.838 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 12:16:25 PM UTC. 2024-04-26T12:16:27.877 INFO:teuthology.orchestra.run.smithi098.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T12:16:27.877 INFO:teuthology.orchestra.run.smithi098.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T12:16:27.912 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:16:27.912 INFO:teuthology.orchestra.run.smithi038.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:27.912 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:16:27.919 INFO:teuthology.orchestra.run.smithi098.stderr:Error: No packages marked for reinstall. 2024-04-26T12:16:27.922 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T12:16:27.925 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T12:16:27.966 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:16:27.974 INFO:teuthology.orchestra.run.smithi133.stderr:Error: No packages marked for reinstall. 2024-04-26T12:16:27.985 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:27.985 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:27.986 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:16:27.986 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T12:16:27.986 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:16:28.019 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-04-26T12:16:28.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum reinstall -y kernel || true 2024-04-26T12:16:28.034 DEBUG:teuthology.parallel:result is None 2024-04-26T12:16:28.129 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:28.129 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:28.129 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:16:28.129 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T12:16:28.130 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:16:28.164 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2024-04-26T12:16:28.177 DEBUG:teuthology.parallel:result is None 2024-04-26T12:16:28.286 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 12:16:26 PM UTC. 2024-04-26T12:16:28.357 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:28.358 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2024-04-26T12:16:28.414 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T12:16:28.421 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T12:16:28.463 INFO:teuthology.orchestra.run.smithi038.stderr:Error: No packages marked for reinstall. 2024-04-26T12:16:28.521 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum reinstall -y kernel || true 2024-04-26T12:16:28.597 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:16:28.597 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:28.597 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:16:28.905 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:16:25 PM UTC. 2024-04-26T12:16:28.947 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2024-04-26T12:16:28.948 INFO:teuthology.orchestra.run.smithi038.stdout:Unable to read consumer identity 2024-04-26T12:16:28.968 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T12:16:28.969 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T12:16:28.998 INFO:teuthology.orchestra.run.smithi133.stderr:Error: No packages marked for reinstall. 2024-04-26T12:16:29.045 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:16:29.171 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:16:29.171 INFO:teuthology.orchestra.run.smithi038.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-26T12:16:29.171 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:16:29.201 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:29.201 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:29.201 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:16:29.201 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T12:16:29.201 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:16:29.237 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2024-04-26T12:16:29.251 DEBUG:teuthology.parallel:result is None 2024-04-26T12:16:29.535 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 12:16:26 PM UTC. 2024-04-26T12:16:29.608 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-26T12:16:29.608 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-26T12:16:29.636 INFO:teuthology.orchestra.run.smithi038.stderr:Error: No packages marked for reinstall. 2024-04-26T12:16:29.692 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:16:29.862 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:29.863 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-26T12:16:29.863 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T12:16:29.863 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T12:16:29.863 DEBUG:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:16:29.897 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2024-04-26T12:16:29.909 DEBUG:teuthology.parallel:result is None 2024-04-26T12:16:29.909 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T12:16:29.916 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T12:16:29.916 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:16:29.952 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:16:29.955 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:16:29.957 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:16:29.977 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T12:16:29.984 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T12:16:30.026 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T12:16:30.026 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:16:30.028 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:16:30.031 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:16:30.033 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:16:30.072 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T12:16:30.101 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T12:16:30.102 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:16:30.104 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:16:30.106 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:16:30.111 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:16:30.138 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:16:30.143 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:16:30.148 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:16:30.148 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:16:30.152 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:16:30.155 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:16:30.162 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:16:30.164 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:16:30.165 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T12:16:30.173 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T12:16:30.173 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:16:30.175 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:16:30.192 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:16:30.199 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:16:30.235 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T12:16:30.245 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T12:16:30.246 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:16:30.251 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:16:30.261 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:16:30.268 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:16:30.293 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:16:30.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:16:30.420 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:16:30.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:16:30.518 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:16:30.518 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:16:30.593 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:16:30.639 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:16:30.697 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:16:30.785 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:16:30.827 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:16:30.827 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:16:30.896 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:16:30.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:16:31.001 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:16:31.086 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:16:31.134 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:16:31.134 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:16:31.203 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:16:31.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:16:31.305 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:16:31.390 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:16:31.438 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:16:31.438 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:16:31.509 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2024-04-26T12:16:31.512 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-04-26T12:16:31.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-04-26T12:16:31.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-04-26T12:16:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:16:31.574 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:16:31.576 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:16:31.606 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:16:32.048 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T12:16:32.056 INFO:teuthology.task.internal:Starting timer... 2024-04-26T12:16:32.056 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T12:16:32.121 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T12:16:32.142 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-26T12:16:32.143 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2024-04-26T12:16:32.215 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: 2024-04-26T12:16:32.217 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-04-26T12:16:32.280 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-04-26T12:16:32.282 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-04-26T12:16:32.336 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-04-26T12:16:32.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2024-04-26T12:16:32.404 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2024-04-26T12:16:32.406 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T12:16:32.406 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2024-04-26T12:16:32.428 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2024-04-26T12:16:32.428 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-04-26T12:16:32.460 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-04-26T12:16:32.460 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-04-26T12:16:32.491 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-04-26T12:16:32.491 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2024-04-26T12:16:32.513 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2024-04-26T12:16:32.513 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive'} 2024-04-26T12:16:32.513 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:16:32.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:16:32.546 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:16:32.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:16:32.574 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:16:32.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:16:32.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:16:32.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:16:32.629 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T12:16:32.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:16:32.660 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:16:32.688 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:16:32.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:16:32.745 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T12:16:32.755 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T12:16:32.772 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T12:16:32.773 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi098.front.sepia.ceph.com,smithi116.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T12:26:54.189 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2024-04-26T12:26:54.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-26T12:26:54.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:26:54.270 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-04-26T12:26:54.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-26T12:26:54.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-26T12:26:54.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:26:54.376 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-04-26T12:26:54.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-26T12:26:54.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-26T12:26:54.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:26:54.524 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-04-26T12:26:54.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-26T12:26:54.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-04-26T12:26:54.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:26:54.624 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-04-26T12:26:54.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-04-26T12:26:54.695 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T12:26:54.705 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T12:26:54.705 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:26:54.706 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:26:54.708 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:26:54.708 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:26:54.710 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:26:54.710 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:26:54.712 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:26:54.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:26:54.742 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:26:54.743 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:26:54.746 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:26:54.757 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:26:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:26:54.765 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:26:54.768 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:26:54.784 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:26:54.827 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-04-26T12:26:54.831 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-04-26T12:26:54.839 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-04-26T12:26:54.843 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-04-26T12:26:54.845 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2024-04-26T12:26:54.855 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:26:54.857 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:26:54.860 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2024-04-26T12:26:54.869 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:26:54.871 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:26:54.878 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:26:54.881 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2024-04-26T12:26:54.894 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2024-04-26T12:26:54.895 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:26:54.909 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:26:54.923 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:26:54.942 INFO:teuthology.orchestra.run.smithi116.stderr:bash: ntpq: command not found 2024-04-26T12:26:54.945 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:26:54.946 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-04-26T12:26:54.946 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.946 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.946 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.946 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.950 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2024-04-26T12:26:54.953 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:26:54.953 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-04-26T12:26:54.954 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.954 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.954 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.954 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.993 INFO:teuthology.orchestra.run.smithi038.stderr:bash: ntpq: command not found 2024-04-26T12:26:54.997 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:26:54.997 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-04-26T12:26:54.998 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.998 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.998 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:54.998 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:55.001 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2024-04-26T12:26:55.005 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:26:55.005 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-04-26T12:26:55.005 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:55.005 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:55.005 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:55.005 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:26:55.006 INFO:teuthology.run_tasks:Running task install... 2024-04-26T12:26:55.015 DEBUG:teuthology.task.install:project ceph 2024-04-26T12:26:55.016 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T12:26:55.016 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T12:26:55.016 INFO:teuthology.task.install:Using flavor: default 2024-04-26T12:26:55.021 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T12:26:55.021 INFO:teuthology.task.install:extra packages: [] 2024-04-26T12:26:55.021 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:26:55.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:26:55.024 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:26:55.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:26:55.025 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:26:55.025 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:26:55.025 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:26:55.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:26:55.171 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:26:55.172 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:26:55.183 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:26:55.183 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:26:55.186 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:26:55.186 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:26:55.251 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:26:55.251 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:26:55.355 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:26:55.355 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:26:55.355 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:26:55.361 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:26:55.361 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:26:55.362 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:26:55.362 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:26:55.362 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:26:55.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:26:55.391 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:26:55.391 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:26:55.393 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:26:55.393 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:26:55.398 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:26:55.398 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:26:55.424 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:26:55.424 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:26:55.424 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:26:55.452 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:26:55.453 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:26:55.459 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:26:55.462 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:26:55.474 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:26:55.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:26:55.537 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:26:55.541 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:26:55.562 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:26:55.595 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2024-04-26T12:26:55.597 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2024-04-26T12:26:55.600 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:26:55.603 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2024-04-26T12:26:55.605 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2024-04-26T12:26:55.607 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-04-26T12:26:55.609 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-04-26T12:26:55.666 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-04-26T12:26:55.667 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-04-26T12:26:55.982 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-04-26T12:26:55.989 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2024-04-26T12:26:56.032 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2024-04-26T12:26:56.042 INFO:teuthology.orchestra.run.smithi116.stdout:Updating Subscription Management repositories. 2024-04-26T12:26:57.331 INFO:teuthology.orchestra.run.smithi098.stdout:63 files removed 2024-04-26T12:26:57.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:26:57.427 INFO:teuthology.orchestra.run.smithi133.stdout:63 files removed 2024-04-26T12:26:57.447 INFO:teuthology.orchestra.run.smithi038.stdout:63 files removed 2024-04-26T12:26:57.453 INFO:teuthology.orchestra.run.smithi116.stdout:63 files removed 2024-04-26T12:26:57.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:26:57.503 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:26:57.505 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:26:57.723 INFO:teuthology.orchestra.run.smithi098.stdout:Updating Subscription Management repositories. 2024-04-26T12:26:57.818 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-04-26T12:26:57.841 INFO:teuthology.orchestra.run.smithi116.stdout:Updating Subscription Management repositories. 2024-04-26T12:26:57.891 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2024-04-26T12:26:59.544 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 273 kB/s | 80 kB 00:00 2024-04-26T12:26:59.784 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 204 kB/s | 80 kB 00:00 2024-04-26T12:26:59.797 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 229 kB/s | 80 kB 00:00 2024-04-26T12:26:59.813 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 199 kB/s | 80 kB 00:00 2024-04-26T12:26:59.836 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 44 kB/s | 11 kB 00:00 2024-04-26T12:27:00.106 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-04-26T12:27:00.118 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 38 kB/s | 11 kB 00:00 2024-04-26T12:27:00.122 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 41 kB/s | 11 kB 00:00 2024-04-26T12:27:00.153 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2024-04-26T12:27:00.411 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2024-04-26T12:27:00.412 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2024-04-26T12:27:00.474 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2024-04-26T12:27:00.482 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2024-04-26T12:27:00.570 INFO:teuthology.orchestra.run.smithi098.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-26T12:27:00.640 INFO:teuthology.orchestra.run.smithi038.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-26T12:27:00.641 INFO:teuthology.orchestra.run.smithi116.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-26T12:27:01.833 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-26T12:27:02.006 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-04-26T12:27:02.135 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 16 MB 00:01 2024-04-26T12:27:02.327 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2024-04-26T12:27:05.621 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 425 kB/s | 24 kB 00:00 2024-04-26T12:27:05.697 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 396 kB/s | 24 kB 00:00 2024-04-26T12:27:05.883 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 368 kB/s | 24 kB 00:00 2024-04-26T12:27:05.950 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 562 kB/s | 24 kB 00:00 2024-04-26T12:27:06.332 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 16 MB/s | 8.8 MB 00:00 2024-04-26T12:27:06.543 INFO:teuthology.orchestra.run.smithi116.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 15 MB/s | 8.8 MB 00:00 2024-04-26T12:27:07.048 INFO:teuthology.orchestra.run.smithi098.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 67 MB 00:01 2024-04-26T12:27:07.418 INFO:teuthology.orchestra.run.smithi038.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 44 MB/s | 60 MB 00:01 2024-04-26T12:27:09.092 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 49 MB/s | 60 MB 00:01 2024-04-26T12:27:09.403 INFO:teuthology.orchestra.run.smithi116.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 67 MB 00:01 2024-04-26T12:27:17.890 INFO:teuthology.orchestra.run.smithi098.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 60 MB 00:01 2024-04-26T12:27:20.445 INFO:teuthology.orchestra.run.smithi116.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 60 MB 00:01 2024-04-26T12:27:20.474 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 52 MB/s | 67 MB 00:01 2024-04-26T12:27:20.577 INFO:teuthology.orchestra.run.smithi038.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 MB/s | 67 MB 00:01 2024-04-26T12:27:28.775 INFO:teuthology.orchestra.run.smithi098.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi038.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-04-26T12:27:35.455 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:27:35.456 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:27:35.686 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-04-26T12:27:35.699 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================================================================== 2024-04-26T12:27:35.699 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-04-26T12:27:35.699 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================================================================== 2024-04-26T12:27:35.699 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-04-26T12:27:35.699 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-26T12:27:35.699 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:27:35.699 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:27:35.699 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:27:35.700 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:27:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:27:35.702 INFO:teuthology.orchestra.run.smithi133.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:27:35.703 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-26T12:27:35.704 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-26T12:27:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:27:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:27:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:27:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:27:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-26T12:27:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:27:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-26T12:27:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-26T12:27:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:27:35.710 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-04-26T12:27:35.710 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================================================================== 2024-04-26T12:27:35.710 INFO:teuthology.orchestra.run.smithi133.stdout:Install 122 Packages 2024-04-26T12:27:35.710 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 14 Packages 2024-04-26T12:27:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:27:35.711 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 206 M 2024-04-26T12:27:35.711 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-04-26T12:27:36.043 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:27:36.044 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:27:36.049 INFO:teuthology.orchestra.run.smithi133.stdout:(1/136): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2024-04-26T12:27:36.096 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:27:36.098 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:27:36.278 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-04-26T12:27:36.291 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================================================================== 2024-04-26T12:27:36.291 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-04-26T12:27:36.291 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================================================================== 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:27:36.292 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-26T12:27:36.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-26T12:27:36.294 INFO:teuthology.orchestra.run.smithi116.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:27:36.295 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-26T12:27:36.296 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-26T12:27:36.297 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:27:36.298 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-26T12:27:36.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-26T12:27:36.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-26T12:27:36.301 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================================================================== 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout:Install 122 Packages 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 14 Packages 2024-04-26T12:27:36.302 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:27:36.303 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 206 M 2024-04-26T12:27:36.303 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-04-26T12:27:36.327 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-04-26T12:27:36.340 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================================================================== 2024-04-26T12:27:36.340 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-04-26T12:27:36.340 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================================================================== 2024-04-26T12:27:36.340 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:27:36.341 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:27:36.342 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-26T12:27:36.343 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:27:36.344 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:27:36.345 INFO:teuthology.orchestra.run.smithi098.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-26T12:27:36.346 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-26T12:27:36.347 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:27:36.348 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:27:36.349 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-26T12:27:36.350 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:27:36.351 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-04-26T12:27:36.351 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================================================================== 2024-04-26T12:27:36.351 INFO:teuthology.orchestra.run.smithi098.stdout:Install 122 Packages 2024-04-26T12:27:36.351 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 14 Packages 2024-04-26T12:27:36.351 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:27:36.351 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 206 M 2024-04-26T12:27:36.351 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-04-26T12:27:36.415 INFO:teuthology.orchestra.run.smithi133.stdout:(2/136): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 10 MB/s | 5.5 MB 00:00 2024-04-26T12:27:36.449 INFO:teuthology.orchestra.run.smithi133.stdout:(3/136): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 2.1 MB/s | 859 kB 00:00 2024-04-26T12:27:36.474 INFO:teuthology.orchestra.run.smithi133.stdout:(4/136): ceph-immutable-object-cache-18.2.2-125 2.8 MB/s | 165 kB 00:00 2024-04-26T12:27:36.578 INFO:teuthology.orchestra.run.smithi116.stdout:(1/136): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 31 kB/s | 6.4 kB 00:00 2024-04-26T12:27:36.613 INFO:teuthology.orchestra.run.smithi133.stdout:(5/136): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 11 MB/s | 1.6 MB 00:00 2024-04-26T12:27:36.671 INFO:teuthology.orchestra.run.smithi098.stdout:(1/136): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 39 kB/s | 6.4 kB 00:00 2024-04-26T12:27:36.975 INFO:teuthology.orchestra.run.smithi133.stdout:(6/136): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 13 MB/s | 4.8 MB 00:00 2024-04-26T12:27:37.051 INFO:teuthology.orchestra.run.smithi133.stdout:(7/136): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 3.8 MB/s | 2.3 MB 00:00 2024-04-26T12:27:37.454 INFO:teuthology.orchestra.run.smithi098.stdout:(2/136): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.1 MB/s | 859 kB 00:00 2024-04-26T12:27:37.635 INFO:teuthology.orchestra.run.smithi098.stdout:(3/136): ceph-immutable-object-cache-18.2.2-125 903 kB/s | 165 kB 00:00 2024-04-26T12:27:37.695 INFO:teuthology.orchestra.run.smithi116.stdout:(2/136): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 769 kB/s | 859 kB 00:01 2024-04-26T12:27:38.185 INFO:teuthology.orchestra.run.smithi116.stdout:(3/136): ceph-immutable-object-cache-18.2.2-125 337 kB/s | 165 kB 00:00 2024-04-26T12:27:38.670 INFO:teuthology.orchestra.run.smithi116.stdout:(4/136): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 2.4 MB/s | 5.5 MB 00:02 2024-04-26T12:27:38.686 INFO:teuthology.orchestra.run.smithi133.stdout:(8/136): ceph-osd-18.2.2-1256.gdc093b5e.el8.x86 11 MB/s | 18 MB 00:01 2024-04-26T12:27:38.759 INFO:teuthology.orchestra.run.smithi133.stdout:(9/136): ceph-selinux-18.2.2-1256.gdc093b5e.el8 325 kB/s | 24 kB 00:00 2024-04-26T12:27:39.102 INFO:teuthology.orchestra.run.smithi098.stdout:(4/136): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 1.5 MB/s | 2.3 MB 00:01 2024-04-26T12:27:39.259 INFO:teuthology.orchestra.run.smithi116.stdout:(5/136): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 2.6 MB/s | 1.6 MB 00:00 2024-04-26T12:27:40.185 INFO:teuthology.orchestra.run.smithi098.stdout:(5/136): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 1.4 MB/s | 1.6 MB 00:01 2024-04-26T12:27:40.564 INFO:teuthology.orchestra.run.smithi116.stdout:(6/136): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 978 kB/s | 2.3 MB 00:02 2024-04-26T12:27:40.611 INFO:teuthology.orchestra.run.smithi133.stdout:(10/136): ceph-radosgw-18.2.2-1256.gdc093b5e.el 3.7 MB/s | 13 MB 00:03 2024-04-26T12:27:40.623 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi098.stdout:(6/136): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 1.3 MB/s | 5.5 MB 00:04 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi133.stdout:(11/136): libcephfs-devel-18.2.2-1256.gdc093b5e 316 kB/s | 31 kB 00:00 2024-04-26T12:27:40.773 INFO:teuthology.orchestra.run.smithi116.stdout:(7/136): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 3.2 MB/s | 4.8 MB 00:01 2024-04-26T12:27:40.881 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2024-04-26T12:27:40.896 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================================================================== 2024-04-26T12:27:40.896 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================================================================== 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:27:40.897 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-26T12:27:40.898 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-26T12:27:40.899 INFO:teuthology.orchestra.run.smithi038.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:27:40.900 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:27:40.901 INFO:teuthology.orchestra.run.smithi038.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-26T12:27:40.902 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:27:40.903 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-26T12:27:40.904 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-26T12:27:40.905 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:27:40.906 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2024-04-26T12:27:40.907 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================================================================== 2024-04-26T12:27:40.908 INFO:teuthology.orchestra.run.smithi038.stdout:Install 122 Packages 2024-04-26T12:27:40.908 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 14 Packages 2024-04-26T12:27:40.908 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:27:40.908 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 206 M 2024-04-26T12:27:40.908 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2024-04-26T12:27:41.043 INFO:teuthology.orchestra.run.smithi133.stdout:(12/136): libcephfs2-18.2.2-1256.gdc093b5e.el8. 2.3 MB/s | 781 kB 00:00 2024-04-26T12:27:41.152 INFO:teuthology.orchestra.run.smithi133.stdout:(13/136): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.3 MB/s | 142 kB 00:00 2024-04-26T12:27:41.260 INFO:teuthology.orchestra.run.smithi133.stdout:(14/136): librados-devel-18.2.2-1256.gdc093b5e. 1.3 MB/s | 139 kB 00:00 2024-04-26T12:27:41.387 INFO:teuthology.orchestra.run.smithi038.stdout:(1/136): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2024-04-26T12:27:41.461 INFO:teuthology.orchestra.run.smithi133.stdout:(15/136): libradosstriper1-18.2.2-1256.gdc093b5 2.3 MB/s | 474 kB 00:00 2024-04-26T12:27:41.760 INFO:teuthology.orchestra.run.smithi098.stdout:(7/136): ceph-common-18.2.2-1256.gdc093b5e.el8. 4.1 MB/s | 22 MB 00:05 2024-04-26T12:27:42.104 INFO:teuthology.orchestra.run.smithi038.stdout:(2/136): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.2 MB/s | 859 kB 00:00 2024-04-26T12:27:42.254 INFO:teuthology.orchestra.run.smithi038.stdout:(3/136): ceph-immutable-object-cache-18.2.2-125 1.1 MB/s | 165 kB 00:00 2024-04-26T12:27:42.871 INFO:teuthology.orchestra.run.smithi038.stdout:(4/136): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 3.1 MB/s | 5.5 MB 00:01 2024-04-26T12:27:43.144 INFO:teuthology.orchestra.run.smithi133.stdout:(16/136): ceph-common-18.2.2-1256.gdc093b5e.el8 3.0 MB/s | 22 MB 00:07 2024-04-26T12:27:43.286 INFO:teuthology.orchestra.run.smithi133.stdout:(17/136): python3-ceph-argparse-18.2.2-1256.gdc 315 kB/s | 45 kB 00:00 2024-04-26T12:27:43.352 INFO:teuthology.orchestra.run.smithi098.stdout:(8/136): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 1.5 MB/s | 4.8 MB 00:03 2024-04-26T12:27:43.357 INFO:teuthology.orchestra.run.smithi038.stdout:(5/136): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 3.2 MB/s | 1.6 MB 00:00 2024-04-26T12:27:43.453 INFO:teuthology.orchestra.run.smithi098.stdout:(9/136): ceph-selinux-18.2.2-1256.gdc093b5e.el8 244 kB/s | 24 kB 00:00 2024-04-26T12:27:43.478 INFO:teuthology.orchestra.run.smithi133.stdout:(18/136): python3-ceph-common-18.2.2-1256.gdc09 673 kB/s | 129 kB 00:00 2024-04-26T12:27:43.603 INFO:teuthology.orchestra.run.smithi133.stdout:(19/136): python3-cephfs-18.2.2-1256.gdc093b5e. 1.5 MB/s | 197 kB 00:00 2024-04-26T12:27:43.829 INFO:teuthology.orchestra.run.smithi133.stdout:(20/136): python3-rados-18.2.2-1256.gdc093b5e.e 1.6 MB/s | 371 kB 00:00 2024-04-26T12:27:43.930 INFO:teuthology.orchestra.run.smithi038.stdout:(6/136): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 1.4 MB/s | 2.3 MB 00:01 2024-04-26T12:27:44.029 INFO:teuthology.orchestra.run.smithi133.stdout:(21/136): python3-rbd-18.2.2-1256.gdc093b5e.el8 1.8 MB/s | 364 kB 00:00 2024-04-26T12:27:44.146 INFO:teuthology.orchestra.run.smithi133.stdout:(22/136): python3-rgw-18.2.2-1256.gdc093b5e.el8 916 kB/s | 107 kB 00:00 2024-04-26T12:27:44.263 INFO:teuthology.orchestra.run.smithi133.stdout:(23/136): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 816 kB/s | 95 kB 00:00 2024-04-26T12:27:44.446 INFO:teuthology.orchestra.run.smithi133.stdout:(24/136): librgw2-18.2.2-1256.gdc093b5e.el8.x86 2.2 MB/s | 6.6 MB 00:02 2024-04-26T12:27:44.613 INFO:teuthology.orchestra.run.smithi133.stdout:(25/136): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.1 MB/s | 181 kB 00:00 2024-04-26T12:27:44.730 INFO:teuthology.orchestra.run.smithi133.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1256.g 208 kB/s | 24 kB 00:00 2024-04-26T12:27:44.905 INFO:teuthology.orchestra.run.smithi133.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 790 kB/s | 138 kB 00:00 2024-04-26T12:27:45.173 INFO:teuthology.orchestra.run.smithi116.stdout:(8/136): ceph-common-18.2.2-1256.gdc093b5e.el8. 2.5 MB/s | 22 MB 00:08 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi116.stdout:(9/136): ceph-selinux-18.2.2-1256.gdc093b5e.el8 224 kB/s | 24 kB 00:00 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi038.stdout:(7/136): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 2.5 MB/s | 4.8 MB 00:01 2024-04-26T12:27:45.598 INFO:teuthology.orchestra.run.smithi116.stdout:(10/136): ceph-radosgw-18.2.2-1256.gdc093b5e.el 2.7 MB/s | 13 MB 00:04 2024-04-26T12:27:45.665 INFO:teuthology.orchestra.run.smithi116.stdout:(11/136): libcephfs-devel-18.2.2-1256.gdc093b5e 467 kB/s | 31 kB 00:00 2024-04-26T12:27:45.747 INFO:teuthology.orchestra.run.smithi133.stdout:(28/136): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 2.3 MB/s | 3.5 MB 00:01 2024-04-26T12:27:45.949 INFO:teuthology.orchestra.run.smithi116.stdout:(12/136): libcephfs2-18.2.2-1256.gdc093b5e.el8. 2.7 MB/s | 781 kB 00:00 2024-04-26T12:27:46.016 INFO:teuthology.orchestra.run.smithi116.stdout:(13/136): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.1 MB/s | 142 kB 00:00 2024-04-26T12:27:46.116 INFO:teuthology.orchestra.run.smithi116.stdout:(14/136): librados-devel-18.2.2-1256.gdc093b5e. 1.4 MB/s | 139 kB 00:00 2024-04-26T12:27:46.169 INFO:teuthology.orchestra.run.smithi098.stdout:(10/136): ceph-radosgw-18.2.2-1256.gdc093b5e.el 3.0 MB/s | 13 MB 00:04 2024-04-26T12:27:46.197 INFO:teuthology.orchestra.run.smithi038.stdout:(8/136): ceph-common-18.2.2-1256.gdc093b5e.el8. 4.2 MB/s | 22 MB 00:05 2024-04-26T12:27:46.236 INFO:teuthology.orchestra.run.smithi098.stdout:(11/136): libcephfs-devel-18.2.2-1256.gdc093b5e 466 kB/s | 31 kB 00:00 2024-04-26T12:27:46.266 INFO:teuthology.orchestra.run.smithi116.stdout:(15/136): libradosstriper1-18.2.2-1256.gdc093b5 3.1 MB/s | 474 kB 00:00 2024-04-26T12:27:46.280 INFO:teuthology.orchestra.run.smithi038.stdout:(9/136): ceph-selinux-18.2.2-1256.gdc093b5e.el8 292 kB/s | 24 kB 00:00 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi133.stdout:(29/136): ceph-mgr-dashboard-18.2.2-1256.gdc093 2.4 MB/s | 3.5 MB 00:01 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi098.stdout:(12/136): libcephfs2-18.2.2-1256.gdc093b5e.el8. 3.4 MB/s | 781 kB 00:00 2024-04-26T12:27:46.554 INFO:teuthology.orchestra.run.smithi098.stdout:(13/136): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.5 MB/s | 142 kB 00:00 2024-04-26T12:27:46.581 INFO:teuthology.orchestra.run.smithi133.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1256.gdc 1.4 MB/s | 246 kB 00:00 2024-04-26T12:27:46.646 INFO:teuthology.orchestra.run.smithi098.stdout:(14/136): librados-devel-18.2.2-1256.gdc093b5e. 1.5 MB/s | 139 kB 00:00 2024-04-26T12:27:46.681 INFO:teuthology.orchestra.run.smithi133.stdout:(31/136): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 493 kB/s | 49 kB 00:00 2024-04-26T12:27:46.790 INFO:teuthology.orchestra.run.smithi133.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1256.gd 140 kB/s | 15 kB 00:00 2024-04-26T12:27:46.854 INFO:teuthology.orchestra.run.smithi098.stdout:(15/136): libradosstriper1-18.2.2-1256.gdc093b5 2.2 MB/s | 474 kB 00:00 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi133.stdout:(33/136): ceph-volume-18.2.2-1256.gdc093b5e.el8 1.2 MB/s | 263 kB 00:00 2024-04-26T12:27:47.199 INFO:teuthology.orchestra.run.smithi133.stdout:(34/136): cephadm-18.2.2-1256.gdc093b5e.el8.noa 888 kB/s | 173 kB 00:00 2024-04-26T12:27:47.374 INFO:teuthology.orchestra.run.smithi133.stdout:(35/136): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2024-04-26T12:27:47.424 INFO:teuthology.orchestra.run.smithi133.stdout:(36/136): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2024-04-26T12:27:47.475 INFO:teuthology.orchestra.run.smithi133.stdout:(37/136): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-04-26T12:27:47.567 INFO:teuthology.orchestra.run.smithi133.stdout:(38/136): python3-asyncssh-2.7.0-2.el8.noarch.r 5.1 MB/s | 476 kB 00:00 2024-04-26T12:27:47.617 INFO:teuthology.orchestra.run.smithi133.stdout:(39/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 876 kB/s | 44 kB 00:00 2024-04-26T12:27:47.667 INFO:teuthology.orchestra.run.smithi133.stdout:(40/136): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2024-04-26T12:27:47.709 INFO:teuthology.orchestra.run.smithi133.stdout:(41/136): python3-cachetools-3.1.1-4.el8.noarch 794 kB/s | 33 kB 00:00 2024-04-26T12:27:47.751 INFO:teuthology.orchestra.run.smithi133.stdout:(42/136): python3-certifi-2018.10.15-7.el8.noar 393 kB/s | 16 kB 00:00 2024-04-26T12:27:47.818 INFO:teuthology.orchestra.run.smithi133.stdout:(43/136): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2024-04-26T12:27:47.885 INFO:teuthology.orchestra.run.smithi133.stdout:(44/136): python3-cherrypy-18.4.0-1.el8.noarch. 5.6 MB/s | 384 kB 00:00 2024-04-26T12:27:47.927 INFO:teuthology.orchestra.run.smithi133.stdout:(45/136): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2024-04-26T12:27:47.961 INFO:teuthology.orchestra.run.smithi133.stdout:(46/136): python3-jaraco-6.2-6.el8.noarch.rpm 335 kB/s | 11 kB 00:00 2024-04-26T12:27:47.995 INFO:teuthology.orchestra.run.smithi133.stdout:(47/136): python3-jaraco-functools-2.0-4.el8.no 527 kB/s | 18 kB 00:00 2024-04-26T12:27:48.145 INFO:teuthology.orchestra.run.smithi133.stdout:(48/136): python3-kubernetes-11.0.0-6.el8.noarc 7.8 MB/s | 1.2 MB 00:00 2024-04-26T12:27:48.220 INFO:teuthology.orchestra.run.smithi133.stdout:(49/136): ceph-mgr-diskprediction-local-18.2.2- 3.0 MB/s | 7.4 MB 00:02 2024-04-26T12:27:48.237 INFO:teuthology.orchestra.run.smithi133.stdout:(50/136): python3-logutils-0.3.5-11.el8.noarch. 530 kB/s | 49 kB 00:00 2024-04-26T12:27:48.270 INFO:teuthology.orchestra.run.smithi133.stdout:(51/136): python3-natsort-7.1.1-2.el8.noarch.rp 1.8 MB/s | 60 kB 00:00 2024-04-26T12:27:48.591 INFO:teuthology.orchestra.run.smithi116.stdout:(16/136): librgw2-18.2.2-1256.gdc093b5e.el8.x86 2.8 MB/s | 6.6 MB 00:02 2024-04-26T12:27:48.629 INFO:teuthology.orchestra.run.smithi098.stdout:(16/136): librgw2-18.2.2-1256.gdc093b5e.el8.x86 3.7 MB/s | 6.6 MB 00:01 2024-04-26T12:27:48.641 INFO:teuthology.orchestra.run.smithi116.stdout:(17/136): python3-ceph-argparse-18.2.2-1256.gdc 897 kB/s | 45 kB 00:00 2024-04-26T12:27:48.704 INFO:teuthology.orchestra.run.smithi133.stdout:(52/136): ceph-test-18.2.2-1256.gdc093b5e.el8.x 4.7 MB/s | 47 MB 00:09 2024-04-26T12:27:48.713 INFO:teuthology.orchestra.run.smithi098.stdout:(17/136): python3-ceph-argparse-18.2.2-1256.gdc 536 kB/s | 45 kB 00:00 2024-04-26T12:27:48.721 INFO:teuthology.orchestra.run.smithi133.stdout:(53/136): python3-more-itertools-7.2.0-3.el8.no 117 kB/s | 59 kB 00:00 2024-04-26T12:27:48.746 INFO:teuthology.orchestra.run.smithi133.stdout:(54/136): python3-pecan-1.3.2-9.el8.noarch.rpm 595 kB/s | 283 kB 00:00 2024-04-26T12:27:48.771 INFO:teuthology.orchestra.run.smithi098.stdout:(18/136): python3-ceph-common-18.2.2-1256.gdc09 2.2 MB/s | 129 kB 00:00 2024-04-26T12:27:48.780 INFO:teuthology.orchestra.run.smithi133.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 574 kB/s | 34 kB 00:00 2024-04-26T12:27:48.813 INFO:teuthology.orchestra.run.smithi133.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2024-04-26T12:27:48.830 INFO:teuthology.orchestra.run.smithi098.stdout:(19/136): python3-cephfs-18.2.2-1256.gdc093b5e. 3.3 MB/s | 197 kB 00:00 2024-04-26T12:27:48.830 INFO:teuthology.orchestra.run.smithi133.stdout:(57/136): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2024-04-26T12:27:48.856 INFO:teuthology.orchestra.run.smithi133.stdout:(58/136): python3-rsa-4.9-2.el8.noarch.rpm 850 kB/s | 64 kB 00:00 2024-04-26T12:27:48.873 INFO:teuthology.orchestra.run.smithi116.stdout:(18/136): python3-ceph-common-18.2.2-1256.gdc09 556 kB/s | 129 kB 00:00 2024-04-26T12:27:48.881 INFO:teuthology.orchestra.run.smithi133.stdout:(59/136): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2024-04-26T12:27:48.906 INFO:teuthology.orchestra.run.smithi133.stdout:(60/136): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2024-04-26T12:27:48.939 INFO:teuthology.orchestra.run.smithi098.stdout:(20/136): python3-rados-18.2.2-1256.gdc093b5e.e 3.3 MB/s | 371 kB 00:00 2024-04-26T12:27:48.960 INFO:teuthology.orchestra.run.smithi133.stdout:(61/136): python3-tempora-1.14.1-5.el8.noarch.r 281 kB/s | 29 kB 00:00 2024-04-26T12:27:48.990 INFO:teuthology.orchestra.run.smithi133.stdout:(62/136): python3-trustme-0.6.0-4.el8.noarch.rp 252 kB/s | 27 kB 00:00 2024-04-26T12:27:48.992 INFO:teuthology.orchestra.run.smithi116.stdout:(19/136): python3-cephfs-18.2.2-1256.gdc093b5e. 1.6 MB/s | 197 kB 00:00 2024-04-26T12:27:49.015 INFO:teuthology.orchestra.run.smithi133.stdout:(63/136): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2024-04-26T12:27:49.041 INFO:teuthology.orchestra.run.smithi133.stdout:(64/136): python3-webob-1.8.5-1.el8.1.noarch.rp 3.0 MB/s | 251 kB 00:00 2024-04-26T12:27:49.055 INFO:teuthology.orchestra.run.smithi098.stdout:(21/136): python3-rbd-18.2.2-1256.gdc093b5e.el8 3.1 MB/s | 364 kB 00:00 2024-04-26T12:27:49.066 INFO:teuthology.orchestra.run.smithi133.stdout:(65/136): python3-websocket-client-0.56.0-5.el8 813 kB/s | 61 kB 00:00 2024-04-26T12:27:49.091 INFO:teuthology.orchestra.run.smithi133.stdout:(66/136): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2024-04-26T12:27:49.116 INFO:teuthology.orchestra.run.smithi133.stdout:(67/136): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2024-04-26T12:27:49.117 INFO:teuthology.orchestra.run.smithi116.stdout:(20/136): python3-rados-18.2.2-1256.gdc093b5e.e 2.9 MB/s | 371 kB 00:00 2024-04-26T12:27:49.122 INFO:teuthology.orchestra.run.smithi098.stdout:(22/136): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.6 MB/s | 107 kB 00:00 2024-04-26T12:27:49.135 INFO:teuthology.orchestra.run.smithi133.stdout:(68/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.2 MB/s | 70 kB 00:00 2024-04-26T12:27:49.189 INFO:teuthology.orchestra.run.smithi098.stdout:(23/136): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.4 MB/s | 95 kB 00:00 2024-04-26T12:27:49.234 INFO:teuthology.orchestra.run.smithi116.stdout:(21/136): python3-rbd-18.2.2-1256.gdc093b5e.el8 3.1 MB/s | 364 kB 00:00 2024-04-26T12:27:49.292 INFO:teuthology.orchestra.run.smithi133.stdout:(69/136): python3-packaging-16.8-9.el8.noarch.r 276 kB/s | 48 kB 00:00 2024-04-26T12:27:49.309 INFO:teuthology.orchestra.run.smithi116.stdout:(22/136): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.4 MB/s | 107 kB 00:00 2024-04-26T12:27:49.317 INFO:teuthology.orchestra.run.smithi133.stdout:(70/136): python3-jsonpointer-1.10-11.el8.noarc 112 kB/s | 20 kB 00:00 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi116.stdout:(23/136): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.4 MB/s | 95 kB 00:00 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi133.stdout:(71/136): python3-prettytable-0.7.2-14.el8.noar 329 kB/s | 44 kB 00:00 2024-04-26T12:27:49.491 INFO:teuthology.orchestra.run.smithi133.stdout:(72/136): python3-pyasn1-modules-0.3.7-6.el8.no 634 kB/s | 110 kB 00:00 2024-04-26T12:27:49.568 INFO:teuthology.orchestra.run.smithi133.stdout:(73/136): thrift-0.13.0-2.el8.x86_64.rpm 3.5 MB/s | 1.7 MB 00:00 2024-04-26T12:27:49.593 INFO:teuthology.orchestra.run.smithi133.stdout:(74/136): python3-jsonpatch-1.21-2.el8.noarch.r 159 kB/s | 27 kB 00:00 2024-04-26T12:27:49.627 INFO:teuthology.orchestra.run.smithi133.stdout:(75/136): python3-pyasn1-0.3.7-6.el8.noarch.rpm 933 kB/s | 126 kB 00:00 2024-04-26T12:27:49.786 INFO:teuthology.orchestra.run.smithi133.stdout:(76/136): python3-werkzeug-0.12.2-4.el8.noarch. 2.1 MB/s | 457 kB 00:00 2024-04-26T12:27:49.828 INFO:teuthology.orchestra.run.smithi133.stdout:(77/136): bison-3.0.4-10.el8.x86_64.rpm 2.9 MB/s | 688 kB 00:00 2024-04-26T12:27:49.853 INFO:teuthology.orchestra.run.smithi133.stdout:(78/136): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi098.stdout:(24/136): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 4.4 MB/s | 3.5 MB 00:00 2024-04-26T12:27:50.057 INFO:teuthology.orchestra.run.smithi098.stdout:(25/136): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 2.4 MB/s | 181 kB 00:00 2024-04-26T12:27:50.124 INFO:teuthology.orchestra.run.smithi098.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1256.g 365 kB/s | 24 kB 00:00 2024-04-26T12:27:50.199 INFO:teuthology.orchestra.run.smithi098.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.8 MB/s | 138 kB 00:00 2024-04-26T12:27:50.275 INFO:teuthology.orchestra.run.smithi133.stdout:(79/136): libtool-2.4.6-25.el8.x86_64.rpm 1.4 MB/s | 709 kB 00:00 2024-04-26T12:27:50.318 INFO:teuthology.orchestra.run.smithi116.stdout:(24/136): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 3.7 MB/s | 3.5 MB 00:00 2024-04-26T12:27:50.402 INFO:teuthology.orchestra.run.smithi116.stdout:(25/136): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 2.1 MB/s | 181 kB 00:00 2024-04-26T12:27:50.403 INFO:teuthology.orchestra.run.smithi133.stdout:(80/136): python3-markupsafe-0.23-19.el8.x86_64 67 kB/s | 39 kB 00:00 2024-04-26T12:27:50.428 INFO:teuthology.orchestra.run.smithi133.stdout:(81/136): python3-pyOpenSSL-19.0.0-1.el8.noarch 675 kB/s | 103 kB 00:00 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi133.stdout:(82/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 431 kB/s | 259 kB 00:00 2024-04-26T12:27:50.469 INFO:teuthology.orchestra.run.smithi116.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1256.g 365 kB/s | 24 kB 00:00 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi116.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.6 MB/s | 138 kB 00:00 2024-04-26T12:27:50.650 INFO:teuthology.orchestra.run.smithi133.stdout:(83/136): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2024-04-26T12:27:50.688 INFO:teuthology.orchestra.run.smithi133.stdout:(84/136): python3-jinja2-2.10.1-3.el8.noarch.rp 2.0 MB/s | 538 kB 00:00 2024-04-26T12:27:50.797 INFO:teuthology.orchestra.run.smithi133.stdout:(85/136): python3-numpy-1.14.3-10.el8.x86_64.rp 11 MB/s | 3.7 MB 00:00 2024-04-26T12:27:50.821 INFO:teuthology.orchestra.run.smithi133.stdout:(86/136): socat-1.7.4.1-1.el8.x86_64.rpm 1.8 MB/s | 323 kB 00:00 2024-04-26T12:27:50.872 INFO:teuthology.orchestra.run.smithi133.stdout:(87/136): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.2 MB/s | 225 kB 00:00 2024-04-26T12:27:50.956 INFO:teuthology.orchestra.run.smithi133.stdout:(88/136): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2024-04-26T12:27:50.983 INFO:teuthology.orchestra.run.smithi098.stdout:(28/136): ceph-mgr-dashboard-18.2.2-1256.gdc093 4.5 MB/s | 3.5 MB 00:00 2024-04-26T12:27:51.014 INFO:teuthology.orchestra.run.smithi133.stdout:(89/136): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-04-26T12:27:51.139 INFO:teuthology.orchestra.run.smithi133.stdout:(90/136): openblas-threads-0.3.15-6.el8.x86_64. 16 MB/s | 5.2 MB 00:00 2024-04-26T12:27:51.240 INFO:teuthology.orchestra.run.smithi133.stdout:(91/136): openblas-0.3.15-6.el8.x86_64.rpm 18 MB/s | 5.0 MB 00:00 2024-04-26T12:27:51.273 INFO:teuthology.orchestra.run.smithi133.stdout:(92/136): automake-1.16.1-8.el8.noarch.rpm 2.7 MB/s | 714 kB 00:00 2024-04-26T12:27:51.298 INFO:teuthology.orchestra.run.smithi133.stdout:(93/136): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2024-04-26T12:27:51.366 INFO:teuthology.orchestra.run.smithi133.stdout:(94/136): python3-pytz-2017.2-11.el8.noarch.rpm 432 kB/s | 54 kB 00:00 2024-04-26T12:27:51.416 INFO:teuthology.orchestra.run.smithi133.stdout:(95/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-04-26T12:27:51.464 INFO:teuthology.orchestra.run.smithi038.stdout:(10/136): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 2.4 MB/s | 18 MB 00:07 2024-04-26T12:27:51.474 INFO:teuthology.orchestra.run.smithi133.stdout:(96/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 165 kB/s | 18 kB 00:00 2024-04-26T12:27:51.494 INFO:teuthology.orchestra.run.smithi116.stdout:(28/136): ceph-mgr-dashboard-18.2.2-1256.gdc093 3.7 MB/s | 3.5 MB 00:00 2024-04-26T12:27:51.522 INFO:teuthology.orchestra.run.smithi038.stdout:(11/136): libcephfs-devel-18.2.2-1256.gdc093b5e 535 kB/s | 31 kB 00:00 2024-04-26T12:27:51.533 INFO:teuthology.orchestra.run.smithi133.stdout:(97/136): python3-jwt-1.6.1-2.el8.noarch.rpm 365 kB/s | 43 kB 00:00 2024-04-26T12:27:51.758 INFO:teuthology.orchestra.run.smithi133.stdout:(98/136): python3-scipy-1.0.0-21.module+el8.9.0 28 MB/s | 14 MB 00:00 2024-04-26T12:27:51.784 INFO:teuthology.orchestra.run.smithi133.stdout:(99/136): python3-pycparser-2.14-14.el8.noarch. 436 kB/s | 109 kB 00:00 2024-04-26T12:27:51.809 INFO:teuthology.orchestra.run.smithi133.stdout:(100/136): python3-oauthlib-2.1.0-1.el8.noarch. 464 kB/s | 155 kB 00:00 2024-04-26T12:27:51.847 INFO:teuthology.orchestra.run.smithi038.stdout:(12/136): libcephfs2-18.2.2-1256.gdc093b5e.el8. 2.3 MB/s | 781 kB 00:00 2024-04-26T12:27:51.892 INFO:teuthology.orchestra.run.smithi133.stdout:(101/136): python3-requests-oauthlib-1.0.0-1.el 320 kB/s | 43 kB 00:00 2024-04-26T12:27:51.909 INFO:teuthology.orchestra.run.smithi133.stdout:(102/136): libaio-devel-0.3.112-1.el8.x86_64.rp 149 kB/s | 19 kB 00:00 2024-04-26T12:27:51.935 INFO:teuthology.orchestra.run.smithi133.stdout:(103/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 349 kB/s | 44 kB 00:00 2024-04-26T12:27:51.939 INFO:teuthology.orchestra.run.smithi038.stdout:(13/136): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.5 MB/s | 142 kB 00:00 2024-04-26T12:27:52.060 INFO:teuthology.orchestra.run.smithi133.stdout:(104/136): pcre2-devel-10.32-2.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2024-04-26T12:27:52.073 INFO:teuthology.orchestra.run.smithi038.stdout:(14/136): ceph-radosgw-18.2.2-1256.gdc093b5e.el 1.9 MB/s | 13 MB 00:06 2024-04-26T12:27:52.085 INFO:teuthology.orchestra.run.smithi133.stdout:(105/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2024-04-26T12:27:52.098 INFO:teuthology.orchestra.run.smithi038.stdout:(15/136): librados-devel-18.2.2-1256.gdc093b5e. 877 kB/s | 139 kB 00:00 2024-04-26T12:27:52.110 INFO:teuthology.orchestra.run.smithi133.stdout:(106/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.1 MB/s | 229 kB 00:00 2024-04-26T12:27:52.161 INFO:teuthology.orchestra.run.smithi133.stdout:(107/136): libselinux-devel-2.9-5.el8.x86_64.rp 1.9 MB/s | 200 kB 00:00 2024-04-26T12:27:52.294 INFO:teuthology.orchestra.run.smithi133.stdout:(108/136): keyutils-libs-devel-1.5.10-9.el8.x86 230 kB/s | 48 kB 00:00 2024-04-26T12:27:52.319 INFO:teuthology.orchestra.run.smithi133.stdout:(109/136): zlib-devel-1.2.11-18.el8_5.x86_64.rp 364 kB/s | 58 kB 00:00 2024-04-26T12:27:52.323 INFO:teuthology.orchestra.run.smithi038.stdout:(16/136): libradosstriper1-18.2.2-1256.gdc093b5 1.9 MB/s | 474 kB 00:00 2024-04-26T12:27:52.345 INFO:teuthology.orchestra.run.smithi133.stdout:(110/136): libsepol-devel-2.9-3.el8.x86_64.rpm 372 kB/s | 87 kB 00:00 2024-04-26T12:27:52.423 INFO:teuthology.orchestra.run.smithi038.stdout:(17/136): python3-ceph-argparse-18.2.2-1256.gdc 447 kB/s | 45 kB 00:00 2024-04-26T12:27:52.428 INFO:teuthology.orchestra.run.smithi133.stdout:(111/136): libcom_err-devel-1.45.6-4.el8.x86_64 288 kB/s | 39 kB 00:00 2024-04-26T12:27:52.454 INFO:teuthology.orchestra.run.smithi133.stdout:(112/136): fuse-2.9.7-17.el8.x86_64.rpm 621 kB/s | 83 kB 00:00 2024-04-26T12:27:52.487 INFO:teuthology.orchestra.run.smithi133.stdout:(113/136): libgfortran-8.5.0-20.el8.x86_64.rpm 4.4 MB/s | 645 kB 00:00 2024-04-26T12:27:52.540 INFO:teuthology.orchestra.run.smithi038.stdout:(18/136): python3-ceph-common-18.2.2-1256.gdc09 1.1 MB/s | 129 kB 00:00 2024-04-26T12:27:52.562 INFO:teuthology.orchestra.run.smithi133.stdout:(114/136): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-04-26T12:27:52.591 INFO:teuthology.orchestra.run.smithi098.stdout:(29/136): ceph-mgr-diskprediction-local-18.2.2- 4.6 MB/s | 7.4 MB 00:01 2024-04-26T12:27:52.596 INFO:teuthology.orchestra.run.smithi133.stdout:(115/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2024-04-26T12:27:52.621 INFO:teuthology.orchestra.run.smithi133.stdout:(116/136): xfsprogs-devel-5.0.0-12.el8.x86_64.r 543 kB/s | 73 kB 00:00 2024-04-26T12:27:52.658 INFO:teuthology.orchestra.run.smithi098.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1256.gdc 3.6 MB/s | 246 kB 00:00 2024-04-26T12:27:52.688 INFO:teuthology.orchestra.run.smithi133.stdout:(117/136): elfutils-libelf-devel-0.189-3.el8.x8 492 kB/s | 62 kB 00:00 2024-04-26T12:27:52.707 INFO:teuthology.orchestra.run.smithi038.stdout:(19/136): python3-cephfs-18.2.2-1256.gdc093b5e. 1.2 MB/s | 197 kB 00:00 2024-04-26T12:27:52.722 INFO:teuthology.orchestra.run.smithi133.stdout:(118/136): krb5-devel-1.18.2-26.el8_9.x86_64.rp 4.4 MB/s | 562 kB 00:00 2024-04-26T12:27:52.725 INFO:teuthology.orchestra.run.smithi098.stdout:(31/136): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 740 kB/s | 49 kB 00:00 2024-04-26T12:27:52.753 INFO:teuthology.orchestra.run.smithi116.stdout:(29/136): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 1.5 MB/s | 18 MB 00:12 2024-04-26T12:27:52.783 INFO:teuthology.orchestra.run.smithi098.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1256.gd 261 kB/s | 15 kB 00:00 2024-04-26T12:27:52.822 INFO:teuthology.orchestra.run.smithi133.stdout:(119/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 353 kB/s | 47 kB 00:00 2024-04-26T12:27:52.867 INFO:teuthology.orchestra.run.smithi098.stdout:(33/136): ceph-volume-18.2.2-1256.gdc093b5e.el8 3.1 MB/s | 263 kB 00:00 2024-04-26T12:27:52.881 INFO:teuthology.orchestra.run.smithi133.stdout:(120/136): openssl-devel-1.1.1k-12.el8_9.x86_64 9.0 MB/s | 2.3 MB 00:00 2024-04-26T12:27:52.915 INFO:teuthology.orchestra.run.smithi133.stdout:(121/136): python3-cryptography-3.2.1-7.el8_9.x 2.8 MB/s | 559 kB 00:00 2024-04-26T12:27:52.951 INFO:teuthology.orchestra.run.smithi098.stdout:(34/136): cephadm-18.2.2-1256.gdc093b5e.el8.noa 2.0 MB/s | 173 kB 00:00 2024-04-26T12:27:52.957 INFO:teuthology.orchestra.run.smithi038.stdout:(20/136): python3-rados-18.2.2-1256.gdc093b5e.e 1.4 MB/s | 371 kB 00:00 2024-04-26T12:27:52.964 INFO:teuthology.orchestra.run.smithi133.stdout:(122/136): libuuid-devel-2.32.1-44.el8_9.1.x86_ 702 kB/s | 100 kB 00:00 2024-04-26T12:27:53.028 INFO:teuthology.orchestra.run.smithi116.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1256.gdc 895 kB/s | 246 kB 00:00 2024-04-26T12:27:53.111 INFO:teuthology.orchestra.run.smithi116.stdout:(31/136): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 591 kB/s | 49 kB 00:00 2024-04-26T12:27:53.115 INFO:teuthology.orchestra.run.smithi133.stdout:(123/136): elfutils-libelf-0.189-3.el8.x86_64.r 1.5 MB/s | 232 kB 00:00 2024-04-26T12:27:53.174 INFO:teuthology.orchestra.run.smithi038.stdout:(21/136): python3-rbd-18.2.2-1256.gdc093b5e.el8 1.6 MB/s | 364 kB 00:00 2024-04-26T12:27:53.178 INFO:teuthology.orchestra.run.smithi116.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1256.gd 228 kB/s | 15 kB 00:00 2024-04-26T12:27:53.215 INFO:teuthology.orchestra.run.smithi133.stdout:(124/136): elfutils-libs-0.189-3.el8.x86_64.rpm 3.0 MB/s | 303 kB 00:00 2024-04-26T12:27:53.276 INFO:teuthology.orchestra.run.smithi098.stdout:(35/136): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 1.5 MB/s | 18 MB 00:12 2024-04-26T12:27:53.283 INFO:teuthology.orchestra.run.smithi038.stdout:(22/136): python3-rgw-18.2.2-1256.gdc093b5e.el8 988 kB/s | 107 kB 00:00 2024-04-26T12:27:53.345 INFO:teuthology.orchestra.run.smithi116.stdout:(33/136): ceph-mgr-diskprediction-local-18.2.2- 4.0 MB/s | 7.4 MB 00:01 2024-04-26T12:27:53.350 INFO:teuthology.orchestra.run.smithi038.stdout:(23/136): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.4 MB/s | 95 kB 00:00 2024-04-26T12:27:53.387 INFO:teuthology.orchestra.run.smithi116.stdout:(34/136): ceph-volume-18.2.2-1256.gdc093b5e.el8 1.2 MB/s | 263 kB 00:00 2024-04-26T12:27:53.399 INFO:teuthology.orchestra.run.smithi133.stdout:(125/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.8 MB/s | 711 kB 00:00 2024-04-26T12:27:53.421 INFO:teuthology.orchestra.run.smithi116.stdout:(35/136): cephadm-18.2.2-1256.gdc093b5e.el8.noa 2.2 MB/s | 173 kB 00:00 2024-04-26T12:27:53.472 INFO:teuthology.orchestra.run.smithi116.stdout:(36/136): gperftools-libs-2.7-9.el8.x86_64.rpm 3.6 MB/s | 306 kB 00:00 2024-04-26T12:27:53.497 INFO:teuthology.orchestra.run.smithi116.stdout:(37/136): liboath-2.6.2-3.el8.x86_64.rpm 784 kB/s | 59 kB 00:00 2024-04-26T12:27:53.522 INFO:teuthology.orchestra.run.smithi116.stdout:(38/136): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-04-26T12:27:53.581 INFO:teuthology.orchestra.run.smithi116.stdout:(39/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 749 kB/s | 44 kB 00:00 2024-04-26T12:27:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:(126/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.4 MB/s | 1.5 MB 00:00 2024-04-26T12:27:53.614 INFO:teuthology.orchestra.run.smithi116.stdout:(40/136): python3-beautifulsoup4-4.6.3-2.el8.1. 5.5 MB/s | 185 kB 00:00 2024-04-26T12:27:53.639 INFO:teuthology.orchestra.run.smithi116.stdout:(41/136): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2024-04-26T12:27:53.665 INFO:teuthology.orchestra.run.smithi116.stdout:(42/136): python3-cachetools-3.1.1-4.el8.noarch 655 kB/s | 33 kB 00:00 2024-04-26T12:27:53.690 INFO:teuthology.orchestra.run.smithi116.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 324 kB/s | 16 kB 00:00 2024-04-26T12:27:53.693 INFO:teuthology.orchestra.run.smithi098.stdout:(36/136): liboath-2.6.2-3.el8.x86_64.rpm 141 kB/s | 59 kB 00:00 2024-04-26T12:27:53.715 INFO:teuthology.orchestra.run.smithi116.stdout:(44/136): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2024-04-26T12:27:53.718 INFO:teuthology.orchestra.run.smithi098.stdout:(37/136): gperftools-libs-2.7-9.el8.x86_64.rpm 399 kB/s | 306 kB 00:00 2024-04-26T12:27:53.741 INFO:teuthology.orchestra.run.smithi116.stdout:(45/136): python3-google-auth-1.1.1-10.el8.noar 3.2 MB/s | 81 kB 00:00 2024-04-26T12:27:53.766 INFO:teuthology.orchestra.run.smithi133.stdout:(127/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.4 MB/s | 1.1 MB 00:00 2024-04-26T12:27:53.791 INFO:teuthology.orchestra.run.smithi116.stdout:(46/136): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2024-04-26T12:27:53.841 INFO:teuthology.orchestra.run.smithi116.stdout:(47/136): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-04-26T12:27:53.844 INFO:teuthology.orchestra.run.smithi098.stdout:(38/136): libunwind-1.3.1-3.el8.x86_64.rpm 500 kB/s | 75 kB 00:00 2024-04-26T12:27:53.866 INFO:teuthology.orchestra.run.smithi116.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2024-04-26T12:27:53.900 INFO:teuthology.orchestra.run.smithi133.stdout:(128/136): librbd1-18.2.2-1256.gdc093b5e.el8.x8 3.6 MB/s | 3.6 MB 00:00 2024-04-26T12:27:53.900 INFO:teuthology.orchestra.run.smithi116.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 1.4 MB/s | 49 kB 00:00 2024-04-26T12:27:53.919 INFO:teuthology.orchestra.run.smithi098.stdout:(39/136): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2024-04-26T12:27:53.925 INFO:teuthology.orchestra.run.smithi133.stdout:(129/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.4 MB/s | 221 kB 00:00 2024-04-26T12:27:53.926 INFO:teuthology.orchestra.run.smithi038.stdout:(24/136): librgw2-18.2.2-1256.gdc093b5e.el8.x86 3.6 MB/s | 6.6 MB 00:01 2024-04-26T12:27:53.934 INFO:teuthology.orchestra.run.smithi116.stdout:(50/136): python3-more-itertools-7.2.0-3.el8.no 1.7 MB/s | 59 kB 00:00 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi116.stdout:(51/136): python3-natsort-7.1.1-2.el8.noarch.rp 1.8 MB/s | 60 kB 00:00 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi098.stdout:(40/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 348 kB/s | 44 kB 00:00 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi133.stdout:(130/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 2.7 MB/s | 254 kB 00:00 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi038.stdout:(25/136): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 2.7 MB/s | 181 kB 00:00 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi116.stdout:(52/136): python3-kubernetes-11.0.0-6.el8.noarc 7.3 MB/s | 1.2 MB 00:00 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi098.stdout:(41/136): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi116.stdout:(53/136): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2024-04-26T12:27:54.051 INFO:teuthology.orchestra.run.smithi133.stdout:(131/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.8 MB/s | 237 kB 00:00 2024-04-26T12:27:54.051 INFO:teuthology.orchestra.run.smithi116.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2024-04-26T12:27:54.068 INFO:teuthology.orchestra.run.smithi038.stdout:(26/136): ceph-grafana-dashboards-18.2.2-1256.g 324 kB/s | 24 kB 00:00 2024-04-26T12:27:54.087 INFO:teuthology.orchestra.run.smithi098.stdout:(42/136): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2024-04-26T12:27:54.097 INFO:teuthology.orchestra.run.smithi116.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 478 kB/s | 34 kB 00:00 2024-04-26T12:27:54.126 INFO:teuthology.orchestra.run.smithi038.stdout:(27/136): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 2.3 MB/s | 138 kB 00:00 2024-04-26T12:27:54.127 INFO:teuthology.orchestra.run.smithi116.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2024-04-26T12:27:54.144 INFO:teuthology.orchestra.run.smithi116.stdout:(57/136): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2024-04-26T12:27:54.145 INFO:teuthology.orchestra.run.smithi098.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2024-04-26T12:27:54.167 INFO:teuthology.orchestra.run.smithi133.stdout:(132/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.0 MB/s | 180 kB 00:00 2024-04-26T12:27:54.169 INFO:teuthology.orchestra.run.smithi116.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 448 kB/s | 19 kB 00:00 2024-04-26T12:27:54.193 INFO:teuthology.orchestra.run.smithi133.stdout:(133/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 698 kB/s | 99 kB 00:00 2024-04-26T12:27:54.195 INFO:teuthology.orchestra.run.smithi116.stdout:(59/136): python3-singledispatch-3.4.0.3-18.el8 477 kB/s | 24 kB 00:00 2024-04-26T12:27:54.220 INFO:teuthology.orchestra.run.smithi116.stdout:(60/136): python3-tempora-1.14.1-5.el8.noarch.r 585 kB/s | 29 kB 00:00 2024-04-26T12:27:54.245 INFO:teuthology.orchestra.run.smithi116.stdout:(61/136): python3-trustme-0.6.0-4.el8.noarch.rp 551 kB/s | 27 kB 00:00 2024-04-26T12:27:54.281 INFO:teuthology.orchestra.run.smithi116.stdout:(62/136): python3-waitress-1.4.3-1.el8.noarch.r 4.1 MB/s | 255 kB 00:00 2024-04-26T12:27:54.282 INFO:teuthology.orchestra.run.smithi098.stdout:(44/136): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2024-04-26T12:27:54.305 INFO:teuthology.orchestra.run.smithi098.stdout:(45/136): python3-cheroot-8.5.2-1.el8.noarch.rp 794 kB/s | 173 kB 00:00 2024-04-26T12:27:54.368 INFO:teuthology.orchestra.run.smithi133.stdout:(134/136): util-linux-2.32.1-44.el8_9.1.x86_64. 12 MB/s | 2.5 MB 00:00 2024-04-26T12:27:54.388 INFO:teuthology.orchestra.run.smithi098.stdout:(46/136): python3-google-auth-1.1.1-10.el8.noar 768 kB/s | 81 kB 00:00 2024-04-26T12:27:54.405 INFO:teuthology.orchestra.run.smithi098.stdout:(47/136): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-04-26T12:27:54.443 INFO:teuthology.orchestra.run.smithi133.stdout:(135/136): librados2-18.2.2-1256.gdc093b5e.el8. 2.4 MB/s | 3.7 MB 00:01 2024-04-26T12:27:54.455 INFO:teuthology.orchestra.run.smithi116.stdout:(63/136): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2024-04-26T12:27:54.468 INFO:teuthology.orchestra.run.smithi133.stdout:(136/136): util-linux-user-2.32.1-44.el8_9.1.x8 373 kB/s | 103 kB 00:00 2024-04-26T12:27:54.472 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:27:54.472 INFO:teuthology.orchestra.run.smithi133.stdout:Total 11 MB/s | 206 MB 00:18 2024-04-26T12:27:54.480 INFO:teuthology.orchestra.run.smithi116.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 309 kB/s | 61 kB 00:00 2024-04-26T12:27:54.480 INFO:teuthology.orchestra.run.smithi098.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2024-04-26T12:27:54.497 INFO:teuthology.orchestra.run.smithi116.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi116.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 548 kB/s | 23 kB 00:00 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi116.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi098.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 532 kB/s | 49 kB 00:00 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi116.stdout:(68/136): thrift-0.13.0-2.el8.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2024-04-26T12:27:54.665 INFO:teuthology.orchestra.run.smithi098.stdout:(50/136): python3-more-itertools-7.2.0-3.el8.no 641 kB/s | 59 kB 00:00 2024-04-26T12:27:54.677 INFO:teuthology.orchestra.run.smithi038.stdout:(28/136): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 2.6 MB/s | 3.5 MB 00:01 2024-04-26T12:27:54.715 INFO:teuthology.orchestra.run.smithi116.stdout:(69/136): python3-packaging-16.8-9.el8.noarch.r 289 kB/s | 48 kB 00:00 2024-04-26T12:27:54.740 INFO:teuthology.orchestra.run.smithi116.stdout:(70/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 131 kB/s | 18 kB 00:00 2024-04-26T12:27:54.753 INFO:teuthology.orchestra.run.smithi098.stdout:(51/136): python3-kubernetes-11.0.0-6.el8.noarc 3.4 MB/s | 1.2 MB 00:00 2024-04-26T12:27:54.773 INFO:teuthology.orchestra.run.smithi098.stdout:(52/136): python3-natsort-7.1.1-2.el8.noarch.rp 555 kB/s | 60 kB 00:00 2024-04-26T12:27:54.857 INFO:teuthology.orchestra.run.smithi098.stdout:(53/136): python3-pecan-1.3.2-9.el8.noarch.rpm 2.7 MB/s | 283 kB 00:00 2024-04-26T12:27:54.874 INFO:teuthology.orchestra.run.smithi098.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2024-04-26T12:27:54.899 INFO:teuthology.orchestra.run.smithi116.stdout:(71/136): python3-jwt-1.6.1-2.el8.noarch.rpm 232 kB/s | 43 kB 00:00 2024-04-26T12:27:54.902 INFO:teuthology.orchestra.run.smithi038.stdout:(29/136): ceph-mgr-dashboard-18.2.2-1256.gdc093 4.6 MB/s | 3.5 MB 00:00 2024-04-26T12:27:54.957 INFO:teuthology.orchestra.run.smithi116.stdout:(72/136): python3-oauthlib-2.1.0-1.el8.noarch.r 714 kB/s | 155 kB 00:00 2024-04-26T12:27:54.958 INFO:teuthology.orchestra.run.smithi098.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2024-04-26T12:27:54.983 INFO:teuthology.orchestra.run.smithi098.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2024-04-26T12:27:55.010 INFO:teuthology.orchestra.run.smithi038.stdout:(30/136): ceph-mgr-modules-core-18.2.2-1256.gdc 2.2 MB/s | 246 kB 00:00 2024-04-26T12:27:55.049 INFO:teuthology.orchestra.run.smithi116.stdout:(73/136): python3-pycparser-2.14-14.el8.noarch. 727 kB/s | 109 kB 00:00 2024-04-26T12:27:55.075 INFO:teuthology.orchestra.run.smithi098.stdout:(57/136): python3-rsa-4.9-2.el8.noarch.rpm 550 kB/s | 64 kB 00:00 2024-04-26T12:27:55.077 INFO:teuthology.orchestra.run.smithi038.stdout:(31/136): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 739 kB/s | 49 kB 00:00 2024-04-26T12:27:55.083 INFO:teuthology.orchestra.run.smithi116.stdout:(74/136): python3-requests-oauthlib-1.0.0-1.el8 341 kB/s | 43 kB 00:00 2024-04-26T12:27:55.100 INFO:teuthology.orchestra.run.smithi098.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2024-04-26T12:27:55.144 INFO:teuthology.orchestra.run.smithi038.stdout:(32/136): ceph-prometheus-alerts-18.2.2-1256.gd 229 kB/s | 15 kB 00:00 2024-04-26T12:27:55.158 INFO:teuthology.orchestra.run.smithi116.stdout:(75/136): libaio-devel-0.3.112-1.el8.x86_64.rpm 172 kB/s | 19 kB 00:00 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi098.stdout:(59/136): python3-singledispatch-3.4.0.3-18.el8 239 kB/s | 24 kB 00:00 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi098.stdout:(60/136): python3-tempora-1.14.1-5.el8.noarch.r 292 kB/s | 29 kB 00:00 2024-04-26T12:27:55.233 INFO:teuthology.orchestra.run.smithi116.stdout:(76/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 292 kB/s | 44 kB 00:00 2024-04-26T12:27:55.351 INFO:teuthology.orchestra.run.smithi116.stdout:(77/136): pcre2-devel-10.32-2.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2024-04-26T12:27:55.367 INFO:teuthology.orchestra.run.smithi116.stdout:(78/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2024-04-26T12:27:55.432 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-04-26T12:27:55.534 INFO:teuthology.orchestra.run.smithi116.stdout:(79/136): libselinux-devel-2.9-5.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2024-04-26T12:27:55.560 INFO:teuthology.orchestra.run.smithi116.stdout:(80/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2024-04-26T12:27:55.629 INFO:teuthology.orchestra.run.smithi038.stdout:(33/136): ceph-test-18.2.2-1256.gdc093b5e.el8.x 5.0 MB/s | 47 MB 00:09 2024-04-26T12:27:55.653 INFO:teuthology.orchestra.run.smithi038.stdout:(34/136): ceph-volume-18.2.2-1256.gdc093b5e.el8 517 kB/s | 263 kB 00:00 2024-04-26T12:27:55.685 INFO:teuthology.orchestra.run.smithi098.stdout:(61/136): ceph-test-18.2.2-1256.gdc093b5e.el8.x 3.9 MB/s | 47 MB 00:12 2024-04-26T12:27:55.702 INFO:teuthology.orchestra.run.smithi116.stdout:(81/136): keyutils-libs-devel-1.5.10-9.el8.x86_ 288 kB/s | 48 kB 00:00 2024-04-26T12:27:55.710 INFO:teuthology.orchestra.run.smithi098.stdout:(62/136): python3-trustme-0.6.0-4.el8.noarch.rp 52 kB/s | 27 kB 00:00 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi038.stdout:(35/136): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.7 MB/s | 173 kB 00:00 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi098.stdout:(63/136): python3-waitress-1.4.3-1.el8.noarch.r 478 kB/s | 255 kB 00:00 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi116.stdout:(82/136): libsepol-devel-2.9-3.el8.x86_64.rpm 437 kB/s | 87 kB 00:00 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi098.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 564 kB/s | 61 kB 00:00 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi116.stdout:(83/136): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 407 kB/s | 58 kB 00:00 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi098.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 786 kB/s | 85 kB 00:00 2024-04-26T12:27:55.902 INFO:teuthology.orchestra.run.smithi116.stdout:(84/136): libcom_err-devel-1.45.6-4.el8.x86_64. 270 kB/s | 39 kB 00:00 2024-04-26T12:27:55.904 INFO:teuthology.orchestra.run.smithi038.stdout:(36/136): liboath-2.6.2-3.el8.x86_64.rpm 336 kB/s | 59 kB 00:00 2024-04-26T12:27:55.919 INFO:teuthology.orchestra.run.smithi098.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2024-04-26T12:27:55.920 INFO:teuthology.orchestra.run.smithi116.stdout:(85/136): fuse-2.9.7-17.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-04-26T12:27:55.921 INFO:teuthology.orchestra.run.smithi038.stdout:(37/136): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2024-04-26T12:27:55.945 INFO:teuthology.orchestra.run.smithi098.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2024-04-26T12:27:55.996 INFO:teuthology.orchestra.run.smithi038.stdout:(38/136): libunwind-1.3.1-3.el8.x86_64.rpm 818 kB/s | 75 kB 00:00 2024-04-26T12:27:56.021 INFO:teuthology.orchestra.run.smithi038.stdout:(39/136): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2024-04-26T12:27:56.045 INFO:teuthology.orchestra.run.smithi098.stdout:(68/136): thrift-0.13.0-2.el8.x86_64.rpm 8.7 MB/s | 1.7 MB 00:00 2024-04-26T12:27:56.055 INFO:teuthology.orchestra.run.smithi038.stdout:(40/136): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 747 kB/s | 44 kB 00:00 2024-04-26T12:27:56.090 INFO:teuthology.orchestra.run.smithi038.stdout:(41/136): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2024-04-26T12:27:56.106 INFO:teuthology.orchestra.run.smithi038.stdout:(42/136): python3-cachetools-3.1.1-4.el8.noarch 660 kB/s | 33 kB 00:00 2024-04-26T12:27:56.112 INFO:teuthology.orchestra.run.smithi098.stdout:(69/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 107 kB/s | 18 kB 00:00 2024-04-26T12:27:56.139 INFO:teuthology.orchestra.run.smithi038.stdout:(43/136): python3-certifi-2018.10.15-7.el8.noar 327 kB/s | 16 kB 00:00 2024-04-26T12:27:56.204 INFO:teuthology.orchestra.run.smithi098.stdout:(70/136): python3-jwt-1.6.1-2.el8.noarch.rpm 269 kB/s | 43 kB 00:00 2024-04-26T12:27:56.214 INFO:teuthology.orchestra.run.smithi038.stdout:(44/136): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2024-04-26T12:27:56.240 INFO:teuthology.orchestra.run.smithi038.stdout:(45/136): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2024-04-26T12:27:56.246 INFO:teuthology.orchestra.run.smithi098.stdout:(71/136): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2024-04-26T12:27:56.282 INFO:teuthology.orchestra.run.smithi038.stdout:(46/136): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2024-04-26T12:27:56.296 INFO:teuthology.orchestra.run.smithi098.stdout:(72/136): python3-webob-1.8.5-1.el8.1.noarch.rp 411 kB/s | 251 kB 00:00 2024-04-26T12:27:56.307 INFO:teuthology.orchestra.run.smithi038.stdout:(47/136): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2024-04-26T12:27:56.341 INFO:teuthology.orchestra.run.smithi038.stdout:(48/136): python3-jaraco-functools-2.0-4.el8.no 301 kB/s | 18 kB 00:00 2024-04-26T12:27:56.399 INFO:teuthology.orchestra.run.smithi038.stdout:(49/136): python3-logutils-0.3.5-11.el8.noarch. 835 kB/s | 49 kB 00:00 2024-04-26T12:27:56.421 INFO:teuthology.orchestra.run.smithi098.stdout:(73/136): python3-pycparser-2.14-14.el8.noarch. 502 kB/s | 109 kB 00:00 2024-04-26T12:27:56.436 INFO:teuthology.orchestra.run.smithi116.stdout:(86/136): ceph-test-18.2.2-1256.gdc093b5e.el8.x 4.2 MB/s | 47 MB 00:11 2024-04-26T12:27:56.453 INFO:teuthology.orchestra.run.smithi116.stdout:(87/136): libquadmath-8.5.0-20.el8.x86_64.rpm 323 kB/s | 172 kB 00:00 2024-04-26T12:27:56.487 INFO:teuthology.orchestra.run.smithi116.stdout:(88/136): libgfortran-8.5.0-20.el8.x86_64.rpm 1.1 MB/s | 645 kB 00:00 2024-04-26T12:27:56.487 INFO:teuthology.orchestra.run.smithi038.stdout:(50/136): python3-more-itertools-7.2.0-3.el8.no 673 kB/s | 59 kB 00:00 2024-04-26T12:27:56.542 INFO:teuthology.orchestra.run.smithi038.stdout:(51/136): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2024-04-26T12:27:56.567 INFO:teuthology.orchestra.run.smithi038.stdout:(52/136): python3-natsort-7.1.1-2.el8.noarch.rp 759 kB/s | 60 kB 00:00 2024-04-26T12:27:56.609 INFO:teuthology.orchestra.run.smithi038.stdout:(53/136): python3-pecan-1.3.2-9.el8.noarch.rpm 4.1 MB/s | 283 kB 00:00 2024-04-26T12:27:56.612 INFO:teuthology.orchestra.run.smithi116.stdout:(89/136): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 459 kB/s | 73 kB 00:00 2024-04-26T12:27:56.634 INFO:teuthology.orchestra.run.smithi038.stdout:(54/136): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2024-04-26T12:27:56.637 INFO:teuthology.orchestra.run.smithi116.stdout:(90/136): elfutils-libelf-devel-0.189-3.el8.x86 410 kB/s | 62 kB 00:00 2024-04-26T12:27:56.668 INFO:teuthology.orchestra.run.smithi038.stdout:(55/136): python3-repoze-lru-0.7-6.el8.noarch.r 575 kB/s | 34 kB 00:00 2024-04-26T12:27:56.671 INFO:teuthology.orchestra.run.smithi116.stdout:(91/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.0 MB/s | 238 kB 00:00 2024-04-26T12:27:56.701 INFO:teuthology.orchestra.run.smithi038.stdout:(56/136): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2024-04-26T12:27:56.720 INFO:teuthology.orchestra.run.smithi098.stdout:(74/136): python3-requests-oauthlib-1.0.0-1.el8 90 kB/s | 43 kB 00:00 2024-04-26T12:27:56.726 INFO:teuthology.orchestra.run.smithi038.stdout:(57/136): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2024-04-26T12:27:56.747 INFO:teuthology.orchestra.run.smithi098.stdout:(75/136): libaio-devel-0.3.112-1.el8.x86_64.rpm 41 kB/s | 19 kB 00:00 2024-04-26T12:27:56.761 INFO:teuthology.orchestra.run.smithi038.stdout:(58/136): python3-simplegeneric-0.8.1-17.el8.no 320 kB/s | 19 kB 00:00 2024-04-26T12:27:56.772 INFO:teuthology.orchestra.run.smithi116.stdout:(92/136): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.5 MB/s | 562 kB 00:00 2024-04-26T12:27:56.772 INFO:teuthology.orchestra.run.smithi098.stdout:(76/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 125 kB/s | 44 kB 00:00 2024-04-26T12:27:56.797 INFO:teuthology.orchestra.run.smithi116.stdout:(93/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 376 kB/s | 47 kB 00:00 2024-04-26T12:27:56.810 INFO:teuthology.orchestra.run.smithi038.stdout:(59/136): python3-singledispatch-3.4.0.3-18.el8 286 kB/s | 24 kB 00:00 2024-04-26T12:27:56.836 INFO:teuthology.orchestra.run.smithi038.stdout:(60/136): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2024-04-26T12:27:56.848 INFO:teuthology.orchestra.run.smithi098.stdout:(77/136): pcre2-devel-10.32-2.el8.x86_64.rpm 4.6 MB/s | 605 kB 00:00 2024-04-26T12:27:56.881 INFO:teuthology.orchestra.run.smithi098.stdout:(78/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2024-04-26T12:27:56.882 INFO:teuthology.orchestra.run.smithi116.stdout:(94/136): openssl-devel-1.1.1k-12.el8_9.x86_64. 9.5 MB/s | 2.3 MB 00:00 2024-04-26T12:27:56.915 INFO:teuthology.orchestra.run.smithi098.stdout:(79/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2024-04-26T12:27:56.922 INFO:teuthology.orchestra.run.smithi116.stdout:(95/136): libuuid-devel-2.32.1-44.el8_9.1.x86_6 798 kB/s | 100 kB 00:00 2024-04-26T12:27:56.928 INFO:teuthology.orchestra.run.smithi038.stdout:(61/136): ceph-mgr-diskprediction-local-18.2.2- 3.3 MB/s | 7.4 MB 00:02 2024-04-26T12:27:56.941 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-04-26T12:27:56.951 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-04-26T12:27:56.953 INFO:teuthology.orchestra.run.smithi038.stdout:(62/136): python3-trustme-0.6.0-4.el8.noarch.rp 193 kB/s | 27 kB 00:00 2024-04-26T12:27:56.956 INFO:teuthology.orchestra.run.smithi116.stdout:(96/136): python3-cryptography-3.2.1-7.el8_9.x8 3.0 MB/s | 559 kB 00:00 2024-04-26T12:27:56.978 INFO:teuthology.orchestra.run.smithi038.stdout:(63/136): python3-waitress-1.4.3-1.el8.noarch.r 1.8 MB/s | 255 kB 00:00 2024-04-26T12:27:56.999 INFO:teuthology.orchestra.run.smithi098.stdout:(80/136): keyutils-libs-devel-1.5.10-9.el8.x86_ 409 kB/s | 48 kB 00:00 2024-04-26T12:27:57.012 INFO:teuthology.orchestra.run.smithi038.stdout:(64/136): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2024-04-26T12:27:57.023 INFO:teuthology.orchestra.run.smithi116.stdout:(97/136): python3-jsonpointer-1.10-11.el8.noarc 142 kB/s | 20 kB 00:00 2024-04-26T12:27:57.032 INFO:teuthology.orchestra.run.smithi098.stdout:(81/136): libselinux-devel-2.9-5.el8.x86_64.rpm 1.1 MB/s | 200 kB 00:00 2024-04-26T12:27:57.037 INFO:teuthology.orchestra.run.smithi038.stdout:(65/136): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2024-04-26T12:27:57.082 INFO:teuthology.orchestra.run.smithi098.stdout:(82/136): libsepol-devel-2.9-3.el8.x86_64.rpm 521 kB/s | 87 kB 00:00 2024-04-26T12:27:57.095 INFO:teuthology.orchestra.run.smithi038.stdout:(66/136): python3-zc-lockfile-2.0-2.el8.noarch. 278 kB/s | 23 kB 00:00 2024-04-26T12:27:57.098 INFO:teuthology.orchestra.run.smithi116.stdout:(98/136): python3-prettytable-0.7.2-14.el8.noar 251 kB/s | 44 kB 00:00 2024-04-26T12:27:57.129 INFO:teuthology.orchestra.run.smithi038.stdout:(67/136): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2024-04-26T12:27:57.149 INFO:teuthology.orchestra.run.smithi098.stdout:(83/136): libcom_err-devel-1.45.6-4.el8.x86_64. 330 kB/s | 39 kB 00:00 2024-04-26T12:27:57.153 INFO:teuthology.orchestra.run.smithi116.stdout:(99/136): python3-jsonpatch-1.21-2.el8.noarch.r 205 kB/s | 27 kB 00:00 2024-04-26T12:27:57.172 INFO:teuthology.orchestra.run.smithi038.stdout:(68/136): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2024-04-26T12:27:57.175 INFO:teuthology.orchestra.run.smithi098.stdout:(84/136): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 329 kB/s | 58 kB 00:00 2024-04-26T12:27:57.182 INFO:teuthology.orchestra.run.smithi116.stdout:(100/136): python3-pyasn1-modules-0.3.7-6.el8.n 488 kB/s | 110 kB 00:00 2024-04-26T12:27:57.205 INFO:teuthology.orchestra.run.smithi038.stdout:(69/136): python3-webob-1.8.5-1.el8.1.noarch.rp 907 kB/s | 251 kB 00:00 2024-04-26T12:27:57.250 INFO:teuthology.orchestra.run.smithi098.stdout:(85/136): fuse-2.9.7-17.el8.x86_64.rpm 496 kB/s | 83 kB 00:00 2024-04-26T12:27:57.274 INFO:teuthology.orchestra.run.smithi116.stdout:(101/136): python3-werkzeug-0.12.2-4.el8.noarch 3.7 MB/s | 457 kB 00:00 2024-04-26T12:27:57.317 INFO:teuthology.orchestra.run.smithi116.stdout:(102/136): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2024-04-26T12:27:57.322 INFO:teuthology.orchestra.run.smithi038.stdout:(70/136): python3-jsonpointer-1.10-11.el8.noarc 104 kB/s | 20 kB 00:00 2024-04-26T12:27:57.325 INFO:teuthology.orchestra.run.smithi098.stdout:(86/136): libgfortran-8.5.0-20.el8.x86_64.rpm 3.6 MB/s | 645 kB 00:00 2024-04-26T12:27:57.333 INFO:teuthology.orchestra.run.smithi116.stdout:(103/136): python3-pyasn1-0.3.7-6.el8.noarch.rp 539 kB/s | 126 kB 00:00 2024-04-26T12:27:57.347 INFO:teuthology.orchestra.run.smithi038.stdout:(71/136): python3-prettytable-0.7.2-14.el8.noar 264 kB/s | 44 kB 00:00 2024-04-26T12:27:57.350 INFO:teuthology.orchestra.run.smithi098.stdout:(87/136): libquadmath-8.5.0-20.el8.x86_64.rpm 982 kB/s | 172 kB 00:00 2024-04-26T12:27:57.423 INFO:teuthology.orchestra.run.smithi038.stdout:(72/136): python3-pyasn1-modules-0.3.7-6.el8.no 528 kB/s | 110 kB 00:00 2024-04-26T12:27:57.426 INFO:teuthology.orchestra.run.smithi098.stdout:(88/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 238 kB 00:00 2024-04-26T12:27:57.441 INFO:teuthology.orchestra.run.smithi116.stdout:(104/136): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2024-04-26T12:27:57.468 INFO:teuthology.orchestra.run.smithi098.stdout:(89/136): elfutils-libelf-devel-0.189-3.el8.x86 528 kB/s | 62 kB 00:00 2024-04-26T12:27:57.492 INFO:teuthology.orchestra.run.smithi116.stdout:(105/136): libtool-2.4.6-25.el8.x86_64.rpm 3.9 MB/s | 709 kB 00:00 2024-04-26T12:27:57.517 INFO:teuthology.orchestra.run.smithi116.stdout:(106/136): python3-markupsafe-0.23-19.el8.x86_6 211 kB/s | 39 kB 00:00 2024-04-26T12:27:57.535 INFO:teuthology.orchestra.run.smithi098.stdout:(90/136): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 347 kB/s | 73 kB 00:00 2024-04-26T12:27:57.548 INFO:teuthology.orchestra.run.smithi038.stdout:(73/136): python3-jsonpatch-1.21-2.el8.noarch.r 118 kB/s | 27 kB 00:00 2024-04-26T12:27:57.582 INFO:teuthology.orchestra.run.smithi038.stdout:(74/136): python3-pyasn1-0.3.7-6.el8.noarch.rpm 540 kB/s | 126 kB 00:00 2024-04-26T12:27:57.599 INFO:teuthology.orchestra.run.smithi098.stdout:(91/136): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.2 MB/s | 562 kB 00:00 2024-04-26T12:27:57.626 INFO:teuthology.orchestra.run.smithi116.stdout:(107/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi116.stdout:(108/136): python3-pyOpenSSL-19.0.0-1.el8.noarc 652 kB/s | 103 kB 00:00 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi038.stdout:(75/136): python3-werkzeug-0.12.2-4.el8.noarch. 1.9 MB/s | 457 kB 00:00 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi098.stdout:(92/136): openssl-devel-1.1.1k-12.el8_9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi098.stdout:(93/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 296 kB/s | 47 kB 00:00 2024-04-26T12:27:57.728 INFO:teuthology.orchestra.run.smithi098.stdout:(94/136): python3-cryptography-3.2.1-7.el8_9.x8 4.3 MB/s | 559 kB 00:00 2024-04-26T12:27:57.749 INFO:teuthology.orchestra.run.smithi038.stdout:(76/136): bison-3.0.4-10.el8.x86_64.rpm 3.4 MB/s | 688 kB 00:00 2024-04-26T12:27:57.785 INFO:teuthology.orchestra.run.smithi116.stdout:(109/136): python3-jinja2-2.10.1-3.el8.noarch.r 3.3 MB/s | 538 kB 00:00 2024-04-26T12:27:57.803 INFO:teuthology.orchestra.run.smithi098.stdout:(95/136): libuuid-devel-2.32.1-44.el8_9.1.x86_6 744 kB/s | 100 kB 00:00 2024-04-26T12:27:57.816 INFO:teuthology.orchestra.run.smithi038.stdout:(77/136): flex-2.6.1-9.el8.x86_64.rpm 1.3 MB/s | 320 kB 00:00 2024-04-26T12:27:57.833 INFO:teuthology.orchestra.run.smithi038.stdout:(78/136): python3-markupsafe-0.23-19.el8.x86_64 464 kB/s | 39 kB 00:00 2024-04-26T12:27:57.845 INFO:teuthology.orchestra.run.smithi098.stdout:(96/136): python3-jsonpointer-1.10-11.el8.noarc 133 kB/s | 20 kB 00:00 2024-04-26T12:27:57.851 INFO:teuthology.orchestra.run.smithi116.stdout:(110/136): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2024-04-26T12:27:57.894 INFO:teuthology.orchestra.run.smithi116.stdout:(111/136): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2024-04-26T12:27:57.903 INFO:teuthology.orchestra.run.smithi098.stdout:(97/136): python3-prettytable-0.7.2-14.el8.noar 250 kB/s | 44 kB 00:00 2024-04-26T12:27:57.924 INFO:teuthology.orchestra.run.smithi038.stdout:(79/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2024-04-26T12:27:57.929 INFO:teuthology.orchestra.run.smithi098.stdout:(98/136): python3-pyasn1-modules-0.3.7-6.el8.no 878 kB/s | 110 kB 00:00 2024-04-26T12:27:57.958 INFO:teuthology.orchestra.run.smithi038.stdout:(80/136): libtool-2.4.6-25.el8.x86_64.rpm 2.3 MB/s | 709 kB 00:00 2024-04-26T12:27:57.996 INFO:teuthology.orchestra.run.smithi098.stdout:(99/136): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.4 MB/s | 126 kB 00:00 2024-04-26T12:27:58.010 INFO:teuthology.orchestra.run.smithi116.stdout:(112/136): python3-numpy-1.14.3-10.el8.x86_64.r 10 MB/s | 3.7 MB 00:00 2024-04-26T12:27:58.034 INFO:teuthology.orchestra.run.smithi038.stdout:(81/136): python3-pyOpenSSL-19.0.0-1.el8.noarch 516 kB/s | 103 kB 00:00 2024-04-26T12:27:58.035 INFO:teuthology.orchestra.run.smithi116.stdout:(113/136): python3-numpy-f2py-1.14.3-10.el8.x86 1.2 MB/s | 225 kB 00:00 2024-04-26T12:27:58.038 INFO:teuthology.orchestra.run.smithi098.stdout:(100/136): python3-jsonpatch-1.21-2.el8.noarch. 138 kB/s | 27 kB 00:00 2024-04-26T12:27:58.061 INFO:teuthology.orchestra.run.smithi116.stdout:(114/136): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2024-04-26T12:27:58.071 INFO:teuthology.orchestra.run.smithi098.stdout:(101/136): python3-werkzeug-0.12.2-4.el8.noarch 3.1 MB/s | 457 kB 00:00 2024-04-26T12:27:58.125 INFO:teuthology.orchestra.run.smithi038.stdout:(82/136): python3-jinja2-2.10.1-3.el8.noarch.rp 3.1 MB/s | 538 kB 00:00 2024-04-26T12:27:58.130 INFO:teuthology.orchestra.run.smithi098.stdout:(102/136): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi098.stdout:(103/136): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2024-04-26T12:27:58.276 INFO:teuthology.orchestra.run.smithi038.stdout:(83/136): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2024-04-26T12:27:58.311 INFO:teuthology.orchestra.run.smithi116.stdout:(115/136): openblas-threads-0.3.15-6.el8.x86_64 17 MB/s | 5.2 MB 00:00 2024-04-26T12:27:58.336 INFO:teuthology.orchestra.run.smithi116.stdout:(116/136): python3-mako-1.0.6-14.el8.noarch.rpm 522 kB/s | 157 kB 00:00 2024-04-26T12:27:58.356 INFO:teuthology.orchestra.run.smithi098.stdout:(104/136): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2024-04-26T12:27:58.409 INFO:teuthology.orchestra.run.smithi038.stdout:(84/136): python3-numpy-1.14.3-10.el8.x86_64.rp 9.9 MB/s | 3.7 MB 00:00 2024-04-26T12:27:58.428 INFO:teuthology.orchestra.run.smithi116.stdout:(117/136): automake-1.16.1-8.el8.noarch.rpm 6.0 MB/s | 714 kB 00:00 2024-04-26T12:27:58.453 INFO:teuthology.orchestra.run.smithi116.stdout:(118/136): jq-1.6-7.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2024-04-26T12:27:58.472 INFO:teuthology.orchestra.run.smithi098.stdout:(105/136): libtool-2.4.6-25.el8.x86_64.rpm 1.7 MB/s | 709 kB 00:00 2024-04-26T12:27:58.518 INFO:teuthology.orchestra.run.smithi038.stdout:(85/136): socat-1.7.4.1-1.el8.x86_64.rpm 824 kB/s | 323 kB 00:00 2024-04-26T12:27:58.523 INFO:teuthology.orchestra.run.smithi098.stdout:(106/136): python3-pyOpenSSL-19.0.0-1.el8.noarc 620 kB/s | 103 kB 00:00 2024-04-26T12:27:58.554 INFO:teuthology.orchestra.run.smithi116.stdout:(119/136): openblas-0.3.15-6.el8.x86_64.rpm 10 MB/s | 5.0 MB 00:00 2024-04-26T12:27:58.585 INFO:teuthology.orchestra.run.smithi038.stdout:(86/136): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2024-04-26T12:27:58.598 INFO:teuthology.orchestra.run.smithi098.stdout:(107/136): python3-markupsafe-0.23-19.el8.x86_6 83 kB/s | 39 kB 00:00 2024-04-26T12:27:58.643 INFO:teuthology.orchestra.run.smithi038.stdout:(87/136): python3-numpy-f2py-1.14.3-10.el8.x86_ 613 kB/s | 225 kB 00:00 2024-04-26T12:27:58.654 INFO:teuthology.orchestra.run.smithi116.stdout:(120/136): python3-pytz-2017.2-11.el8.noarch.rp 240 kB/s | 54 kB 00:00 2024-04-26T12:27:58.680 INFO:teuthology.orchestra.run.smithi116.stdout:(121/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-26T12:27:58.694 INFO:teuthology.orchestra.run.smithi038.stdout:(88/136): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi038.stdout:(89/136): openblas-threads-0.3.15-6.el8.x86_64. 18 MB/s | 5.2 MB 00:00 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi098.stdout:(108/136): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi038.stdout:(90/136): automake-1.16.1-8.el8.noarch.rpm 4.6 MB/s | 714 kB 00:00 2024-04-26T12:27:58.849 INFO:teuthology.orchestra.run.smithi098.stdout:(109/136): python3-jinja2-2.10.1-3.el8.noarch.r 1.6 MB/s | 538 kB 00:00 2024-04-26T12:27:58.930 INFO:teuthology.orchestra.run.smithi116.stdout:(122/136): python3-scipy-1.0.0-21.module+el8.9. 29 MB/s | 14 MB 00:00 2024-04-26T12:27:58.949 INFO:teuthology.orchestra.run.smithi098.stdout:(110/136): python3-numpy-1.14.3-10.el8.x86_64.r 11 MB/s | 3.7 MB 00:00 2024-04-26T12:27:58.978 INFO:teuthology.orchestra.run.smithi038.stdout:(91/136): openblas-0.3.15-6.el8.x86_64.rpm 15 MB/s | 5.0 MB 00:00 2024-04-26T12:27:58.991 INFO:teuthology.orchestra.run.smithi098.stdout:(111/136): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2024-04-26T12:27:59.003 INFO:teuthology.orchestra.run.smithi038.stdout:(92/136): jq-1.6-7.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2024-04-26T12:27:59.016 INFO:teuthology.orchestra.run.smithi098.stdout:(112/136): socat-1.7.4.1-1.el8.x86_64.rpm 1.5 MB/s | 323 kB 00:00 2024-04-26T12:27:59.054 INFO:teuthology.orchestra.run.smithi038.stdout:(93/136): python3-pytz-2017.2-11.el8.noarch.rpm 259 kB/s | 54 kB 00:00 2024-04-26T12:27:59.133 INFO:teuthology.orchestra.run.smithi098.stdout:(113/136): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2024-04-26T12:27:59.162 INFO:teuthology.orchestra.run.smithi038.stdout:(94/136): libverto-devel-0.3.0-5.el8.x86_64.rpm 165 kB/s | 18 kB 00:00 2024-04-26T12:27:59.166 INFO:teuthology.orchestra.run.smithi098.stdout:(114/136): librdkafka-0.11.4-3.el8.x86_64.rpm 1.6 MB/s | 354 kB 00:00 2024-04-26T12:27:59.222 INFO:teuthology.orchestra.run.smithi116.stdout:(123/136): librbd1-18.2.2-1256.gdc093b5e.el8.x8 6.6 MB/s | 3.6 MB 00:00 2024-04-26T12:27:59.247 INFO:teuthology.orchestra.run.smithi116.stdout:(124/136): elfutils-libelf-0.189-3.el8.x86_64.r 733 kB/s | 232 kB 00:00 2024-04-26T12:27:59.271 INFO:teuthology.orchestra.run.smithi038.stdout:(95/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 704 kB/s | 188 kB 00:00 2024-04-26T12:27:59.284 INFO:teuthology.orchestra.run.smithi098.stdout:(115/136): openblas-threads-0.3.15-6.el8.x86_64 18 MB/s | 5.2 MB 00:00 2024-04-26T12:27:59.326 INFO:teuthology.orchestra.run.smithi098.stdout:(116/136): automake-1.16.1-8.el8.noarch.rpm 4.4 MB/s | 714 kB 00:00 2024-04-26T12:27:59.329 INFO:teuthology.orchestra.run.smithi038.stdout:(96/136): python3-jwt-1.6.1-2.el8.noarch.rpm 255 kB/s | 43 kB 00:00 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi038.stdout:(97/136): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi116.stdout:(125/136): elfutils-libs-0.189-3.el8.x86_64.rpm 2.0 MB/s | 303 kB 00:00 2024-04-26T12:27:59.468 INFO:teuthology.orchestra.run.smithi098.stdout:(117/136): openblas-0.3.15-6.el8.x86_64.rpm 15 MB/s | 5.0 MB 00:00 2024-04-26T12:27:59.468 INFO:teuthology.orchestra.run.smithi116.stdout:(126/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.1 MB/s | 711 kB 00:00 2024-04-26T12:27:59.493 INFO:teuthology.orchestra.run.smithi098.stdout:(118/136): python3-pytz-2017.2-11.el8.noarch.rp 325 kB/s | 54 kB 00:00 2024-04-26T12:27:59.518 INFO:teuthology.orchestra.run.smithi098.stdout:(119/136): jq-1.6-7.el8.x86_64.rpm 866 kB/s | 202 kB 00:00 2024-04-26T12:27:59.547 INFO:teuthology.orchestra.run.smithi038.stdout:(98/136): python3-scipy-1.0.0-21.module+el8.9.0 24 MB/s | 14 MB 00:00 2024-04-26T12:27:59.572 INFO:teuthology.orchestra.run.smithi038.stdout:(99/136): python3-requests-oauthlib-1.0.0-1.el8 213 kB/s | 43 kB 00:00 2024-04-26T12:27:59.597 INFO:teuthology.orchestra.run.smithi038.stdout:(100/136): python3-pycparser-2.14-14.el8.noarch 408 kB/s | 109 kB 00:00 2024-04-26T12:27:59.648 INFO:teuthology.orchestra.run.smithi038.stdout:(101/136): libaio-devel-0.3.112-1.el8.x86_64.rp 187 kB/s | 19 kB 00:00 2024-04-26T12:27:59.660 INFO:teuthology.orchestra.run.smithi098.stdout:(120/136): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-04-26T12:27:59.685 INFO:teuthology.orchestra.run.smithi098.stdout:(121/136): python3-packaging-16.8-9.el8.noarch. 288 kB/s | 48 kB 00:00 2024-04-26T12:27:59.706 INFO:teuthology.orchestra.run.smithi038.stdout:(102/136): libzstd-devel-1.4.4-1.el8.x86_64.rpm 328 kB/s | 44 kB 00:00 2024-04-26T12:27:59.756 INFO:teuthology.orchestra.run.smithi038.stdout:(103/136): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2024-04-26T12:27:59.781 INFO:teuthology.orchestra.run.smithi038.stdout:(104/136): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2024-04-26T12:27:59.853 INFO:teuthology.orchestra.run.smithi116.stdout:(127/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 3.1 MB/s | 1.5 MB 00:00 2024-04-26T12:27:59.882 INFO:teuthology.orchestra.run.smithi038.stdout:(105/136): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi098.stdout:(122/136): python3-scipy-1.0.0-21.module+el8.9. 30 MB/s | 14 MB 00:00 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi116.stdout:(128/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.3 MB/s | 1.1 MB 00:00 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi116.stdout:(129/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.9 MB/s | 221 kB 00:00 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi038.stdout:(106/136): libselinux-devel-2.9-5.el8.x86_64.rp 957 kB/s | 200 kB 00:00 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi038.stdout:(107/136): libsepol-devel-2.9-3.el8.x86_64.rpm 802 kB/s | 87 kB 00:00 2024-04-26T12:28:00.016 INFO:teuthology.orchestra.run.smithi038.stdout:(108/136): keyutils-libs-devel-1.5.10-9.el8.x86 205 kB/s | 48 kB 00:00 2024-04-26T12:28:00.049 INFO:teuthology.orchestra.run.smithi116.stdout:(130/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 2.3 MB/s | 254 kB 00:00 2024-04-26T12:28:00.083 INFO:teuthology.orchestra.run.smithi038.stdout:(109/136): zlib-devel-1.2.11-18.el8_5.x86_64.rp 493 kB/s | 58 kB 00:00 2024-04-26T12:28:00.086 INFO:teuthology.orchestra.run.smithi098.stdout:(123/136): librados2-18.2.2-1256.gdc093b5e.el8. 8.7 MB/s | 3.7 MB 00:00 2024-04-26T12:28:00.099 INFO:teuthology.orchestra.run.smithi116.stdout:(131/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 237 kB 00:00 2024-04-26T12:28:00.111 INFO:teuthology.orchestra.run.smithi098.stdout:(124/136): elfutils-libelf-0.189-3.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2024-04-26T12:28:00.148 INFO:teuthology.orchestra.run.smithi038.stdout:(110/136): libcom_err-devel-1.45.6-4.el8.x86_64 245 kB/s | 39 kB 00:00 2024-04-26T12:28:00.157 INFO:teuthology.orchestra.run.smithi116.stdout:(132/136): librados2-18.2.2-1256.gdc093b5e.el8. 2.5 MB/s | 3.7 MB 00:01 2024-04-26T12:28:00.175 INFO:teuthology.orchestra.run.smithi038.stdout:(111/136): fuse-2.9.7-17.el8.x86_64.rpm 522 kB/s | 83 kB 00:00 2024-04-26T12:28:00.195 INFO:teuthology.orchestra.run.smithi098.stdout:(125/136): elfutils-libs-0.189-3.el8.x86_64.rpm 2.7 MB/s | 303 kB 00:00 2024-04-26T12:28:00.208 INFO:teuthology.orchestra.run.smithi038.stdout:(112/136): libgfortran-8.5.0-20.el8.x86_64.rpm 5.0 MB/s | 645 kB 00:00 2024-04-26T12:28:00.233 INFO:teuthology.orchestra.run.smithi116.stdout:(133/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 978 kB/s | 180 kB 00:00 2024-04-26T12:28:00.242 INFO:teuthology.orchestra.run.smithi038.stdout:(113/136): libquadmath-8.5.0-20.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2024-04-26T12:28:00.301 INFO:teuthology.orchestra.run.smithi038.stdout:(114/136): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2024-04-26T12:28:00.333 INFO:teuthology.orchestra.run.smithi116.stdout:(134/136): util-linux-2.32.1-44.el8_9.1.x86_64. 14 MB/s | 2.5 MB 00:00 2024-04-26T12:28:00.342 INFO:teuthology.orchestra.run.smithi038.stdout:(115/136): elfutils-libelf-devel-0.189-3.el8.x8 616 kB/s | 62 kB 00:00 2024-04-26T12:28:00.358 INFO:teuthology.orchestra.run.smithi116.stdout:(135/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 382 kB/s | 99 kB 00:00 2024-04-26T12:28:00.368 INFO:teuthology.orchestra.run.smithi038.stdout:(116/136): xfsprogs-devel-5.0.0-12.el8.x86_64.r 456 kB/s | 73 kB 00:00 2024-04-26T12:28:00.370 INFO:teuthology.orchestra.run.smithi098.stdout:(126/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.4 MB/s | 1.5 MB 00:00 2024-04-26T12:28:00.383 INFO:teuthology.orchestra.run.smithi116.stdout:(136/136): util-linux-user-2.32.1-44.el8_9.1.x8 684 kB/s | 103 kB 00:00 2024-04-26T12:28:00.386 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:00.387 INFO:teuthology.orchestra.run.smithi116.stdout:Total 8.5 MB/s | 206 MB 00:24 2024-04-26T12:28:00.412 INFO:teuthology.orchestra.run.smithi098.stdout:(127/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 2.3 MB/s | 711 kB 00:00 2024-04-26T12:28:00.468 INFO:teuthology.orchestra.run.smithi038.stdout:(117/136): krb5-devel-1.18.2-26.el8_9.x86_64.rp 3.3 MB/s | 562 kB 00:00 2024-04-26T12:28:00.485 INFO:teuthology.orchestra.run.smithi038.stdout:(118/136): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 403 kB/s | 47 kB 00:00 2024-04-26T12:28:00.504 INFO:teuthology.orchestra.run.smithi098.stdout:(128/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.0 MB/s | 1.1 MB 00:00 2024-04-26T12:28:00.538 INFO:teuthology.orchestra.run.smithi098.stdout:(129/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 221 kB 00:00 2024-04-26T12:28:00.561 INFO:teuthology.orchestra.run.smithi038.stdout:(119/136): openssl-devel-1.1.1k-12.el8_9.x86_64 11 MB/s | 2.3 MB 00:00 2024-04-26T12:28:00.646 INFO:teuthology.orchestra.run.smithi098.stdout:(130/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 2.1 MB/s | 237 kB 00:00 2024-04-26T12:28:00.661 INFO:teuthology.orchestra.run.smithi038.stdout:(120/136): python3-cryptography-3.2.1-7.el8_9.x 2.8 MB/s | 559 kB 00:00 2024-04-26T12:28:00.672 INFO:teuthology.orchestra.run.smithi098.stdout:(131/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 254 kB 00:00 2024-04-26T12:28:00.694 INFO:teuthology.orchestra.run.smithi038.stdout:(121/136): libuuid-devel-2.32.1-44.el8_9.1.x86_ 478 kB/s | 100 kB 00:00 2024-04-26T12:28:00.720 INFO:teuthology.orchestra.run.smithi038.stdout:(122/136): python3-packaging-16.8-9.el8.noarch. 303 kB/s | 48 kB 00:00 2024-04-26T12:28:00.756 INFO:teuthology.orchestra.run.smithi098.stdout:(132/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.6 MB/s | 180 kB 00:00 2024-04-26T12:28:00.789 INFO:teuthology.orchestra.run.smithi098.stdout:(133/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 846 kB/s | 99 kB 00:00 2024-04-26T12:28:00.854 INFO:teuthology.orchestra.run.smithi038.stdout:(123/136): elfutils-libelf-0.189-3.el8.x86_64.r 1.7 MB/s | 232 kB 00:00 2024-04-26T12:28:00.897 INFO:teuthology.orchestra.run.smithi098.stdout:(134/136): util-linux-user-2.32.1-44.el8_9.1.x8 950 kB/s | 103 kB 00:00 2024-04-26T12:28:00.962 INFO:teuthology.orchestra.run.smithi038.stdout:(124/136): elfutils-libs-0.189-3.el8.x86_64.rpm 2.7 MB/s | 303 kB 00:00 2024-04-26T12:28:00.973 INFO:teuthology.orchestra.run.smithi098.stdout:(135/136): librbd1-18.2.2-1256.gdc093b5e.el8.x8 2.8 MB/s | 3.6 MB 00:01 2024-04-26T12:28:01.023 INFO:teuthology.orchestra.run.smithi098.stdout:(136/136): util-linux-2.32.1-44.el8_9.1.x86_64. 9.3 MB/s | 2.5 MB 00:00 2024-04-26T12:28:01.025 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:01.026 INFO:teuthology.orchestra.run.smithi098.stdout:Total 8.3 MB/s | 206 MB 00:24 2024-04-26T12:28:01.129 INFO:teuthology.orchestra.run.smithi038.stdout:(125/136): librados2-18.2.2-1256.gdc093b5e.el8. 7.9 MB/s | 3.7 MB 00:00 2024-04-26T12:28:01.171 INFO:teuthology.orchestra.run.smithi038.stdout:(126/136): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.3 MB/s | 711 kB 00:00 2024-04-26T12:28:01.308 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-04-26T12:28:01.362 INFO:teuthology.orchestra.run.smithi038.stdout:(127/136): openssl-libs-1.1.1k-12.el8_9.x86_64. 6.3 MB/s | 1.5 MB 00:00 2024-04-26T12:28:01.405 INFO:teuthology.orchestra.run.smithi038.stdout:(128/136): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.6 MB/s | 1.1 MB 00:00 2024-04-26T12:28:01.480 INFO:teuthology.orchestra.run.smithi038.stdout:(129/136): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.8 MB/s | 221 kB 00:00 2024-04-26T12:28:01.514 INFO:teuthology.orchestra.run.smithi038.stdout:(130/136): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 2.3 MB/s | 254 kB 00:00 2024-04-26T12:28:01.572 INFO:teuthology.orchestra.run.smithi038.stdout:(131/136): libmount-2.32.1-44.el8_9.1.x86_64.rp 2.5 MB/s | 237 kB 00:00 2024-04-26T12:28:01.631 INFO:teuthology.orchestra.run.smithi038.stdout:(132/136): librbd1-18.2.2-1256.gdc093b5e.el8.x8 3.8 MB/s | 3.6 MB 00:00 2024-04-26T12:28:01.681 INFO:teuthology.orchestra.run.smithi038.stdout:(133/136): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.0 MB/s | 180 kB 00:00 2024-04-26T12:28:01.697 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-04-26T12:28:01.697 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-04-26T12:28:01.706 INFO:teuthology.orchestra.run.smithi038.stdout:(134/136): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 741 kB/s | 99 kB 00:00 2024-04-26T12:28:01.815 INFO:teuthology.orchestra.run.smithi038.stdout:(135/136): util-linux-2.32.1-44.el8_9.1.x86_64. 13 MB/s | 2.5 MB 00:00 2024-04-26T12:28:01.840 INFO:teuthology.orchestra.run.smithi038.stdout:(136/136): util-linux-user-2.32.1-44.el8_9.1.x8 648 kB/s | 103 kB 00:00 2024-04-26T12:28:01.843 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:28:01.844 INFO:teuthology.orchestra.run.smithi038.stdout:Total 9.8 MB/s | 206 MB 00:20 2024-04-26T12:28:01.909 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-04-26T12:28:02.304 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-04-26T12:28:02.304 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-04-26T12:28:02.816 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-04-26T12:28:02.826 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-04-26T12:28:02.827 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-04-26T12:28:02.872 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2024-04-26T12:28:02.962 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-26T12:28:03.283 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:28:03.317 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2024-04-26T12:28:03.317 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2024-04-26T12:28:03.438 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-04-26T12:28:03.448 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-04-26T12:28:03.483 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:28:03.683 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-26T12:28:03.879 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:28:03.952 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:28:04.154 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:28:04.222 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:28:04.468 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-26T12:28:04.577 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2024-04-26T12:28:04.589 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2024-04-26T12:28:04.646 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-26T12:28:04.713 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-26T12:28:04.929 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/150 2024-04-26T12:28:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:28:05.516 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:28:05.737 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:28:06.117 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:28:06.337 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:28:06.446 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:28:06.654 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:28:06.734 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:28:06.973 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-26T12:28:07.348 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-26T12:28:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:28:07.601 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:28:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:28:08.195 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:28:08.284 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-04-26T12:28:08.474 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-26T12:28:08.526 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-26T12:28:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-26T12:28:08.764 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:28:08.807 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:28:09.020 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-26T12:28:09.055 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-26T12:28:09.151 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-26T12:28:09.330 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:28:09.358 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:28:09.401 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:28:09.589 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:28:09.596 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:28:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-26T12:28:09.670 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:28:09.782 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-26T12:28:09.828 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-26T12:28:09.910 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-26T12:28:09.952 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:28:10.046 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2024-04-26T12:28:10.067 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:28:10.162 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/150 2024-04-26T12:28:10.194 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-26T12:28:10.236 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:28:10.319 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:28:10.338 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:28:10.420 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:28:10.434 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-26T12:28:10.469 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:28:10.507 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-26T12:28:10.636 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.15-6.el8.x86_64 22/150 2024-04-26T12:28:10.689 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/150 2024-04-26T12:28:10.696 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:28:10.717 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/150 2024-04-26T12:28:10.883 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/150 2024-04-26T12:28:10.911 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:28:11.008 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/150 2024-04-26T12:28:11.028 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:28:11.083 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:28:11.136 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/150 2024-04-26T12:28:11.236 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:28:11.287 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:28:11.313 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:28:11.321 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 22/150 2024-04-26T12:28:11.362 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/150 2024-04-26T12:28:11.606 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/150 2024-04-26T12:28:11.634 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/150 2024-04-26T12:28:11.639 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/150 2024-04-26T12:28:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:28:11.863 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/150 2024-04-26T12:28:11.913 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:28:11.981 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 25/150 2024-04-26T12:28:12.038 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:28:12.111 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/150 2024-04-26T12:28:12.205 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:28:12.238 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:28:12.278 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/150 2024-04-26T12:28:12.299 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:28:12.444 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:28:12.499 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:28:12.552 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:28:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/150 2024-04-26T12:28:12.703 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:28:12.708 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-26T12:28:12.768 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/150 2024-04-26T12:28:12.823 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:28:12.845 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:28:12.997 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:28:13.038 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:28:13.059 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/150 2024-04-26T12:28:13.142 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:28:13.197 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/150 2024-04-26T12:28:13.205 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-26T12:28:13.279 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:28:13.377 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:28:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/150 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:28:13.570 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:28:13.652 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:28:13.710 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:28:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:28:13.785 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:28:13.801 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:28:13.891 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:28:13.975 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:28:13.995 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:28:14.027 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-26T12:28:14.175 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 19/150 2024-04-26T12:28:14.251 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:28:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:28:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:28:14.457 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/150 2024-04-26T12:28:14.473 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 20/150 2024-04-26T12:28:14.475 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2024-04-26T12:28:14.567 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-26T12:28:14.650 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/150 2024-04-26T12:28:14.710 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/150 2024-04-26T12:28:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 19/150 2024-04-26T12:28:14.808 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/150 2024-04-26T12:28:14.871 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:28:14.937 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:28:15.009 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:28:15.037 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 20/150 2024-04-26T12:28:15.054 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:28:15.116 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/150 2024-04-26T12:28:15.203 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:28:15.221 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:28:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 21/150 2024-04-26T12:28:15.311 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-26T12:28:15.401 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 16/150 2024-04-26T12:28:15.444 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:28:15.603 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/150 2024-04-26T12:28:15.669 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:28:15.761 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 17/150 2024-04-26T12:28:15.796 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:28:15.845 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:28:15.977 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 18/150 2024-04-26T12:28:16.054 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:28:16.103 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-26T12:28:16.235 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 19/150 2024-04-26T12:28:16.410 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/150 2024-04-26T12:28:16.585 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:28:16.658 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:28:16.896 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-26T12:28:17.097 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 20/150 2024-04-26T12:28:17.179 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 24/150 2024-04-26T12:28:17.286 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-26T12:28:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 36/150 2024-04-26T12:28:17.410 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:28:17.662 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-26T12:28:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-26T12:28:17.927 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/150 2024-04-26T12:28:17.952 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 21/150 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 25/150 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 27/150 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 39/150 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.15-6.el8.x86_64 22/150 2024-04-26T12:28:18.310 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 40/150 2024-04-26T12:28:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-26T12:28:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/150 2024-04-26T12:28:18.527 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:28:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/150 2024-04-26T12:28:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 27/150 2024-04-26T12:28:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:28:18.698 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/150 2024-04-26T12:28:18.877 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:28:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-26T12:28:18.916 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 22/150 2024-04-26T12:28:18.937 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:28:19.018 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/150 2024-04-26T12:28:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/150 2024-04-26T12:28:19.114 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-26T12:28:19.193 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/150 2024-04-26T12:28:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/150 2024-04-26T12:28:19.271 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:28:19.337 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-26T12:28:19.387 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/150 2024-04-26T12:28:19.543 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/150 2024-04-26T12:28:19.577 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:28:19.601 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 25/150 2024-04-26T12:28:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:28:19.884 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/150 2024-04-26T12:28:20.029 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:28:20.169 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/150 2024-04-26T12:28:20.369 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:28:20.386 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:28:20.414 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 28/150 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.7-17.el8.x86_64 47/150 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/150 2024-04-26T12:28:20.783 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/150 2024-04-26T12:28:20.824 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/150 2024-04-26T12:28:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:28:21.023 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 49/150 2024-04-26T12:28:21.038 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/150 2024-04-26T12:28:21.196 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 50/150 2024-04-26T12:28:21.372 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 33/150 2024-04-26T12:28:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 51/150 2024-04-26T12:28:21.495 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/150 2024-04-26T12:28:21.780 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 52/150 2024-04-26T12:28:21.854 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 33/150 2024-04-26T12:28:22.073 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/150 2024-04-26T12:28:22.093 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/150 2024-04-26T12:28:22.314 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 54/150 2024-04-26T12:28:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/150 2024-04-26T12:28:22.469 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/150 2024-04-26T12:28:22.498 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 55/150 2024-04-26T12:28:22.729 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 56/150 2024-04-26T12:28:22.733 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/150 2024-04-26T12:28:22.771 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/150 2024-04-26T12:28:22.812 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/150 2024-04-26T12:28:23.022 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/150 2024-04-26T12:28:23.027 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-26T12:28:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 57/150 2024-04-26T12:28:23.122 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/150 2024-04-26T12:28:23.273 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-26T12:28:23.345 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 58/150 2024-04-26T12:28:23.423 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/150 2024-04-26T12:28:23.505 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-26T12:28:23.650 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 59/150 2024-04-26T12:28:23.679 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-26T12:28:23.750 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 39/150 2024-04-26T12:28:23.875 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 60/150 2024-04-26T12:28:23.887 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-26T12:28:23.952 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 40/150 2024-04-26T12:28:24.098 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 39/150 2024-04-26T12:28:24.146 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/150 2024-04-26T12:28:24.178 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:28:24.242 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:28:24.325 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 40/150 2024-04-26T12:28:24.423 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 62/150 2024-04-26T12:28:24.470 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:28:24.536 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:28:24.609 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:28:24.669 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:28:24.697 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 63/150 2024-04-26T12:28:24.790 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-26T12:28:24.893 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:28:24.957 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 64/150 2024-04-26T12:28:24.963 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:28:24.990 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2024-04-26T12:28:25.030 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 65/150 2024-04-26T12:28:25.224 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-26T12:28:25.278 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:28:25.335 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 36/150 2024-04-26T12:28:25.383 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/150 2024-04-26T12:28:25.462 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-26T12:28:25.614 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el8.noarch 37/150 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 67/150 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:28:25.817 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/150 2024-04-26T12:28:25.901 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 68/150 2024-04-26T12:28:26.004 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 68/150 2024-04-26T12:28:26.060 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 39/150 2024-04-26T12:28:26.113 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:28:26.162 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:28:26.189 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 40/150 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.6-7.el8.x86_64 69/150 2024-04-26T12:28:26.428 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-26T12:28:26.493 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:28:26.499 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 47/150 2024-04-26T12:28:26.518 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:28:26.518 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:28:26.533 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : automake-1.16.1-8.el8.noarch 70/150 2024-04-26T12:28:26.605 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 41/150 2024-04-26T12:28:26.691 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 71/150 2024-04-26T12:28:26.729 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-16.8-9.el8.noarch 47/150 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jq-1.6-7.el8.x86_64 48/150 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:28:26.899 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 42/150 2024-04-26T12:28:26.917 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 48/150 2024-04-26T12:28:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 72/150 2024-04-26T12:28:27.027 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 48/150 2024-04-26T12:28:27.027 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.1-8.el8.noarch 49/150 2024-04-26T12:28:27.137 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 73/150 2024-04-26T12:28:27.145 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 43/150 2024-04-26T12:28:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 50/150 2024-04-26T12:28:27.298 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : jq-1.6-7.el8.x86_64 49/150 2024-04-26T12:28:27.347 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 44/150 2024-04-26T12:28:27.360 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-packaging-16.8-9.el8.noarch 74/150 2024-04-26T12:28:27.377 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 51/150 2024-04-26T12:28:27.526 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.1-8.el8.noarch 50/150 2024-04-26T12:28:27.551 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:28:27.559 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-26T12:28:27.587 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 52/150 2024-04-26T12:28:27.759 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 51/150 2024-04-26T12:28:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-26T12:28:27.824 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.7-17.el8.x86_64 53/150 2024-04-26T12:28:27.950 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 52/150 2024-04-26T12:28:28.018 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 54/150 2024-04-26T12:28:28.046 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-26T12:28:28.060 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 45/150 2024-04-26T12:28:28.102 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 53/150 2024-04-26T12:28:28.233 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 55/150 2024-04-26T12:28:28.257 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-26T12:28:28.363 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.7-17.el8.x86_64 54/150 2024-04-26T12:28:28.386 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:28:28.417 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 46/150 2024-04-26T12:28:28.430 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 56/150 2024-04-26T12:28:28.455 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-26T12:28:28.603 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-26T12:28:28.616 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 55/150 2024-04-26T12:28:28.629 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-packaging-16.8-9.el8.noarch 47/150 2024-04-26T12:28:28.664 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 57/150 2024-04-26T12:28:28.818 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-26T12:28:28.830 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 56/150 2024-04-26T12:28:28.840 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.7-17.el8.x86_64 48/150 2024-04-26T12:28:28.966 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 58/150 2024-04-26T12:28:29.003 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 57/150 2024-04-26T12:28:29.063 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-26T12:28:29.203 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 49/150 2024-04-26T12:28:29.229 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 58/150 2024-04-26T12:28:29.278 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-26T12:28:29.292 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 59/150 2024-04-26T12:28:29.417 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 50/150 2024-04-26T12:28:29.462 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-26T12:28:29.540 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 60/150 2024-04-26T12:28:29.570 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 59/150 2024-04-26T12:28:29.614 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 51/150 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 61/150 2024-04-26T12:28:29.871 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-26T12:28:29.890 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 52/150 2024-04-26T12:28:29.897 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 60/150 2024-04-26T12:28:29.922 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 62/150 2024-04-26T12:28:30.120 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 61/150 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/150 2024-04-26T12:28:30.286 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 63/150 2024-04-26T12:28:30.314 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-26T12:28:30.322 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 62/150 2024-04-26T12:28:30.497 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/150 2024-04-26T12:28:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-26T12:28:30.571 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 63/150 2024-04-26T12:28:30.605 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 64/150 2024-04-26T12:28:30.749 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/150 2024-04-26T12:28:30.799 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-26T12:28:30.912 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 56/150 2024-04-26T12:28:30.945 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 64/150 2024-04-26T12:28:31.032 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-26T12:28:31.153 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 57/150 2024-04-26T12:28:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 65/150 2024-04-26T12:28:31.274 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 65/150 2024-04-26T12:28:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 66/150 2024-04-26T12:28:31.562 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 58/150 2024-04-26T12:28:31.602 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 66/150 2024-04-26T12:28:31.741 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 67/150 2024-04-26T12:28:31.787 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/150 2024-04-26T12:28:31.884 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 59/150 2024-04-26T12:28:31.962 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 68/150 2024-04-26T12:28:32.053 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/150 2024-04-26T12:28:32.219 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 69/150 2024-04-26T12:28:32.229 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 60/150 2024-04-26T12:28:32.330 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-26T12:28:32.376 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/150 2024-04-26T12:28:32.478 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 61/150 2024-04-26T12:28:32.529 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/150 2024-04-26T12:28:32.662 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-26T12:28:32.662 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/150 2024-04-26T12:28:32.737 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-26T12:28:32.834 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/150 2024-04-26T12:28:32.881 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-26T12:28:32.904 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 71/150 2024-04-26T12:28:33.017 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/150 2024-04-26T12:28:33.027 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 72/150 2024-04-26T12:28:33.103 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 72/150 2024-04-26T12:28:33.232 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-26T12:28:33.272 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 73/150 2024-04-26T12:28:33.419 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/150 2024-04-26T12:28:33.431 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 73/150 2024-04-26T12:28:33.518 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-26T12:28:33.543 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 74/150 2024-04-26T12:28:33.654 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-16.8-9.el8.noarch 74/150 2024-04-26T12:28:33.687 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/150 2024-04-26T12:28:33.707 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-26T12:28:33.707 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-26T12:28:33.836 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 66/150 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-26T12:28:34.070 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-26T12:28:34.117 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 67/150 2024-04-26T12:28:34.179 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-26T12:28:34.317 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-26T12:28:34.445 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-26T12:28:34.445 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 68/150 2024-04-26T12:28:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 69/150 2024-04-26T12:28:34.702 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 69/150 2024-04-26T12:28:34.715 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:28:34.748 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-26T12:28:34.774 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:28:34.827 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-26T12:28:34.938 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-26T12:28:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/150 2024-04-26T12:28:35.010 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jq-1.6-7.el8.x86_64 70/150 2024-04-26T12:28:35.068 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : automake-1.16.1-8.el8.noarch 71/150 2024-04-26T12:28:35.321 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-26T12:28:35.417 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 72/150 2024-04-26T12:28:35.481 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-26T12:28:35.519 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-26T12:28:35.601 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 73/150 2024-04-26T12:28:35.712 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-26T12:28:35.719 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-26T12:28:35.828 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 74/150 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-26T12:28:36.002 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/150 2024-04-26T12:28:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-26T12:28:36.128 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-26T12:28:36.235 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/150 2024-04-26T12:28:36.339 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-26T12:28:36.370 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-26T12:28:36.522 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/150 2024-04-26T12:28:36.563 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-26T12:28:36.588 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-26T12:28:36.740 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-26T12:28:36.750 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/150 2024-04-26T12:28:36.812 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-26T12:28:36.947 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/150 2024-04-26T12:28:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-26T12:28:37.057 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-26T12:28:37.172 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/150 2024-04-26T12:28:37.281 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-26T12:28:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-26T12:28:37.414 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/150 2024-04-26T12:28:37.498 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-26T12:28:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-26T12:28:37.691 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/150 2024-04-26T12:28:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-26T12:28:37.897 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 83/150 2024-04-26T12:28:38.112 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 84/150 2024-04-26T12:28:38.290 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 85/150 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 86/150 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-26T12:28:38.688 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:38.755 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 87/150 2024-04-26T12:28:38.900 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-26T12:28:38.911 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-26T12:28:38.956 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 88/150 2024-04-26T12:28:38.957 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-26T12:28:39.235 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-2.6-1.el8.noarch 89/150 2024-04-26T12:28:39.258 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-26T12:28:39.483 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-26T12:28:39.483 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-26T12:28:39.509 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 90/150 2024-04-26T12:28:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-26T12:28:39.844 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:28:39.853 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-26T12:28:39.943 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:28:39.993 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 91/150 2024-04-26T12:28:40.006 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-26T12:28:40.106 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:28:40.176 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-26T12:28:40.396 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 92/150 2024-04-26T12:28:40.409 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-26T12:28:40.812 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-26T12:28:40.982 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:28:41.081 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:28:41.209 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-26T12:28:41.257 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/150 2024-04-26T12:28:41.565 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:28:41.612 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 93/150 2024-04-26T12:28:41.910 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:28:41.953 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 94/150 2024-04-26T12:28:42.109 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/150 2024-04-26T12:28:42.196 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 95/150 2024-04-26T12:28:42.555 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 96/150 2024-04-26T12:28:42.869 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 97/150 2024-04-26T12:28:43.113 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 98/150 2024-04-26T12:28:43.962 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 99/150 2024-04-26T12:28:44.141 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:28:44.207 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/150 2024-04-26T12:28:44.440 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/150 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:45.232 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:45.822 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:46.126 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:46.137 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:28:46.207 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:28:46.418 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:28:46.718 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:47.230 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:28:47.718 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:28:48.408 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:28:49.090 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:49.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:49.978 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 102/150 2024-04-26T12:28:50.256 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:28:50.380 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/150 2024-04-26T12:28:50.532 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:28:59.767 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /run 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2024-04-26T12:28:59.768 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:00.103 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:29:01.741 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:29:02.175 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:29:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:29:02.847 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:29:03.019 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:29:03.037 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:29:04.827 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:29:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:29:05.134 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 110/150 2024-04-26T12:29:05.380 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 111/150 2024-04-26T12:29:05.627 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:29:06.059 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:29:06.059 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-04-26T12:29:06.059 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-04-26T12:29:06.059 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2024-04-26T12:29:06.059 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /run 2024-04-26T12:29:06.059 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-04-26T12:29:06.059 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-04-26T12:29:06.059 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-04-26T12:29:06.060 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-04-26T12:29:06.060 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /dev 2024-04-26T12:29:06.060 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:29:06.650 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:29:06.913 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:29:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:29:07.954 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /run 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2024-04-26T12:29:07.955 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:08.093 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:29:08.095 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:29:08.186 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:29:08.343 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:29:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:29:08.551 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 115/150 2024-04-26T12:29:08.562 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:29:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:29:08.766 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:29:08.803 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:29:08.943 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:29:08.955 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:29:09.230 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:29:09.429 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:29:09.446 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:29:09.994 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:29:10.242 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/150 2024-04-26T12:29:10.280 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:29:10.455 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:29:10.489 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:29:10.500 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:29:10.656 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:29:10.683 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:29:11.024 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:29:11.131 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:29:11.214 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:29:11.217 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:29:11.321 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:29:11.339 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:29:11.378 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:29:11.551 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 110/150 2024-04-26T12:29:11.810 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 111/150 2024-04-26T12:29:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:29:13.024 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/150 2024-04-26T12:29:13.024 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2024-04-26T12:29:13.024 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2024-04-26T12:29:13.024 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /dev 2024-04-26T12:29:13.024 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /run 2024-04-26T12:29:13.024 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2024-04-26T12:29:13.025 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2024-04-26T12:29:13.025 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2024-04-26T12:29:13.025 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2024-04-26T12:29:13.025 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /dev 2024-04-26T12:29:13.025 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:13.066 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:29:13.122 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:29:13.308 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:29:13.325 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:29:13.412 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:29:13.419 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 110/150 2024-04-26T12:29:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 111/150 2024-04-26T12:29:13.904 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:29:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:29:14.486 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:29:14.580 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:29:14.933 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:29:14.986 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 115/150 2024-04-26T12:29:15.213 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:29:15.227 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 105/150 2024-04-26T12:29:15.394 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:29:15.433 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:29:15.461 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:29:15.611 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:29:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:29:15.663 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:29:15.706 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 106/150 2024-04-26T12:29:15.854 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:29:15.944 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/150 2024-04-26T12:29:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/150 2024-04-26T12:29:16.180 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:29:16.381 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 107/150 2024-04-26T12:29:16.412 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:29:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:29:16.529 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:29:16.550 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 108/150 2024-04-26T12:29:16.813 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/150 2024-04-26T12:29:16.900 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 115/150 2024-04-26T12:29:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/150 2024-04-26T12:29:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:29:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 124/150 2024-04-26T12:29:17.116 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:29:17.118 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:29:17.151 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:29:17.303 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:29:17.315 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:29:17.378 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:29:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 125/150 2024-04-26T12:29:17.623 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/150 2024-04-26T12:29:17.724 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:29:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-26T12:29:17.927 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:29:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-26T12:29:18.273 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 129/150 2024-04-26T12:29:18.504 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-26T12:29:18.560 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:29:18.603 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/150 2024-04-26T12:29:18.725 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 131/150 2024-04-26T12:29:18.739 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 109/150 2024-04-26T12:29:18.837 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:29:18.861 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 110/150 2024-04-26T12:29:18.873 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:29:19.031 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/150 2024-04-26T12:29:19.087 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:29:19.118 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 111/150 2024-04-26T12:29:19.309 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:29:19.353 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:29:19.434 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:29:19.555 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 134/150 2024-04-26T12:29:19.612 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:29:19.754 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.6.1-9.el8.x86_64 135/150 2024-04-26T12:29:19.834 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 135/150 2024-04-26T12:29:20.075 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.0.4-10.el8.x86_64 136/150 2024-04-26T12:29:20.089 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 136/150 2024-04-26T12:29:20.257 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-26T12:29:20.470 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-26T12:29:20.470 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:29:20.496 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 112/150 2024-04-26T12:29:20.752 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:29:20.752 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:29:20.768 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:29:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:29:20.978 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:29:21.253 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:29:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:29:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-26T12:29:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:21.842 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 113/150 2024-04-26T12:29:21.952 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:21.952 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:29:22.044 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:29:22.154 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 114/150 2024-04-26T12:29:22.218 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:29:22.218 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:29:22.485 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:22.485 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:29:22.547 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 115/150 2024-04-26T12:29:22.718 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:29:22.718 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:22.735 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:29:22.783 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 116/150 2024-04-26T12:29:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:29:22.969 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:29:22.985 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 117/150 2024-04-26T12:29:23.196 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:29:23.333 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/150 2024-04-26T12:29:23.383 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:29:23.631 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/150 2024-04-26T12:29:23.917 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/150 2024-04-26T12:29:24.019 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:29:24.019 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/150 2024-04-26T12:29:24.019 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/150 2024-04-26T12:29:24.019 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/150 2024-04-26T12:29:24.020 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/150 2024-04-26T12:29:24.020 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/150 2024-04-26T12:29:24.020 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/150 2024-04-26T12:29:24.020 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/150 2024-04-26T12:29:24.020 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/150 2024-04-26T12:29:24.020 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:29:24.021 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:29:24.021 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:29:24.021 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:29:24.021 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/150 2024-04-26T12:29:24.021 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/150 2024-04-26T12:29:24.021 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:29:24.021 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/150 2024-04-26T12:29:24.021 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/150 2024-04-26T12:29:24.022 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-26T12:29:24.034 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-26T12:29:24.035 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-26T12:29:24.036 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 70/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 71/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 72/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 75/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 76/150 2024-04-26T12:29:24.037 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.0.4-10.el8.x86_64 77/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.6.1-9.el8.x86_64 78/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 79/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 80/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 82/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 84/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 86/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 88/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 89/150 2024-04-26T12:29:24.038 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 90/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 91/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : automake-1.16.1-8.el8.noarch 92/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.6-7.el8.x86_64 93/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 94/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 95/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 96/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 97/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 100/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 101/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 102/150 2024-04-26T12:29:24.039 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 103/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 104/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 105/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 107/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 108/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 109/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 110/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 111/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 112/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 113/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 114/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 115/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 116/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 117/150 2024-04-26T12:29:24.040 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 118/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 119/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 120/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 121/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 122/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-26T12:29:24.041 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:24.042 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-26T12:29:24.043 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:24.043 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-26T12:29:24.043 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:24.043 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-26T12:29:24.053 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:29:24.146 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:29:24.360 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/150 2024-04-26T12:29:24.392 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:29:24.405 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:29:24.560 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:29:24.601 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 119/150 2024-04-26T12:29:24.662 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-26T12:29:24.769 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:29:24.872 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-26T12:29:25.016 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/150 2024-04-26T12:29:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 129/150 2024-04-26T12:29:25.156 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 120/150 2024-04-26T12:29:25.294 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:29:25.307 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-26T12:29:25.374 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/150 2024-04-26T12:29:25.543 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 131/150 2024-04-26T12:29:25.643 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/150 2024-04-26T12:29:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/150 2024-04-26T12:29:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:29:26.104 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:29:26.117 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/150 2024-04-26T12:29:26.171 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:29:26.371 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-26T12:29:26.392 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:29:26.469 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:29:26.564 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-26T12:29:26.743 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:29:26.756 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:29:26.791 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 129/150 2024-04-26T12:29:26.970 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 136/150 2024-04-26T12:29:27.044 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-26T12:29:27.127 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-26T12:29:27.289 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 131/150 2024-04-26T12:29:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-26T12:29:27.338 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:29:27.597 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/150 2024-04-26T12:29:27.612 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:29:27.612 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:29:27.830 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:29:27.830 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:29:27.920 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:29:28.112 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:29:28.126 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:29:28.202 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 134/150 2024-04-26T12:29:28.311 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:29:28.460 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:29:28.473 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 135/150 2024-04-26T12:29:28.586 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-26T12:29:28.587 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:28.654 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 136/150 2024-04-26T12:29:28.823 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-26T12:29:28.862 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:28.862 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:29:29.030 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-26T12:29:29.030 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:29:29.145 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:29:29.145 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:29.312 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:29:29.313 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:29:29.386 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:29.387 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:29:29.530 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:29:29.530 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:29:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:29:29.653 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:29.822 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:29:29.920 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:29.921 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:29:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:29:30.192 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:29:30.224 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 121/150 2024-04-26T12:29:30.262 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-26T12:29:30.262 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:30.401 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:29:30.487 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:30.487 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:29:30.554 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/150 2024-04-26T12:29:30.745 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:29:30.745 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:30.785 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/150 2024-04-26T12:29:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:29:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/150 2024-04-26T12:29:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/150 2024-04-26T12:29:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/150 2024-04-26T12:29:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/150 2024-04-26T12:29:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/150 2024-04-26T12:29:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/150 2024-04-26T12:29:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/150 2024-04-26T12:29:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-26T12:29:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-26T12:29:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 70/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 71/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 72/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 73/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/150 2024-04-26T12:29:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 76/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 77/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 79/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 80/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 81/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 82/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 83/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 84/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 85/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 86/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 87/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 88/150 2024-04-26T12:29:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 89/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 90/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 91/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 92/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 93/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 94/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 95/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 96/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 97/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 98/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 99/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 100/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 101/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/150 2024-04-26T12:29:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.1-9.el8.x86_64 103/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 104/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 105/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 106/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 107/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 108/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 109/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 110/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 111/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 112/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 113/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 114/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 115/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 116/150 2024-04-26T12:29:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.1-8.el8.noarch 117/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : jq-1.6-7.el8.x86_64 118/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 119/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 120/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 121/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 122/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-26T12:29:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-26T12:29:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-26T12:29:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-26T12:29:31.020 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:31.020 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:29:31.295 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:29:31.295 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:31.546 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:29:31.609 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/150 2024-04-26T12:29:31.854 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:29:31.899 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 124/150 2024-04-26T12:29:32.060 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:29:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 125/150 2024-04-26T12:29:32.393 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/150 2024-04-26T12:29:32.615 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 127/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:29:32.632 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/150 2024-04-26T12:29:32.633 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/150 2024-04-26T12:29:32.634 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/150 2024-04-26T12:29:32.634 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/150 2024-04-26T12:29:32.634 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/150 2024-04-26T12:29:32.634 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/150 2024-04-26T12:29:32.644 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-26T12:29:32.645 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-26T12:29:32.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 70/150 2024-04-26T12:29:32.647 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 71/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 73/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 74/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 76/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 78/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 79/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 80/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 81/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 82/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 83/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 84/150 2024-04-26T12:29:32.648 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 85/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 86/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 87/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 88/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 91/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 92/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 93/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 94/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 95/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 96/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 97/150 2024-04-26T12:29:32.649 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 98/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 101/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 102/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.0.4-10.el8.x86_64 103/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.1-9.el8.x86_64 104/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 105/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 106/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 107/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 108/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 110/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 111/150 2024-04-26T12:29:32.650 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 112/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 113/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 114/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 115/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 116/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 117/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.1-8.el8.noarch 118/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jq-1.6-7.el8.x86_64 119/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 120/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 121/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 122/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:29:32.651 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-26T12:29:32.652 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-26T12:29:32.653 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:29:32.653 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-26T12:29:32.653 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:32.653 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-26T12:29:32.653 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:32.653 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-26T12:29:32.653 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:32.653 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-26T12:29:32.798 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/150 2024-04-26T12:29:33.035 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 129/150 2024-04-26T12:29:33.285 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/150 2024-04-26T12:29:33.495 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 131/150 2024-04-26T12:29:33.669 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-26T12:29:33.669 INFO:teuthology.orchestra.run.smithi133.stdout:Installed products updated. 2024-04-26T12:29:33.764 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/150 2024-04-26T12:29:34.060 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:29:34.251 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 134/150 2024-04-26T12:29:34.294 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:34.294 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:34.295 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-26T12:29:34.297 INFO:teuthology.orchestra.run.smithi133.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: jq-1.6-7.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:29:34.298 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:29:34.299 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.300 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:29:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:29:34.302 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:29:34.303 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:29:34.304 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:29:34.305 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-26T12:29:34.305 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:34.305 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-04-26T12:29:34.450 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flex-2.6.1-9.el8.x86_64 135/150 2024-04-26T12:29:34.538 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 135/150 2024-04-26T12:29:34.784 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bison-3.0.4-10.el8.x86_64 136/150 2024-04-26T12:29:34.800 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 136/150 2024-04-26T12:29:34.987 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 137/150 2024-04-26T12:29:35.156 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 138/150 2024-04-26T12:29:35.156 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:29:35.454 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 139/150 2024-04-26T12:29:35.454 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:29:35.688 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 140/150 2024-04-26T12:29:35.689 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:29:35.954 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 141/150 2024-04-26T12:29:36.098 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:29:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 143/150 2024-04-26T12:29:36.355 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:36.523 DEBUG:teuthology.parallel:result is None 2024-04-26T12:29:36.595 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:36.595 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:29:36.770 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 145/150 2024-04-26T12:29:36.770 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:37.020 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:37.020 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:29:37.253 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 147/150 2024-04-26T12:29:37.253 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:37.496 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:37.497 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:29:37.736 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 149/150 2024-04-26T12:29:37.927 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:29:38.549 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: elfutils-libelf-0.186-1.el8.x86_64 150/150 2024-04-26T12:29:38.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/150 2024-04-26T12:29:38.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/150 2024-04-26T12:29:38.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/150 2024-04-26T12:29:38.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/150 2024-04-26T12:29:38.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/150 2024-04-26T12:29:38.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/150 2024-04-26T12:29:38.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/150 2024-04-26T12:29:38.549 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/150 2024-04-26T12:29:38.550 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/150 2024-04-26T12:29:38.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/150 2024-04-26T12:29:38.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/150 2024-04-26T12:29:38.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/150 2024-04-26T12:29:38.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/150 2024-04-26T12:29:38.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/150 2024-04-26T12:29:38.551 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/150 2024-04-26T12:29:38.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/150 2024-04-26T12:29:38.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/150 2024-04-26T12:29:38.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/150 2024-04-26T12:29:38.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/150 2024-04-26T12:29:38.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/150 2024-04-26T12:29:38.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/150 2024-04-26T12:29:38.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/150 2024-04-26T12:29:38.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/150 2024-04-26T12:29:38.563 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/150 2024-04-26T12:29:38.564 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 70/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 71/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 72/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 73/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 74/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 75/150 2024-04-26T12:29:38.565 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flex-2.6.1-9.el8.x86_64 77/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 78/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 80/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 81/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 82/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 83/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 84/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 85/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 86/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 87/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 88/150 2024-04-26T12:29:38.566 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 89/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 90/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : automake-1.16.1-8.el8.noarch 91/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jq-1.6-7.el8.x86_64 92/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 93/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 94/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 95/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 96/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 97/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 98/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 99/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 100/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 101/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 102/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 103/150 2024-04-26T12:29:38.567 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 105/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 106/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 109/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 110/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 111/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 112/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 113/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 114/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 115/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 116/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 117/150 2024-04-26T12:29:38.568 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 118/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 119/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 120/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 121/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 122/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 127/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 128/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 129/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 130/150 2024-04-26T12:29:38.569 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 131/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 132/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 133/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 134/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 135/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 136/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 137/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 138/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 139/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 140/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 141/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 142/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 143/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 144/150 2024-04-26T12:29:38.570 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 145/150 2024-04-26T12:29:38.571 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 146/150 2024-04-26T12:29:38.571 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 147/150 2024-04-26T12:29:38.571 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 148/150 2024-04-26T12:29:38.571 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 149/150 2024-04-26T12:29:43.831 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-26T12:29:43.831 INFO:teuthology.orchestra.run.smithi098.stdout:Installed products updated. 2024-04-26T12:29:44.443 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:44.443 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-04-26T12:29:44.443 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-26T12:29:44.443 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-26T12:29:44.443 INFO:teuthology.orchestra.run.smithi098.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:44.443 INFO:teuthology.orchestra.run.smithi098.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:44.443 INFO:teuthology.orchestra.run.smithi098.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:44.443 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.443 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.444 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.445 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: jq-1.6-7.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.446 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:29:44.447 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:29:44.448 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:29:44.449 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:29:44.450 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:29:44.451 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:29:44.451 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:29:44.451 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:29:44.451 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:29:44.451 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:29:44.451 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:29:44.451 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:29:44.452 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:29:44.453 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:29:44.454 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-26T12:29:44.454 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:44.454 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-04-26T12:29:44.639 DEBUG:teuthology.parallel:result is None 2024-04-26T12:29:46.205 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-26T12:29:46.205 INFO:teuthology.orchestra.run.smithi116.stdout:Installed products updated. 2024-04-26T12:29:46.831 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:46.831 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-04-26T12:29:46.831 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-26T12:29:46.831 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-26T12:29:46.831 INFO:teuthology.orchestra.run.smithi116.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:46.831 INFO:teuthology.orchestra.run.smithi116.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:46.831 INFO:teuthology.orchestra.run.smithi116.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:46.831 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.832 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.833 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: jq-1.6-7.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:29:46.834 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-26T12:29:46.835 INFO:teuthology.orchestra.run.smithi116.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-26T12:29:46.836 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:29:46.837 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:29:46.838 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.839 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:29:46.840 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:29:46.841 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:29:46.841 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.841 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.841 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:46.841 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:29:46.841 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:29:46.841 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:29:46.841 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:29:46.841 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-26T12:29:46.842 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:46.842 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-04-26T12:29:47.038 DEBUG:teuthology.parallel:result is None 2024-04-26T12:29:48.333 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 150/150 2024-04-26T12:29:48.333 INFO:teuthology.orchestra.run.smithi038.stdout:Installed products updated. 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.738 INFO:teuthology.orchestra.run.smithi038.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.739 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:49.740 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: jq-1.6-7.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.741 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:29:49.742 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-26T12:29:49.743 INFO:teuthology.orchestra.run.smithi038.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:29:49.744 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:29:49.745 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:29:49.746 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:29:49.747 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.748 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.748 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:29:49.748 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:29:49.748 INFO:teuthology.orchestra.run.smithi038.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:29:49.748 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:29:49.748 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:29:49.748 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-26T12:29:49.748 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:49.748 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2024-04-26T12:29:51.276 DEBUG:teuthology.parallel:result is None 2024-04-26T12:29:51.276 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:29:51.416 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:29:51.444 INFO:teuthology.orchestra.run.smithi038.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:29:51.445 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:29:51.445 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:29:51.447 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:29:51.582 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:29:51.611 INFO:teuthology.orchestra.run.smithi098.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:29:51.611 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:29:51.611 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:29:51.613 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:29:51.749 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:29:51.778 INFO:teuthology.orchestra.run.smithi116.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:29:51.778 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:29:51.778 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:29:51.780 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:29:51.920 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:29:51.947 INFO:teuthology.orchestra.run.smithi133.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:29:51.947 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:29:51.947 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:29:51.949 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T12:29:51.949 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:29:51.949 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:29:52.003 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:29:52.003 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:29:52.052 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:29:52.053 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:29:52.105 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:29:52.105 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:29:52.154 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T12:29:52.154 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:29:52.154 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:29:52.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:29:52.276 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:29:52.276 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:29:52.313 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:29:52.397 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:29:52.397 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:29:52.430 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:29:52.516 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:29:52.516 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:29:52.553 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:29:52.625 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T12:29:52.625 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:29:52.625 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:29:52.661 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:29:52.737 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:29:52.737 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:29:52.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:29:52.848 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:29:52.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:29:52.886 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:29:52.963 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:29:52.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:29:52.998 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:29:53.072 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T12:29:53.072 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:29:53.072 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:29:53.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:29:53.184 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:29:53.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:29:53.216 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:29:53.288 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:29:53.288 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:29:53.320 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:29:53.392 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:29:53.392 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:29:53.425 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:29:53.498 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T12:29:53.590 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T12:29:53.590 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2024-04-26T12:29:53.593 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2024-04-26T12:29:53.595 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-04-26T12:29:53.598 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2024-04-26T12:29:53.629 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T12:29:53.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:29:53.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:29:53.672 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:29:53.674 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:29:53.704 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T12:29:53.704 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:29:53.744 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:29:53.746 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:29:53.749 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:29:53.789 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T12:29:53.789 INFO:tasks.ceph:config {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T12:29:53.789 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674216', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi038.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBNPUHl3CXNTWj1hEysxsoQ/uyh8xDUwi0pwdmOYt8MqX2UYDx6audub4hS2hCsWK4goJDsOvZSzkn6a2wdFPjI=', 'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ10jdB8zyUpHgY/mgU6CQkPD3OkZ4tOCYHskGjeYuYl6O2ekgwypJnrtTFJvqD/jfaVJtJ9BCiEHekSAM05oio=', 'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQkPYgybmgRwDMj2ry9gq8ocliVFUlr7m8bJyVpQfL1GwXhBif708m296Zcb38/lFS9vazlO8rUfAkrjcrG9WI=', 'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKLEdV9K41uMJtqszRYDlHWMD02BejT081teB/Aq9Io1Acvw0wsp0WW7NnzlQwJ1FQMlXUor2ys8nT0ruL9g9Tc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsync-tester.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T12:29:53.789 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:29:53.821 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:29:53.824 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:29:53.826 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:29:53.844 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:29:53.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:29:53.886 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:29:53.888 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:29:53.917 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:29:53.917 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:29:53.973 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:29:53.974 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-04-26T12:29:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:29:54.033 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:54.033 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 177087 Links: 1 2024-04-26T12:29:54.033 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:54.033 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:54.034 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-04-26 12:29:30.618338749 +0000 2024-04-26T12:29:54.034 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-04-26 12:25:32.308304329 +0000 2024-04-26T12:29:54.034 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-04-26 12:25:32.308304329 +0000 2024-04-26T12:29:54.034 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-04-26T12:29:54.034 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:29:54.100 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-04-26T12:29:54.100 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-04-26T12:29:54.100 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000258928 s, 2.0 MB/s 2024-04-26T12:29:54.102 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:29:54.161 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-04-26T12:29:54.220 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:29:54.220 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:54.220 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 177133 Links: 1 2024-04-26T12:29:54.220 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:54.220 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:54.220 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-04-26 12:29:30.618338749 +0000 2024-04-26T12:29:54.220 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-04-26 12:25:32.660299820 +0000 2024-04-26T12:29:54.220 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-04-26 12:25:32.660299820 +0000 2024-04-26T12:29:54.220 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-04-26T12:29:54.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:29:54.286 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-04-26T12:29:54.287 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-04-26T12:29:54.287 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00024178 s, 2.1 MB/s 2024-04-26T12:29:54.288 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:29:54.347 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-04-26T12:29:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:29:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:54.404 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 184380 Links: 1 2024-04-26T12:29:54.404 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:54.405 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:54.405 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-04-26 12:29:30.618338749 +0000 2024-04-26T12:29:54.405 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-04-26 12:25:33.037294991 +0000 2024-04-26T12:29:54.405 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-04-26 12:25:33.037294991 +0000 2024-04-26T12:29:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-04-26T12:29:54.405 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:29:54.470 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-04-26T12:29:54.471 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-04-26T12:29:54.471 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000187528 s, 2.7 MB/s 2024-04-26T12:29:54.472 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:29:54.531 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-04-26T12:29:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:29:54.588 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:54.588 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6h/6d Inode: 185466 Links: 1 2024-04-26T12:29:54.588 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:54.588 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:54.588 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-04-26 12:29:30.618338749 +0000 2024-04-26T12:29:54.589 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-04-26 12:25:33.366290776 +0000 2024-04-26T12:29:54.589 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-04-26 12:25:33.366290776 +0000 2024-04-26T12:29:54.589 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-04-26T12:29:54.589 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:29:54.653 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-04-26T12:29:54.653 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-04-26T12:29:54.653 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000224954 s, 2.3 MB/s 2024-04-26T12:29:54.654 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:29:54.713 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:29:54.713 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:29:54.713 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:29:54.734 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:29:54.734 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-04-26T12:29:54.795 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:29:54.795 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:54.795 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 176543 Links: 1 2024-04-26T12:29:54.795 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:54.795 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:54.795 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-04-26 12:29:32.271177187 +0000 2024-04-26T12:29:54.795 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-04-26 12:25:33.357765138 +0000 2024-04-26T12:29:54.796 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-04-26 12:25:33.357765138 +0000 2024-04-26T12:29:54.796 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-04-26T12:29:54.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:29:54.865 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-04-26T12:29:54.865 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-04-26T12:29:54.865 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000192402 s, 2.7 MB/s 2024-04-26T12:29:54.866 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:29:54.926 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-04-26T12:29:54.985 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:29:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 178722 Links: 1 2024-04-26T12:29:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-04-26 12:29:32.271177187 +0000 2024-04-26T12:29:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-04-26 12:25:33.718759366 +0000 2024-04-26T12:29:54.986 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-04-26 12:25:33.718759366 +0000 2024-04-26T12:29:54.986 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-04-26T12:29:54.986 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:29:55.054 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-04-26T12:29:55.054 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-04-26T12:29:55.054 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000238295 s, 2.1 MB/s 2024-04-26T12:29:55.056 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:29:55.115 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-04-26T12:29:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:29:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:55.174 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 178807 Links: 1 2024-04-26T12:29:55.174 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:55.174 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:55.174 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-04-26 12:29:32.271177187 +0000 2024-04-26T12:29:55.174 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-04-26 12:25:34.063753849 +0000 2024-04-26T12:29:55.174 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-04-26 12:25:34.063753849 +0000 2024-04-26T12:29:55.174 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-04-26T12:29:55.175 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:29:55.241 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-04-26T12:29:55.241 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-04-26T12:29:55.241 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000208168 s, 2.5 MB/s 2024-04-26T12:29:55.242 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:29:55.301 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-04-26T12:29:55.361 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:29:55.361 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:55.361 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 177944 Links: 1 2024-04-26T12:29:55.361 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:55.361 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:55.362 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-04-26 12:29:32.271177187 +0000 2024-04-26T12:29:55.362 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-04-26 12:25:34.401748445 +0000 2024-04-26T12:29:55.362 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-04-26 12:25:34.401748445 +0000 2024-04-26T12:29:55.362 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-04-26T12:29:55.363 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:29:55.429 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-04-26T12:29:55.430 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-04-26T12:29:55.430 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000242113 s, 2.1 MB/s 2024-04-26T12:29:55.431 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:29:55.492 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:29:55.492 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:29:55.492 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:29:55.512 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:29:55.513 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-04-26T12:29:55.574 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:29:55.574 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:55.574 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 183490 Links: 1 2024-04-26T12:29:55.574 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:55.574 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:55.574 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-04-26 12:29:23.662783326 +0000 2024-04-26T12:29:55.574 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-04-26 12:25:40.871007422 +0000 2024-04-26T12:29:55.574 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-04-26 12:25:40.871007422 +0000 2024-04-26T12:29:55.575 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-04-26T12:29:55.575 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:29:55.644 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-04-26T12:29:55.644 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-04-26T12:29:55.645 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000227153 s, 2.3 MB/s 2024-04-26T12:29:55.646 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:29:55.707 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-04-26T12:29:55.766 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:29:55.767 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:55.767 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 179630 Links: 1 2024-04-26T12:29:55.767 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:55.767 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:55.767 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-04-26 12:29:23.662783326 +0000 2024-04-26T12:29:55.767 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-04-26 12:25:41.219001088 +0000 2024-04-26T12:29:55.767 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-04-26 12:25:41.219001088 +0000 2024-04-26T12:29:55.767 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-04-26T12:29:55.767 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:29:55.835 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-04-26T12:29:55.836 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-04-26T12:29:55.836 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000227351 s, 2.3 MB/s 2024-04-26T12:29:55.837 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:29:55.896 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-04-26T12:29:55.955 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:29:55.955 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:55.955 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 174708 Links: 1 2024-04-26T12:29:55.955 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:55.955 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:55.955 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-04-26 12:29:23.662783326 +0000 2024-04-26T12:29:55.955 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-04-26 12:25:41.582994462 +0000 2024-04-26T12:29:55.955 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-04-26 12:25:41.582994462 +0000 2024-04-26T12:29:55.955 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-04-26T12:29:55.955 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:29:56.024 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-04-26T12:29:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-04-26T12:29:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000178047 s, 2.9 MB/s 2024-04-26T12:29:56.026 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:29:56.086 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-04-26T12:29:56.146 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:29:56.146 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:29:56.147 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 174838 Links: 1 2024-04-26T12:29:56.147 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:29:56.147 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:29:56.147 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-04-26 12:29:23.662783326 +0000 2024-04-26T12:29:56.147 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-04-26 12:25:41.928988166 +0000 2024-04-26T12:29:56.147 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-04-26 12:25:41.928988166 +0000 2024-04-26T12:29:56.147 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-04-26T12:29:56.147 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:29:56.215 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-04-26T12:29:56.215 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-04-26T12:29:56.215 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000241681 s, 2.1 MB/s 2024-04-26T12:29:56.217 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:29:56.276 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:29:56.276 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:29:56.276 INFO:tasks.ceph:Generating config... 2024-04-26T12:29:56.277 INFO:tasks.ceph:[global] osd_pg_log_dups_tracked = 10000 2024-04-26T12:29:56.277 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T12:29:56.278 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T12:29:56.278 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T12:29:56.278 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T12:29:56.278 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T12:29:56.278 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T12:29:56.279 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T12:29:56.279 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T12:29:56.279 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T12:29:56.279 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T12:29:56.279 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T12:29:56.279 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T12:29:56.279 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T12:29:56.279 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T12:29:56.348 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T12:29:56.352 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T12:29:56.406 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:29:56.437 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.38'), ('mon.b', '[v2:172.21.15.38:3301,v1:172.21.15.38:6790]'), ('mon.c', '[v2:172.21.15.38:3302,v1:172.21.15.38:6791]')] 2024-04-26T12:29:56.438 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],[v2:172.21.15.38:3302,v1:172.21.15.38:6791]', 'osd_pg_log_dups_tracked': 10000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-26T12:29:56.439 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:29:56.439 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:29:56.499 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.38 --addv b '[v2:172.21.15.38:3301,v1:172.21.15.38:6790]' --addv c '[v2:172.21.15.38:3302,v1:172.21.15.38:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:56.598 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:56.598 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid 64cc8c72-72d6-4335-8e3d-3304aaa6cad9 2024-04-26T12:29:56.598 INFO:teuthology.orchestra.run.smithi038.stdout:setting min_mon_release = pacific 2024-04-26T12:29:56.598 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2024-04-26T12:29:56.598 INFO:teuthology.orchestra.run.smithi038.stdout:fsid 64cc8c72-72d6-4335-8e3d-3304aaa6cad9 2024-04-26T12:29:56.598 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2024-04-26T12:29:56.598047+0000 2024-04-26T12:29:56.598 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-04-26T12:29:56.598047+0000 2024-04-26T12:29:56.598 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 16 (pacific) 2024-04-26T12:29:56.599 INFO:teuthology.orchestra.run.smithi038.stdout:election_strategy: 1 2024-04-26T12:29:56.599 INFO:teuthology.orchestra.run.smithi038.stdout:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2024-04-26T12:29:56.599 INFO:teuthology.orchestra.run.smithi038.stdout:1: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.b 2024-04-26T12:29:56.599 INFO:teuthology.orchestra.run.smithi038.stdout:2: [v2:172.21.15.38:3302/0,v1:172.21.15.38:6791/0] mon.c 2024-04-26T12:29:56.599 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T12:29:56.600 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:29:56.619 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 64cc8c72-72d6-4335-8e3d-3304aaa6cad9... 2024-04-26T12:29:56.620 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:29:56.662 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:29:56.665 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:29:56.668 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:29:56.718 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-04-26T12:29:56.718 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2024-04-26T12:29:56.718 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:29:56.718 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2024-04-26T12:29:56.718 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.718 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:29:56.719 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2024-04-26T12:29:56.720 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2024-04-26T12:29:56.721 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],[v2:172.21.15.38:3302,v1:172.21.15.38:6791]" 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pg_log_dups_tracked = 10000 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 64cc8c72-72d6-4335-8e3d-3304aaa6cad9 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.722 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:29:56.723 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression algorithm = zstd 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression mode = aggressive 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 1/20 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 1/20 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 4/10 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2024-04-26T12:29:56.724 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: osd max markdown count = 1000 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.725 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:29:56.726 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2024-04-26T12:29:56.727 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2024-04-26T12:29:56.728 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:29:56.728 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:29:56.728 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2024-04-26T12:29:56.728 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2024-04-26T12:29:56.728 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2024-04-26T12:29:56.728 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.729 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2024-04-26T12:29:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2024-04-26T12:29:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2024-04-26T12:29:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2024-04-26T12:29:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:29:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2024-04-26T12:29:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:29:56.731 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:29:56.731 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.731 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2024-04-26T12:29:56.731 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.731 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2024-04-26T12:29:56.731 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2024-04-26T12:29:56.731 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:29:56.731 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2024-04-26T12:29:56.732 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],[v2:172.21.15.38:3302,v1:172.21.15.38:6791]" 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pg_log_dups_tracked = 10000 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 64cc8c72-72d6-4335-8e3d-3304aaa6cad9 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2024-04-26T12:29:56.733 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:29:56.734 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore compression algorithm = zstd 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore compression mode = aggressive 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2024-04-26T12:29:56.735 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: osd max markdown count = 1000 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2024-04-26T12:29:56.736 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2024-04-26T12:29:56.737 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:29:56.738 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2024-04-26T12:29:56.739 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2024-04-26T12:29:56.740 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-04-26T12:29:56.740 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-04-26T12:29:56.740 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:29:56.740 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-04-26T12:29:56.740 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.740 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-04-26T12:29:56.740 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.740 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.741 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:29:56.742 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],[v2:172.21.15.38:3302,v1:172.21.15.38:6791]" 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pg_log_dups_tracked = 10000 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 64cc8c72-72d6-4335-8e3d-3304aaa6cad9 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.743 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-04-26T12:29:56.744 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore compression algorithm = zstd 2024-04-26T12:29:56.745 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore compression mode = aggressive 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 1/20 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 1/20 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 4/10 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:29:56.746 INFO:teuthology.orchestra.run.smithi116.stdout: osd max markdown count = 1000 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:56.747 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-04-26T12:29:56.749 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.749 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-04-26T12:29:56.749 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-04-26T12:29:56.749 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-04-26T12:29:56.749 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-04-26T12:29:56.749 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-04-26T12:29:56.749 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:29:56.750 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2024-04-26T12:29:56.751 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: chdir = "" 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: auth supported = cephx 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: filestore xattr use omap = true 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: mon clock drift allowed = 1.000 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: osd crush chooseleaf type = 0 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: auth debug = true 2024-04-26T12:29:56.752 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on old message = true 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on bug = true 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn max object skew = 0 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default size = 2 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow primary affinity = true 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow pg remap = true 2024-04-26T12:29:56.753 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on no sortbitwise = false 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on too few osds = false 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon_allow_pool_size_one = true 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: osd default data pool replay window = 5 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: mon allow pool delete = true 2024-04-26T12:29:56.754 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon cluster log file level = debug 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: debug asserts on shutdown = true 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon health detail to clog = false 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: mon host = "172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],[v2:172.21.15.38:3302,v1:172.21.15.38:6791]" 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pg_log_dups_tracked = 10000 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = 64cc8c72-72d6-4335-8e3d-3304aaa6cad9 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout:[osd] 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: osd journal size = 100 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub load threshold = 5.0 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub max interval = 600 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:29:56.755 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd recover clone overlap = true 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd recovery max chunk = 1048576 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug shutdown = true 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug op order = true 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify stray on activate = true 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd open classes on start = true 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug pg log writeout = true 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: osd map max advance = 10 2024-04-26T12:29:56.756 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: journal zero on create = true 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: filestore apply finisher threads = 3 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: bdev debug aio = true 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug misdirected ops = true 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore block size = 96636764160 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore compression algorithm = zstd 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore compression mode = aggressive 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore fsck on mount = True 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluefs = 1/20 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluestore = 1/20 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-04-26T12:29:56.757 INFO:teuthology.orchestra.run.smithi038.stdout: debug osd = 20 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: debug rocksdb = 4/10 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.9 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd max markdown count = 1000 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: osd objectstore = bluestore 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr] 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: debug mgr = 20 2024-04-26T12:29:56.758 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: mgr/telemetry/nag = false 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout:[mon] 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug paxos = 20 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: mon data avail warn = 5 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: mon mgr mkfs grace = 240 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd reporter subtree level = osd 2024-04-26T12:29:56.759 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd prime pg temp = true 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: # 1m isn't quite enough 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:29:56.760 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout:[client] 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout: rgw cache enabled = true 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable ops log = true 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable usage log = true 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.a] 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.b] 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.c] 2024-04-26T12:29:56.761 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2024-04-26T12:29:56.763 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T12:29:56.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T12:29:56.930 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T12:29:56.930 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:29:56.930 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T12:29:56.951 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:29:56.951 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T12:29:57.013 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2024-04-26T12:29:57.013 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:29:57.013 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:29:57.013 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:29:57.166 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:29:57.166 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:57.203 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T12:29:57.203 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:29:57.204 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:29:57.204 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:29:57.248 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:29:57.249 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:57.308 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-04-26T12:29:57.308 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:29:57.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:29:57.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:29:57.354 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:29:57.354 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:57.413 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2024-04-26T12:29:57.414 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:29:57.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:29:57.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:29:57.461 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:29:57.461 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:57.520 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T12:29:57.521 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T12:29:57.521 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:29:57.590 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:29:57.593 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:29:57.657 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:29:57.659 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T12:29:57.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:29:57.724 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:29:57.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T12:29:57.757 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T12:29:57.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T12:29:57.851 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T12:29:57.866 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T12:29:57.867 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:29:57.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T12:29:57.899 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:29:57.899 INFO:tasks.ceph:role: osd.0 2024-04-26T12:29:57.899 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T12:29:57.899 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:29:57.976 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:29:57.977 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:29:57.977 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:29:57.977 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:29:57.977 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:29:57.977 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:29:57.977 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:29:57.977 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:29:57.977 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:29:57.977 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:29:58.417 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-04-26T12:29:58.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-04-26T12:29:58.419 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:29:58.600 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T12:29:58.637 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:29:58.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T12:29:58.726+0000 7f037ae3c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T12:29:58.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T12:29:58.729+0000 7f037ae3c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T12:29:58.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T12:29:58.729+0000 7f037ae3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:29:58.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T12:29:58.729+0000 7f037ae3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:29:58.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T12:29:58.729+0000 7f037ae3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:29:58.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-04-26T12:29:58.734+0000 7f037ae3c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T12:30:01.586 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T12:30:01.619 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T12:30:01.653 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:30:01.653 INFO:tasks.ceph:role: osd.1 2024-04-26T12:30:01.654 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2024-04-26T12:30:01.654 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:30:01.731 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:30:01.732 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:30:01.732 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:30:01.732 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:30:01.732 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:30:01.732 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:30:01.732 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:30:01.732 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:30:01.732 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:30:01.732 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:30:02.163 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-04-26T12:30:02.165 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-04-26T12:30:02.165 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:30:02.323 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T12:30:02.360 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:30:02.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-26T12:30:02.453+0000 7fcd511147c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T12:30:02.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-26T12:30:02.455+0000 7fcd511147c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T12:30:02.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-26T12:30:02.455+0000 7fcd511147c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:30:02.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-26T12:30:02.455+0000 7fcd511147c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:30:02.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-26T12:30:02.455+0000 7fcd511147c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:30:02.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-04-26T12:30:02.463+0000 7fcd511147c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T12:30:05.312 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T12:30:05.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T12:30:05.379 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:30:05.379 INFO:tasks.ceph:role: osd.2 2024-04-26T12:30:05.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2024-04-26T12:30:05.379 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:30:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:30:05.458 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:30:05.458 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:30:05.458 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:30:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:30:05.458 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:30:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:30:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:30:05.458 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:30:05.458 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:30:05.892 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-04-26T12:30:05.895 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-04-26T12:30:05.895 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T12:30:06.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T12:30:06.086 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:30:06.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-04-26T12:30:06.187+0000 7fa6340307c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T12:30:06.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-04-26T12:30:06.188+0000 7fa6340307c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T12:30:06.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-04-26T12:30:06.188+0000 7fa6340307c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:30:06.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-04-26T12:30:06.188+0000 7fa6340307c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:30:06.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-04-26T12:30:06.188+0000 7fa6340307c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:30:06.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-04-26T12:30:06.196+0000 7fa6340307c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T12:30:09.060 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T12:30:09.092 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T12:30:09.093 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:30:09.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T12:30:09.130 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:30:09.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T12:30:09.206 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:30:09.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T12:30:09.283 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:30:09.283 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T12:30:09.316 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:30:09.316 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T12:30:09.348 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:30:09.349 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T12:30:09.381 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:30:09.381 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T12:30:09.404 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T12:30:09.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T12:30:09.477 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2024-04-26T12:30:09.477 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBFnitmXpsqIxAABOOCj+vVSa6M2xQVASWL2A== 2024-04-26T12:30:09.477 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2024-04-26T12:30:09.477 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBFnitmQ8gnJxAAnAaUwzZxyKW4PKJi3KmV9w== 2024-04-26T12:30:09.477 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2024-04-26T12:30:09.477 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBFnitmSnEqKxAAe7MGQWAKmJ2EmOupU/f/fQ== 2024-04-26T12:30:09.477 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2024-04-26T12:30:09.477 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBGnitmvNNfKxAA28xTjJYqr6sDFIzXQ3l2Zw== 2024-04-26T12:30:09.478 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2024-04-26T12:30:09.478 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBKnitm8JQVGxAA2h+LDD0exPyI5Kv8jCeVvg== 2024-04-26T12:30:09.478 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2024-04-26T12:30:09.478 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBOnitm1Qg1CxAAbbWy4qO5a6BMFYj867a56w== 2024-04-26T12:30:09.478 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2024-04-26T12:30:09.478 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQBFnitmKsO9MhAAfFpXkaAFeOIIe9UCfP2rmg== 2024-04-26T12:30:09.479 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:30:09.585 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:30:09.648 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T12:30:09.712 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:30:09.771 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:30:09.831 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:30:09.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:30:09.952 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T12:30:09.952 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T12:30:09.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:30:10.097 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T12:30:10.128 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T12:30:10.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:30:10.317 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T12:30:10.349 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T12:30:10.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:30:10.554 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T12:30:10.588 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:30:10.649 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T12:30:10.650 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T12:30:10.650 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T12:30:10.692 INFO:tasks.ceph.mon.a:Started 2024-04-26T12:30:10.693 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T12:30:10.693 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T12:30:10.695 INFO:tasks.ceph.mon.b:Started 2024-04-26T12:30:10.695 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T12:30:10.695 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T12:30:10.697 INFO:tasks.ceph.mon.c:Started 2024-04-26T12:30:10.697 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T12:30:10.697 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T12:30:10.698 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T12:30:10.700 INFO:tasks.ceph.mgr.x:Started 2024-04-26T12:30:10.700 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T12:30:10.701 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T12:30:10.704 INFO:tasks.ceph.mgr.y:Started 2024-04-26T12:30:10.704 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T12:30:10.704 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T12:30:16.627 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:16.626+0000 7f6aae0b2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:30:16.729 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:16.728+0000 7f6aae0b2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:30:16.812 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:16.811+0000 7f6aae0b2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:30:16.893 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:16.892+0000 7f6aae0b2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:30:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2024-04-26T12:30:17.021 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T12:30:17.021 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T12:30:17.021 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-04-26T12:30:17.021 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T12:30:17.055 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-04-26T12:30:17.055 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T12:30:17.089 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-04-26T12:30:17.089 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T12:30:17.097 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:17.097+0000 7f6aae0b2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:30:17.122 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 25a1a54a-7d63-4c77-a385-f8147232ba3f 0 2024-04-26T12:30:17.229 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:17.229+0000 7f92b34ea200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:30:17.290 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:17.289+0000 7f6aae0b2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:30:17.320 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:17.319+0000 7f92b34ea200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:30:17.396 INFO:teuthology.orchestra.run.smithi133.stdout:0 2024-04-26T12:30:17.405 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:17.405+0000 7f92b34ea200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:30:17.409 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc 1 2024-04-26T12:30:17.419 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:17.419+0000 7f6aae0b2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:30:17.483 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:17.482+0000 7f92b34ea200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:30:17.529 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:17.529+0000 7f6aae0b2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:30:17.617 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:17.616+0000 7f6aae0b2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:30:17.630 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-04-26T12:30:17.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 0ddc67e1-ee46-4691-bc16-6366296d9929 2 2024-04-26T12:30:17.685 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:17.684+0000 7f92b34ea200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:30:17.876 INFO:teuthology.orchestra.run.smithi133.stdout:2 2024-04-26T12:30:17.882 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:17.881+0000 7f6aae0b2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:30:17.889 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:30:17.889 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:30:17.892 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:30:17.892 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:30:17.892 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:30:17.894 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:30:17.895 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T12:30:17.895 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T12:30:17.897 INFO:tasks.ceph.osd.2:Started 2024-04-26T12:30:17.897 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:17.909 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:17.909+0000 7f92b34ea200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:30:17.966 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:17.965+0000 7f6aae0b2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:30:18.043 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:18.042+0000 7f92b34ea200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:30:18.134 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:18.134 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:17.865270+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:18.142 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:18.141+0000 7f92b34ea200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:30:18.151 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T12:30:18.151 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T12:30:18.231 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:18.230+0000 7f92b34ea200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:30:18.416 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:18.416+0000 7f6aae0b2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:30:18.454 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:18.478 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:18.477+0000 7f92b34ea200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:30:18.486 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:18.485+0000 7fbd8bcae7c0 -1 Falling back to public interface 2024-04-26T12:30:18.494 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:18.493+0000 7f619d3847c0 -1 Falling back to public interface 2024-04-26T12:30:18.500 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:18.499+0000 7f1a04aca7c0 -1 Falling back to public interface 2024-04-26T12:30:18.559 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:18.559+0000 7f92b34ea200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:30:18.678 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-26T12:30:18.678 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":5,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:17.865270+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:18.691 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T12:30:18.824 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:18.823+0000 7f6aae0b2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:30:18.936 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:18.935+0000 7f92b34ea200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:30:19.007 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:19.006+0000 7f6aae0b2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:30:19.097 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:19.096+0000 7f6aae0b2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:30:19.304 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:19.304+0000 7f92b34ea200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:30:19.491 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:19.490+0000 7f92b34ea200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:30:19.573 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:19.572+0000 7f92b34ea200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:30:19.917 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:19.916+0000 7f6aae0b2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:30:20.013 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:20.012+0000 7f6aae0b2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:30:20.166 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:20.165+0000 7f6aae0b2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:30:20.299 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:20.299+0000 7f92b34ea200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:30:20.391 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:20.390+0000 7f92b34ea200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:30:20.534 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:20.533+0000 7f92b34ea200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:30:20.809 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:20.808+0000 7f6aae0b2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:30:20.997 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:20.996+0000 7f6aae0b2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:30:21.137 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:21.136+0000 7f92b34ea200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:30:21.190 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:21.189+0000 7f6aae0b2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:30:21.316 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:21.315+0000 7f92b34ea200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:30:21.494 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:21.494+0000 7f92b34ea200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:30:21.918 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:21.917+0000 7fbd8bcae7c0 -1 osd.2 0 log_to_monitors true 2024-04-26T12:30:21.934 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:21.933+0000 7f1a04aca7c0 -1 osd.1 0 log_to_monitors true 2024-04-26T12:30:21.935 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:21.934+0000 7f619d3847c0 -1 osd.0 0 log_to_monitors true 2024-04-26T12:30:22.142 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:22.142+0000 7f6aae0b2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:30:22.325 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:22.324+0000 7f92b34ea200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:30:22.416 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:22.416+0000 7f6aae0b2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:30:22.503 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:22.502+0000 7f6aae0b2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:30:22.596 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:22.595+0000 7f92b34ea200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:30:22.682 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:22.682+0000 7f92b34ea200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:30:22.948 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:22.947+0000 7f6aae0b2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:30:23.127 INFO:tasks.ceph.mgr.x.smithi038.stderr:2024-04-26T12:30:23.126+0000 7f92b34ea200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:30:23.714 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:23.713+0000 7f619173a700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T12:30:23.728 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:23.727+0000 7f6189314700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:30:23.738 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:23.737+0000 7f19f9681700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T12:30:23.744 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:23.743+0000 7fbd80865700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T12:30:23.753 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:23.752+0000 7f19f0a5a700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:30:23.759 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:23.758+0000 7fbd77c3e700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:30:24.000 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:23.999+0000 7f6a6932a700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T12:30:24.000 INFO:tasks.ceph.mgr.y.smithi038.stderr:2024-04-26T12:30:24.000+0000 7f6a6932a700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T12:30:24.993 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:25.354 INFO:teuthology.misc.health.smithi038.stdout: 2024-04-26T12:30:25.354 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":8,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:24.744360+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:25.369 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T12:30:25.369 INFO:tasks.ceph:Creating RBD pool 2024-04-26T12:30:25.369 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T12:30:25.790 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'rbd' created 2024-04-26T12:30:25.803 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T12:30:26.795 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T12:30:26.810 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T12:30:26.811 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T12:30:26.811 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T12:30:26.813 INFO:tasks.ceph.mds.a:Started 2024-04-26T12:30:26.813 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T12:30:26.813 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:26.905 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2024-04-26T12:30:27.201 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:27.201 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":10,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:26.778505+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:27.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:30:25.029168+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:30:25.763407+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:30:27.217 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:30:27.589 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-04-26T12:30:27.607 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:30:27.981 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2024-04-26T12:30:27.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:30:28.410 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:28.410 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6803/1003606543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1003606543},{"type":"v1","addr":"172.21.15.38:6803","nonce":1003606543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T12:30:28.413 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 2 2024-04-26T12:30:28.426 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:28.792 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:28.792 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":11,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:27.788553+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:28.808 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:30:25.029168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:30:25.763407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:30:28.808 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:30:29.180 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-04-26T12:30:29.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:30:29.558 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2024-04-26T12:30:29.574 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T12:30:29.947 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:29.947 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2024-04-26T12:30:29.947 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:29.948 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2024-04-26T12:30:29.948 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": ".mgr" 2024-04-26T12:30:29.948 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:29.948 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:29.948 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 2, 2024-04-26T12:30:29.948 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "rbd" 2024-04-26T12:30:29.948 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:29.948 INFO:teuthology.orchestra.run.smithi038.stdout:] 2024-04-26T12:30:29.963 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T12:30:29.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T12:30:31.128 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2024-04-26T12:30:31.142 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T12:30:32.153 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2024-04-26T12:30:32.168 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T12:30:32.607 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T12:30:32.621 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:32.985 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:32.985 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":14,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:32.588924+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:33.001 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:33.372 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:33.372 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":14,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:32.588924+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:33.388 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T12:30:34.639 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T12:30:34.639 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T12:30:35.649 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T12:30:35.649 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:30:36.064 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:36.064 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:30:32.589261+0000","modified":"2024-04-26T12:30:35.618890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6803/1003606543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1003606543},{"type":"v1","addr":"172.21.15.38:6803","nonce":1003606543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:30:36.067 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2024-04-26T12:30:36.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:36.444 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:36.444 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":15,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:33.595371+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:36.460 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T12:30:36.460 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:36.829 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:36.831 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:30:36.842 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-26T12:30:34.969410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81528,"kb_used_data":396,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033992,"statfs":{"total":289910292480,"available":289826807808,"internally_reserved":0,"allocated":405504,"data_stored":1262869,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000714"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:30:28.239068+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:30:28.239068+0000","last_peered":"2024-04-26T12:30:28.239068+0000","last_clean":"2024-04-26T12:30:28.239068+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:30:28.239068+0000","last_undegraded":"2024-04-26T12:30:28.239068+0000","last_fullsized":"2024-04-26T12:30:28.239068+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:30:27.810430+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:30:27.810430+0000","last_peered":"2024-04-26T12:30:27.810430+0000","last_clean":"2024-04-26T12:30:27.810430+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:30:27.810430+0000","last_undegraded":"2024-04-26T12:30:27.810430+0000","last_fullsized":"2024-04-26T12:30:27.810430+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:30:28.239012+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:30:28.239012+0000","last_peered":"2024-04-26T12:30:28.239012+0000","last_clean":"2024-04-26T12:30:28.239012+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:30:28.239012+0000","last_undegraded":"2024-04-26T12:30:28.239012+0000","last_fullsized":"2024-04-26T12:30:28.239012+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:30:27.810430+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:30:27.810430+0000","last_peered":"2024-04-26T12:30:27.810430+0000","last_clean":"2024-04-26T12:30:27.810430+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:30:27.810430+0000","last_undegraded":"2024-04-26T12:30:27.810430+0000","last_fullsized":"2024-04-26T12:30:27.810430+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:30:27.810377+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:30:27.810377+0000","last_peered":"2024-04-26T12:30:27.810377+0000","last_clean":"2024-04-26T12:30:27.810377+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:30:27.810377+0000","last_undegraded":"2024-04-26T12:30:27.810377+0000","last_fullsized":"2024-04-26T12:30:27.810377+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:30:27.810387+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:30:27.810387+0000","last_peered":"2024-04-26T12:30:27.810387+0000","last_clean":"2024-04-26T12:30:27.810387+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:30:27.810387+0000","last_undegraded":"2024-04-26T12:30:27.810387+0000","last_fullsized":"2024-04-26T12:30:27.810387+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:30:27.805028+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:30:27.805028+0000","last_peered":"2024-04-26T12:30:27.805028+0000","last_clean":"2024-04-26T12:30:27.805028+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:30:27.805028+0000","last_undegraded":"2024-04-26T12:30:27.805028+0000","last_fullsized":"2024-04-26T12:30:27.805028+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:30:28.239045+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:30:28.239045+0000","last_peered":"2024-04-26T12:30:28.239045+0000","last_clean":"2024-04-26T12:30:28.239045+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:30:28.239045+0000","last_undegraded":"2024-04-26T12:30:28.239045+0000","last_fullsized":"2024-04-26T12:30:28.239045+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T12:30:27.810411+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:30:27.810411+0000","last_peered":"2024-04-26T12:30:27.810411+0000","last_clean":"2024-04-26T12:30:27.810411+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:30:27.810411+0000","last_undegraded":"2024-04-26T12:30:27.810411+0000","last_fullsized":"2024-04-26T12:30:27.810411+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:31.115468+0000","last_change":"2024-04-26T12:30:31.115468+0000","last_active":"2024-04-26T12:30:31.115468+0000","last_peered":"2024-04-26T12:30:31.115468+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:31.115468+0000","last_undegraded":"2024-04-26T12:30:31.115468+0000","last_fullsized":"2024-04-26T12:30:31.115468+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T12:30:32.119831+0000","last_change":"2024-04-26T12:30:32.119831+0000","last_active":"2024-04-26T12:30:32.119831+0000","last_peered":"2024-04-26T12:30:32.119831+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T12:30:32.119831+0000","last_undegraded":"2024-04-26T12:30:32.119831+0000","last_fullsized":"2024-04-26T12:30:32.119831+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618116,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":92,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":94208,"data_stored":26637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":155648,"data_stored":618116,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:36.849 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:37.259 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:37.260 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:30:37.272 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T12:30:36.969728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81640,"kb_used_data":548,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033880,"statfs":{"total":289910292480,"available":289826693120,"internally_reserved":0,"allocated":561152,"data_stored":1317887,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.848930"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613749+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:30:33.613749+0000","last_peered":"2024-04-26T12:30:33.613749+0000","last_clean":"2024-04-26T12:30:33.613749+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:30:33.613749+0000","last_undegraded":"2024-04-26T12:30:33.613749+0000","last_fullsized":"2024-04-26T12:30:33.613749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613688+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:30:33.613688+0000","last_peered":"2024-04-26T12:30:33.613688+0000","last_clean":"2024-04-26T12:30:33.613688+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:30:33.613688+0000","last_undegraded":"2024-04-26T12:30:33.613688+0000","last_fullsized":"2024-04-26T12:30:33.613688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614359+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:30:33.614359+0000","last_peered":"2024-04-26T12:30:33.614359+0000","last_clean":"2024-04-26T12:30:33.614359+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:30:33.614359+0000","last_undegraded":"2024-04-26T12:30:33.614359+0000","last_fullsized":"2024-04-26T12:30:33.614359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614425+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:30:33.614425+0000","last_peered":"2024-04-26T12:30:33.614425+0000","last_clean":"2024-04-26T12:30:33.614425+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:30:33.614425+0000","last_undegraded":"2024-04-26T12:30:33.614425+0000","last_fullsized":"2024-04-26T12:30:33.614425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613283+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:30:33.613283+0000","last_peered":"2024-04-26T12:30:33.613283+0000","last_clean":"2024-04-26T12:30:33.613283+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:30:33.613283+0000","last_undegraded":"2024-04-26T12:30:33.613283+0000","last_fullsized":"2024-04-26T12:30:33.613283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613479+0000","last_change":"2024-04-26T12:30:32.614596+0000","last_active":"2024-04-26T12:30:33.613479+0000","last_peered":"2024-04-26T12:30:33.613479+0000","last_clean":"2024-04-26T12:30:33.613479+0000","last_became_active":"2024-04-26T12:30:32.613418+0000","last_became_peered":"2024-04-26T12:30:32.613418+0000","last_unstale":"2024-04-26T12:30:33.613479+0000","last_undegraded":"2024-04-26T12:30:33.613479+0000","last_fullsized":"2024-04-26T12:30:33.613479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:32.926352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613744+0000","last_change":"2024-04-26T12:30:32.614280+0000","last_active":"2024-04-26T12:30:33.613744+0000","last_peered":"2024-04-26T12:30:33.613744+0000","last_clean":"2024-04-26T12:30:33.613744+0000","last_became_active":"2024-04-26T12:30:32.613382+0000","last_became_peered":"2024-04-26T12:30:32.613382+0000","last_unstale":"2024-04-26T12:30:33.613744+0000","last_undegraded":"2024-04-26T12:30:33.613744+0000","last_fullsized":"2024-04-26T12:30:33.613744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613306+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:30:33.613306+0000","last_peered":"2024-04-26T12:30:33.613306+0000","last_clean":"2024-04-26T12:30:33.613306+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:30:33.613306+0000","last_undegraded":"2024-04-26T12:30:33.613306+0000","last_fullsized":"2024-04-26T12:30:33.613306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641132+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:30:34.641132+0000","last_peered":"2024-04-26T12:30:34.641132+0000","last_clean":"2024-04-26T12:30:34.641132+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:30:34.641132+0000","last_undegraded":"2024-04-26T12:30:34.641132+0000","last_fullsized":"2024-04-26T12:30:34.641132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613769+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:30:33.613769+0000","last_peered":"2024-04-26T12:30:33.613769+0000","last_clean":"2024-04-26T12:30:33.613769+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:30:33.613769+0000","last_undegraded":"2024-04-26T12:30:33.613769+0000","last_fullsized":"2024-04-26T12:30:33.613769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614206+0000","last_change":"2024-04-26T12:30:32.616474+0000","last_active":"2024-04-26T12:30:33.614206+0000","last_peered":"2024-04-26T12:30:33.614206+0000","last_clean":"2024-04-26T12:30:33.614206+0000","last_became_active":"2024-04-26T12:30:32.615780+0000","last_became_peered":"2024-04-26T12:30:32.615780+0000","last_unstale":"2024-04-26T12:30:33.614206+0000","last_undegraded":"2024-04-26T12:30:33.614206+0000","last_fullsized":"2024-04-26T12:30:33.614206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.298182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613314+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:30:33.613314+0000","last_peered":"2024-04-26T12:30:33.613314+0000","last_clean":"2024-04-26T12:30:33.613314+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:30:33.613314+0000","last_undegraded":"2024-04-26T12:30:33.613314+0000","last_fullsized":"2024-04-26T12:30:33.613314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613096+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:30:33.613096+0000","last_peered":"2024-04-26T12:30:33.613096+0000","last_clean":"2024-04-26T12:30:33.613096+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:30:33.613096+0000","last_undegraded":"2024-04-26T12:30:33.613096+0000","last_fullsized":"2024-04-26T12:30:33.613096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613926+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:30:33.613926+0000","last_peered":"2024-04-26T12:30:33.613926+0000","last_clean":"2024-04-26T12:30:33.613926+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:30:33.613926+0000","last_undegraded":"2024-04-26T12:30:33.613926+0000","last_fullsized":"2024-04-26T12:30:33.613926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613728+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:30:33.613728+0000","last_peered":"2024-04-26T12:30:33.613728+0000","last_clean":"2024-04-26T12:30:33.613728+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:30:33.613728+0000","last_undegraded":"2024-04-26T12:30:33.613728+0000","last_fullsized":"2024-04-26T12:30:33.613728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613416+0000","last_change":"2024-04-26T12:30:32.619340+0000","last_active":"2024-04-26T12:30:33.613416+0000","last_peered":"2024-04-26T12:30:33.613416+0000","last_clean":"2024-04-26T12:30:33.613416+0000","last_became_active":"2024-04-26T12:30:32.616781+0000","last_became_peered":"2024-04-26T12:30:32.616781+0000","last_unstale":"2024-04-26T12:30:33.613416+0000","last_undegraded":"2024-04-26T12:30:33.613416+0000","last_fullsized":"2024-04-26T12:30:33.613416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:30.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641153+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:30:34.641153+0000","last_peered":"2024-04-26T12:30:34.641153+0000","last_clean":"2024-04-26T12:30:34.641153+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:30:34.641153+0000","last_undegraded":"2024-04-26T12:30:34.641153+0000","last_fullsized":"2024-04-26T12:30:34.641153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614070+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:30:33.614070+0000","last_peered":"2024-04-26T12:30:33.614070+0000","last_clean":"2024-04-26T12:30:33.614070+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:30:33.614070+0000","last_undegraded":"2024-04-26T12:30:33.614070+0000","last_fullsized":"2024-04-26T12:30:33.614070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641094+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:30:34.641094+0000","last_peered":"2024-04-26T12:30:34.641094+0000","last_clean":"2024-04-26T12:30:34.641094+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:30:34.641094+0000","last_undegraded":"2024-04-26T12:30:34.641094+0000","last_fullsized":"2024-04-26T12:30:34.641094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614333+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:30:33.614333+0000","last_peered":"2024-04-26T12:30:33.614333+0000","last_clean":"2024-04-26T12:30:33.614333+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:30:33.614333+0000","last_undegraded":"2024-04-26T12:30:33.614333+0000","last_fullsized":"2024-04-26T12:30:33.614333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613733+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:30:33.613733+0000","last_peered":"2024-04-26T12:30:33.613733+0000","last_clean":"2024-04-26T12:30:33.613733+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:30:33.613733+0000","last_undegraded":"2024-04-26T12:30:33.613733+0000","last_fullsized":"2024-04-26T12:30:33.613733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613025+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:30:33.613025+0000","last_peered":"2024-04-26T12:30:33.613025+0000","last_clean":"2024-04-26T12:30:33.613025+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:30:33.613025+0000","last_undegraded":"2024-04-26T12:30:33.613025+0000","last_fullsized":"2024-04-26T12:30:33.613025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640404+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:30:34.640404+0000","last_peered":"2024-04-26T12:30:34.640404+0000","last_clean":"2024-04-26T12:30:34.640404+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:30:34.640404+0000","last_undegraded":"2024-04-26T12:30:34.640404+0000","last_fullsized":"2024-04-26T12:30:34.640404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613088+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:30:33.613088+0000","last_peered":"2024-04-26T12:30:33.613088+0000","last_clean":"2024-04-26T12:30:33.613088+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:30:33.613088+0000","last_undegraded":"2024-04-26T12:30:33.613088+0000","last_fullsized":"2024-04-26T12:30:33.613088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613910+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:30:33.613910+0000","last_peered":"2024-04-26T12:30:33.613910+0000","last_clean":"2024-04-26T12:30:33.613910+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:30:33.613910+0000","last_undegraded":"2024-04-26T12:30:33.613910+0000","last_fullsized":"2024-04-26T12:30:33.613910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641161+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:30:34.641161+0000","last_peered":"2024-04-26T12:30:34.641161+0000","last_clean":"2024-04-26T12:30:34.641161+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:30:34.641161+0000","last_undegraded":"2024-04-26T12:30:34.641161+0000","last_fullsized":"2024-04-26T12:30:34.641161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614220+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:30:33.614220+0000","last_peered":"2024-04-26T12:30:33.614220+0000","last_clean":"2024-04-26T12:30:33.614220+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:30:33.614220+0000","last_undegraded":"2024-04-26T12:30:33.614220+0000","last_fullsized":"2024-04-26T12:30:33.614220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613168+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:30:33.613168+0000","last_peered":"2024-04-26T12:30:33.613168+0000","last_clean":"2024-04-26T12:30:33.613168+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:33.613168+0000","last_undegraded":"2024-04-26T12:30:33.613168+0000","last_fullsized":"2024-04-26T12:30:33.613168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613699+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:30:33.613699+0000","last_peered":"2024-04-26T12:30:33.613699+0000","last_clean":"2024-04-26T12:30:33.613699+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:30:33.613699+0000","last_undegraded":"2024-04-26T12:30:33.613699+0000","last_fullsized":"2024-04-26T12:30:33.613699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640503+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:30:34.640503+0000","last_peered":"2024-04-26T12:30:34.640503+0000","last_clean":"2024-04-26T12:30:34.640503+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:30:34.640503+0000","last_undegraded":"2024-04-26T12:30:34.640503+0000","last_fullsized":"2024-04-26T12:30:34.640503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640234+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:30:34.640234+0000","last_peered":"2024-04-26T12:30:34.640234+0000","last_clean":"2024-04-26T12:30:34.640234+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:30:34.640234+0000","last_undegraded":"2024-04-26T12:30:34.640234+0000","last_fullsized":"2024-04-26T12:30:34.640234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614142+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:30:33.614142+0000","last_peered":"2024-04-26T12:30:33.614142+0000","last_clean":"2024-04-26T12:30:33.614142+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:30:33.614142+0000","last_undegraded":"2024-04-26T12:30:33.614142+0000","last_fullsized":"2024-04-26T12:30:33.614142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641363+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:30:34.641363+0000","last_peered":"2024-04-26T12:30:34.641363+0000","last_clean":"2024-04-26T12:30:34.641363+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:30:34.641363+0000","last_undegraded":"2024-04-26T12:30:34.641363+0000","last_fullsized":"2024-04-26T12:30:34.641363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640252+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:30:34.640252+0000","last_peered":"2024-04-26T12:30:34.640252+0000","last_clean":"2024-04-26T12:30:34.640252+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:30:34.640252+0000","last_undegraded":"2024-04-26T12:30:34.640252+0000","last_fullsized":"2024-04-26T12:30:34.640252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614092+0000","last_change":"2024-04-26T12:30:32.163546+0000","last_active":"2024-04-26T12:30:33.614092+0000","last_peered":"2024-04-26T12:30:33.614092+0000","last_clean":"2024-04-26T12:30:33.614092+0000","last_became_active":"2024-04-26T12:30:32.163231+0000","last_became_peered":"2024-04-26T12:30:32.163231+0000","last_unstale":"2024-04-26T12:30:33.614092+0000","last_undegraded":"2024-04-26T12:30:33.614092+0000","last_fullsized":"2024-04-26T12:30:33.614092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640548+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:30:34.640548+0000","last_peered":"2024-04-26T12:30:34.640548+0000","last_clean":"2024-04-26T12:30:34.640548+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:30:34.640548+0000","last_undegraded":"2024-04-26T12:30:34.640548+0000","last_fullsized":"2024-04-26T12:30:34.640548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640519+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:30:34.640519+0000","last_peered":"2024-04-26T12:30:34.640519+0000","last_clean":"2024-04-26T12:30:34.640519+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:30:34.640519+0000","last_undegraded":"2024-04-26T12:30:34.640519+0000","last_fullsized":"2024-04-26T12:30:34.640519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614299+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:30:33.614299+0000","last_peered":"2024-04-26T12:30:33.614299+0000","last_clean":"2024-04-26T12:30:33.614299+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:30:33.614299+0000","last_undegraded":"2024-04-26T12:30:33.614299+0000","last_fullsized":"2024-04-26T12:30:33.614299+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614095+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:30:33.614095+0000","last_peered":"2024-04-26T12:30:33.614095+0000","last_clean":"2024-04-26T12:30:33.614095+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:30:33.614095+0000","last_undegraded":"2024-04-26T12:30:33.614095+0000","last_fullsized":"2024-04-26T12:30:33.614095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613977+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:30:33.613977+0000","last_peered":"2024-04-26T12:30:33.613977+0000","last_clean":"2024-04-26T12:30:33.613977+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:30:33.613977+0000","last_undegraded":"2024-04-26T12:30:33.613977+0000","last_fullsized":"2024-04-26T12:30:33.613977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613519+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:30:33.613519+0000","last_peered":"2024-04-26T12:30:33.613519+0000","last_clean":"2024-04-26T12:30:33.613519+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:30:33.613519+0000","last_undegraded":"2024-04-26T12:30:33.613519+0000","last_fullsized":"2024-04-26T12:30:33.613519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640659+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:30:34.640659+0000","last_peered":"2024-04-26T12:30:34.640659+0000","last_clean":"2024-04-26T12:30:34.640659+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:30:34.640659+0000","last_undegraded":"2024-04-26T12:30:34.640659+0000","last_fullsized":"2024-04-26T12:30:34.640659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613920+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:30:33.613920+0000","last_peered":"2024-04-26T12:30:33.613920+0000","last_clean":"2024-04-26T12:30:33.613920+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:30:33.613920+0000","last_undegraded":"2024-04-26T12:30:33.613920+0000","last_fullsized":"2024-04-26T12:30:33.613920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613180+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:30:33.613180+0000","last_peered":"2024-04-26T12:30:33.613180+0000","last_clean":"2024-04-26T12:30:33.613180+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:30:33.613180+0000","last_undegraded":"2024-04-26T12:30:33.613180+0000","last_fullsized":"2024-04-26T12:30:33.613180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641338+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:30:34.641338+0000","last_peered":"2024-04-26T12:30:34.641338+0000","last_clean":"2024-04-26T12:30:34.641338+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:30:34.641338+0000","last_undegraded":"2024-04-26T12:30:34.641338+0000","last_fullsized":"2024-04-26T12:30:34.641338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613748+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:30:33.613748+0000","last_peered":"2024-04-26T12:30:33.613748+0000","last_clean":"2024-04-26T12:30:33.613748+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:30:33.613748+0000","last_undegraded":"2024-04-26T12:30:33.613748+0000","last_fullsized":"2024-04-26T12:30:33.613748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641478+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:30:34.641478+0000","last_peered":"2024-04-26T12:30:34.641478+0000","last_clean":"2024-04-26T12:30:34.641478+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:30:34.641478+0000","last_undegraded":"2024-04-26T12:30:34.641478+0000","last_fullsized":"2024-04-26T12:30:34.641478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614300+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:30:33.614300+0000","last_peered":"2024-04-26T12:30:33.614300+0000","last_clean":"2024-04-26T12:30:33.614300+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:30:33.614300+0000","last_undegraded":"2024-04-26T12:30:33.614300+0000","last_fullsized":"2024-04-26T12:30:33.614300+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613214+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:30:33.613214+0000","last_peered":"2024-04-26T12:30:33.613214+0000","last_clean":"2024-04-26T12:30:33.613214+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:30:33.613214+0000","last_undegraded":"2024-04-26T12:30:33.613214+0000","last_fullsized":"2024-04-26T12:30:33.613214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613464+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:30:33.613464+0000","last_peered":"2024-04-26T12:30:33.613464+0000","last_clean":"2024-04-26T12:30:33.613464+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:30:33.613464+0000","last_undegraded":"2024-04-26T12:30:33.613464+0000","last_fullsized":"2024-04-26T12:30:33.613464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614330+0000","last_change":"2024-04-26T12:30:32.159189+0000","last_active":"2024-04-26T12:30:33.614330+0000","last_peered":"2024-04-26T12:30:33.614330+0000","last_clean":"2024-04-26T12:30:33.614330+0000","last_became_active":"2024-04-26T12:30:32.158897+0000","last_became_peered":"2024-04-26T12:30:32.158897+0000","last_unstale":"2024-04-26T12:30:33.614330+0000","last_undegraded":"2024-04-26T12:30:33.614330+0000","last_fullsized":"2024-04-26T12:30:33.614330+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613885+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:30:33.613885+0000","last_peered":"2024-04-26T12:30:33.613885+0000","last_clean":"2024-04-26T12:30:33.613885+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:30:33.613885+0000","last_undegraded":"2024-04-26T12:30:33.613885+0000","last_fullsized":"2024-04-26T12:30:33.613885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640992+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:30:34.640992+0000","last_peered":"2024-04-26T12:30:34.640992+0000","last_clean":"2024-04-26T12:30:34.640992+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:30:34.640992+0000","last_undegraded":"2024-04-26T12:30:34.640992+0000","last_fullsized":"2024-04-26T12:30:34.640992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640809+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:30:34.640809+0000","last_peered":"2024-04-26T12:30:34.640809+0000","last_clean":"2024-04-26T12:30:34.640809+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:30:34.640809+0000","last_undegraded":"2024-04-26T12:30:34.640809+0000","last_fullsized":"2024-04-26T12:30:34.640809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614019+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:30:33.614019+0000","last_peered":"2024-04-26T12:30:33.614019+0000","last_clean":"2024-04-26T12:30:33.614019+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:30:33.614019+0000","last_undegraded":"2024-04-26T12:30:33.614019+0000","last_fullsized":"2024-04-26T12:30:33.614019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613501+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:30:33.613501+0000","last_peered":"2024-04-26T12:30:33.613501+0000","last_clean":"2024-04-26T12:30:33.613501+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:30:33.613501+0000","last_undegraded":"2024-04-26T12:30:33.613501+0000","last_fullsized":"2024-04-26T12:30:33.613501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614525+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:30:33.614525+0000","last_peered":"2024-04-26T12:30:33.614525+0000","last_clean":"2024-04-26T12:30:33.614525+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:30:33.614525+0000","last_undegraded":"2024-04-26T12:30:33.614525+0000","last_fullsized":"2024-04-26T12:30:33.614525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612940+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:30:33.612940+0000","last_peered":"2024-04-26T12:30:33.612940+0000","last_clean":"2024-04-26T12:30:33.612940+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:30:33.612940+0000","last_undegraded":"2024-04-26T12:30:33.612940+0000","last_fullsized":"2024-04-26T12:30:33.612940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614223+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:30:33.614223+0000","last_peered":"2024-04-26T12:30:33.614223+0000","last_clean":"2024-04-26T12:30:33.614223+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:30:33.614223+0000","last_undegraded":"2024-04-26T12:30:33.614223+0000","last_fullsized":"2024-04-26T12:30:33.614223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612992+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:30:33.612992+0000","last_peered":"2024-04-26T12:30:33.612992+0000","last_clean":"2024-04-26T12:30:33.612992+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:30:33.612992+0000","last_undegraded":"2024-04-26T12:30:33.612992+0000","last_fullsized":"2024-04-26T12:30:33.612992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641275+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:30:34.641275+0000","last_peered":"2024-04-26T12:30:34.641275+0000","last_clean":"2024-04-26T12:30:34.641275+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:30:34.641275+0000","last_undegraded":"2024-04-26T12:30:34.641275+0000","last_fullsized":"2024-04-26T12:30:34.641275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600450+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:30:32.600450+0000","last_peered":"2024-04-26T12:30:32.600450+0000","last_clean":"2024-04-26T12:30:32.600450+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:30:32.600450+0000","last_undegraded":"2024-04-26T12:30:32.600450+0000","last_fullsized":"2024-04-26T12:30:32.600450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614436+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:30:33.614436+0000","last_peered":"2024-04-26T12:30:33.614436+0000","last_clean":"2024-04-26T12:30:33.614436+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:30:33.614436+0000","last_undegraded":"2024-04-26T12:30:33.614436+0000","last_fullsized":"2024-04-26T12:30:33.614436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613294+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:30:33.613294+0000","last_peered":"2024-04-26T12:30:33.613294+0000","last_clean":"2024-04-26T12:30:33.613294+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:30:33.613294+0000","last_undegraded":"2024-04-26T12:30:33.613294+0000","last_fullsized":"2024-04-26T12:30:33.613294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607913+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:30:32.607913+0000","last_peered":"2024-04-26T12:30:32.607913+0000","last_clean":"2024-04-26T12:30:32.607913+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:30:32.607913+0000","last_undegraded":"2024-04-26T12:30:32.607913+0000","last_fullsized":"2024-04-26T12:30:32.607913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613849+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:30:33.613849+0000","last_peered":"2024-04-26T12:30:33.613849+0000","last_clean":"2024-04-26T12:30:33.613849+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:30:33.613849+0000","last_undegraded":"2024-04-26T12:30:33.613849+0000","last_fullsized":"2024-04-26T12:30:33.613849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641033+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:30:34.641033+0000","last_peered":"2024-04-26T12:30:34.641033+0000","last_clean":"2024-04-26T12:30:34.641033+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:30:34.641033+0000","last_undegraded":"2024-04-26T12:30:34.641033+0000","last_fullsized":"2024-04-26T12:30:34.641033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.599399+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:30:32.599399+0000","last_peered":"2024-04-26T12:30:32.599399+0000","last_clean":"2024-04-26T12:30:32.599399+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:30:32.599399+0000","last_undegraded":"2024-04-26T12:30:32.599399+0000","last_fullsized":"2024-04-26T12:30:32.599399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612917+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:30:33.612917+0000","last_peered":"2024-04-26T12:30:33.612917+0000","last_clean":"2024-04-26T12:30:33.612917+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:30:33.612917+0000","last_undegraded":"2024-04-26T12:30:33.612917+0000","last_fullsized":"2024-04-26T12:30:33.612917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641472+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:30:34.641472+0000","last_peered":"2024-04-26T12:30:34.641472+0000","last_clean":"2024-04-26T12:30:34.641472+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:30:34.641472+0000","last_undegraded":"2024-04-26T12:30:34.641472+0000","last_fullsized":"2024-04-26T12:30:34.641472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.610211+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:30:32.610211+0000","last_peered":"2024-04-26T12:30:32.610211+0000","last_clean":"2024-04-26T12:30:32.610211+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:30:32.610211+0000","last_undegraded":"2024-04-26T12:30:32.610211+0000","last_fullsized":"2024-04-26T12:30:32.610211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607337+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:30:32.607337+0000","last_peered":"2024-04-26T12:30:32.607337+0000","last_clean":"2024-04-26T12:30:32.607337+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:30:32.607337+0000","last_undegraded":"2024-04-26T12:30:32.607337+0000","last_fullsized":"2024-04-26T12:30:32.607337+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640452+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:30:34.640452+0000","last_peered":"2024-04-26T12:30:34.640452+0000","last_clean":"2024-04-26T12:30:34.640452+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:30:34.640452+0000","last_undegraded":"2024-04-26T12:30:34.640452+0000","last_fullsized":"2024-04-26T12:30:34.640452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614485+0000","last_change":"2024-04-26T12:30:32.620556+0000","last_active":"2024-04-26T12:30:33.614485+0000","last_peered":"2024-04-26T12:30:33.614485+0000","last_clean":"2024-04-26T12:30:33.614485+0000","last_became_active":"2024-04-26T12:30:32.620148+0000","last_became_peered":"2024-04-26T12:30:32.620148+0000","last_unstale":"2024-04-26T12:30:33.614485+0000","last_undegraded":"2024-04-26T12:30:33.614485+0000","last_fullsized":"2024-04-26T12:30:33.614485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607350+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:30:32.607350+0000","last_peered":"2024-04-26T12:30:32.607350+0000","last_clean":"2024-04-26T12:30:32.607350+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:30:32.607350+0000","last_undegraded":"2024-04-26T12:30:32.607350+0000","last_fullsized":"2024-04-26T12:30:32.607350+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640248+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:30:34.640248+0000","last_peered":"2024-04-26T12:30:34.640248+0000","last_clean":"2024-04-26T12:30:34.640248+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:30:34.640248+0000","last_undegraded":"2024-04-26T12:30:34.640248+0000","last_fullsized":"2024-04-26T12:30:34.640248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614007+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:30:33.614007+0000","last_peered":"2024-04-26T12:30:33.614007+0000","last_clean":"2024-04-26T12:30:33.614007+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:30:33.614007+0000","last_undegraded":"2024-04-26T12:30:33.614007+0000","last_fullsized":"2024-04-26T12:30:33.614007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.605563+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:30:32.605563+0000","last_peered":"2024-04-26T12:30:32.605563+0000","last_clean":"2024-04-26T12:30:32.605563+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:30:32.605563+0000","last_undegraded":"2024-04-26T12:30:32.605563+0000","last_fullsized":"2024-04-26T12:30:32.605563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640832+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:30:34.640832+0000","last_peered":"2024-04-26T12:30:34.640832+0000","last_clean":"2024-04-26T12:30:34.640832+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:30:34.640832+0000","last_undegraded":"2024-04-26T12:30:34.640832+0000","last_fullsized":"2024-04-26T12:30:34.640832+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613291+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:30:33.613291+0000","last_peered":"2024-04-26T12:30:33.613291+0000","last_clean":"2024-04-26T12:30:33.613291+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:30:33.613291+0000","last_undegraded":"2024-04-26T12:30:33.613291+0000","last_fullsized":"2024-04-26T12:30:33.613291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641247+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:30:34.641247+0000","last_peered":"2024-04-26T12:30:34.641247+0000","last_clean":"2024-04-26T12:30:34.641247+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:30:34.641247+0000","last_undegraded":"2024-04-26T12:30:34.641247+0000","last_fullsized":"2024-04-26T12:30:34.641247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600817+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:30:32.600817+0000","last_peered":"2024-04-26T12:30:32.600817+0000","last_clean":"2024-04-26T12:30:32.600817+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:30:32.600817+0000","last_undegraded":"2024-04-26T12:30:32.600817+0000","last_fullsized":"2024-04-26T12:30:32.600817+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640370+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:30:34.640370+0000","last_peered":"2024-04-26T12:30:34.640370+0000","last_clean":"2024-04-26T12:30:34.640370+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:30:34.640370+0000","last_undegraded":"2024-04-26T12:30:34.640370+0000","last_fullsized":"2024-04-26T12:30:34.640370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.608611+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:30:32.608611+0000","last_peered":"2024-04-26T12:30:32.608611+0000","last_clean":"2024-04-26T12:30:32.608611+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:30:32.608611+0000","last_undegraded":"2024-04-26T12:30:32.608611+0000","last_fullsized":"2024-04-26T12:30:32.608611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641338+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:30:34.641338+0000","last_peered":"2024-04-26T12:30:34.641338+0000","last_clean":"2024-04-26T12:30:34.641338+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:30:34.641338+0000","last_undegraded":"2024-04-26T12:30:34.641338+0000","last_fullsized":"2024-04-26T12:30:34.641338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613310+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:30:33.613310+0000","last_peered":"2024-04-26T12:30:33.613310+0000","last_clean":"2024-04-26T12:30:33.613310+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:30:33.613310+0000","last_undegraded":"2024-04-26T12:30:33.613310+0000","last_fullsized":"2024-04-26T12:30:33.613310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613412+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:30:33.613412+0000","last_peered":"2024-04-26T12:30:33.613412+0000","last_clean":"2024-04-26T12:30:33.613412+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:30:33.613412+0000","last_undegraded":"2024-04-26T12:30:33.613412+0000","last_fullsized":"2024-04-26T12:30:33.613412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613632+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:30:33.613632+0000","last_peered":"2024-04-26T12:30:33.613632+0000","last_clean":"2024-04-26T12:30:33.613632+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:30:33.613632+0000","last_undegraded":"2024-04-26T12:30:33.613632+0000","last_fullsized":"2024-04-26T12:30:33.613632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614172+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:30:33.614172+0000","last_peered":"2024-04-26T12:30:33.614172+0000","last_clean":"2024-04-26T12:30:33.614172+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:30:33.614172+0000","last_undegraded":"2024-04-26T12:30:33.614172+0000","last_fullsized":"2024-04-26T12:30:33.614172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613790+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:30:33.613790+0000","last_peered":"2024-04-26T12:30:33.613790+0000","last_clean":"2024-04-26T12:30:33.613790+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:30:33.613790+0000","last_undegraded":"2024-04-26T12:30:33.613790+0000","last_fullsized":"2024-04-26T12:30:33.613790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613843+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:30:33.613843+0000","last_peered":"2024-04-26T12:30:33.613843+0000","last_clean":"2024-04-26T12:30:33.613843+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:30:33.613843+0000","last_undegraded":"2024-04-26T12:30:33.613843+0000","last_fullsized":"2024-04-26T12:30:33.613843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612884+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:30:33.612884+0000","last_peered":"2024-04-26T12:30:33.612884+0000","last_clean":"2024-04-26T12:30:33.612884+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:30:33.612884+0000","last_undegraded":"2024-04-26T12:30:33.612884+0000","last_fullsized":"2024-04-26T12:30:33.612884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641370+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:30:34.641370+0000","last_peered":"2024-04-26T12:30:34.641370+0000","last_clean":"2024-04-26T12:30:34.641370+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:30:34.641370+0000","last_undegraded":"2024-04-26T12:30:34.641370+0000","last_fullsized":"2024-04-26T12:30:34.641370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613737+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:30:33.613737+0000","last_peered":"2024-04-26T12:30:33.613737+0000","last_clean":"2024-04-26T12:30:33.613737+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:30:33.613737+0000","last_undegraded":"2024-04-26T12:30:33.613737+0000","last_fullsized":"2024-04-26T12:30:33.613737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613593+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:30:33.613593+0000","last_peered":"2024-04-26T12:30:33.613593+0000","last_clean":"2024-04-26T12:30:33.613593+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:30:33.613593+0000","last_undegraded":"2024-04-26T12:30:33.613593+0000","last_fullsized":"2024-04-26T12:30:33.613593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640266+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:30:34.640266+0000","last_peered":"2024-04-26T12:30:34.640266+0000","last_clean":"2024-04-26T12:30:34.640266+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:30:34.640266+0000","last_undegraded":"2024-04-26T12:30:34.640266+0000","last_fullsized":"2024-04-26T12:30:34.640266+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613341+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:30:33.613341+0000","last_peered":"2024-04-26T12:30:33.613341+0000","last_clean":"2024-04-26T12:30:33.613341+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:30:33.613341+0000","last_undegraded":"2024-04-26T12:30:33.613341+0000","last_fullsized":"2024-04-26T12:30:33.613341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640934+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:30:34.640934+0000","last_peered":"2024-04-26T12:30:34.640934+0000","last_clean":"2024-04-26T12:30:34.640934+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:30:34.640934+0000","last_undegraded":"2024-04-26T12:30:34.640934+0000","last_fullsized":"2024-04-26T12:30:34.640934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613671+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:30:33.613671+0000","last_peered":"2024-04-26T12:30:33.613671+0000","last_clean":"2024-04-26T12:30:33.613671+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:30:33.613671+0000","last_undegraded":"2024-04-26T12:30:33.613671+0000","last_fullsized":"2024-04-26T12:30:33.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":638777,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":126976,"data_stored":40949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":638161,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:37.277 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T12:30:37.277 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T12:30:37.277 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T12:30:37.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T12:30:37.277 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T12:30:37.750 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:37.764 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":39758},{"type":"v1","addr":"172.21.15.38:6801","nonce":39758}]},"active_addr":"172.21.15.38:6801/39758","active_change":"2024-04-26T12:30:22.962367+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":797824989}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":46190003}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":876051888}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.38:0","nonce":3247507954}]}]} 2024-04-26T12:30:37.767 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T12:30:37.767 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:30:37.767 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:37.931 INFO:tasks.ceph.mds.a.smithi038.stderr:2024-04-26T12:30:37.930+0000 7fc16825f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T12:30:38.131 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:38.132 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":15,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:33.595371+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:38.148 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:30:38.148 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:38.511 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:38.512 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":15,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:33.595371+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:38.528 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:30:38.528 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:30:38.529 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:30:38.719 INFO:teuthology.orchestra.run.smithi038.stdout:34359738372 2024-04-26T12:30:38.719 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:30:38.730 INFO:teuthology.orchestra.run.smithi038.stdout:34359738373 2024-04-26T12:30:38.730 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:30:38.737 INFO:teuthology.orchestra.run.smithi038.stdout:34359738372 2024-04-26T12:30:38.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:30:39.159 INFO:teuthology.orchestra.run.smithi038.stdout:34359738371 2024-04-26T12:30:39.173 INFO:teuthology.orchestra.run.smithi038.stdout:34359738371 2024-04-26T12:30:39.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2024-04-26T12:30:39.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2024-04-26T12:30:39.190 INFO:teuthology.orchestra.run.smithi038.stdout:34359738372 2024-04-26T12:30:39.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.1 2024-04-26T12:30:40.176 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:30:40.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:30:40.208 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:30:40.569 INFO:teuthology.orchestra.run.smithi038.stdout:34359738372 2024-04-26T12:30:40.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2024-04-26T12:30:40.586 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:40.603 INFO:teuthology.orchestra.run.smithi038.stdout:34359738373 2024-04-26T12:30:40.604 INFO:teuthology.orchestra.run.smithi038.stdout:34359738372 2024-04-26T12:30:40.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.1 2024-04-26T12:30:40.621 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:40.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.2 2024-04-26T12:30:40.622 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:40.622 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:30:40.622 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:41.034 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:41.035 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:30:41.047 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-26T12:30:40.970671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81640,"kb_used_data":556,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033880,"statfs":{"total":289910292480,"available":289826693120,"internally_reserved":0,"allocated":569344,"data_stored":1322490,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.368601"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613749+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:30:33.613749+0000","last_peered":"2024-04-26T12:30:33.613749+0000","last_clean":"2024-04-26T12:30:33.613749+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:30:33.613749+0000","last_undegraded":"2024-04-26T12:30:33.613749+0000","last_fullsized":"2024-04-26T12:30:33.613749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613688+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:30:33.613688+0000","last_peered":"2024-04-26T12:30:33.613688+0000","last_clean":"2024-04-26T12:30:33.613688+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:30:33.613688+0000","last_undegraded":"2024-04-26T12:30:33.613688+0000","last_fullsized":"2024-04-26T12:30:33.613688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614359+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:30:33.614359+0000","last_peered":"2024-04-26T12:30:33.614359+0000","last_clean":"2024-04-26T12:30:33.614359+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:30:33.614359+0000","last_undegraded":"2024-04-26T12:30:33.614359+0000","last_fullsized":"2024-04-26T12:30:33.614359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614425+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:30:33.614425+0000","last_peered":"2024-04-26T12:30:33.614425+0000","last_clean":"2024-04-26T12:30:33.614425+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:30:33.614425+0000","last_undegraded":"2024-04-26T12:30:33.614425+0000","last_fullsized":"2024-04-26T12:30:33.614425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613283+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:30:33.613283+0000","last_peered":"2024-04-26T12:30:33.613283+0000","last_clean":"2024-04-26T12:30:33.613283+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:30:33.613283+0000","last_undegraded":"2024-04-26T12:30:33.613283+0000","last_fullsized":"2024-04-26T12:30:33.613283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613479+0000","last_change":"2024-04-26T12:30:32.614596+0000","last_active":"2024-04-26T12:30:33.613479+0000","last_peered":"2024-04-26T12:30:33.613479+0000","last_clean":"2024-04-26T12:30:33.613479+0000","last_became_active":"2024-04-26T12:30:32.613418+0000","last_became_peered":"2024-04-26T12:30:32.613418+0000","last_unstale":"2024-04-26T12:30:33.613479+0000","last_undegraded":"2024-04-26T12:30:33.613479+0000","last_fullsized":"2024-04-26T12:30:33.613479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:32.926352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613744+0000","last_change":"2024-04-26T12:30:32.614280+0000","last_active":"2024-04-26T12:30:33.613744+0000","last_peered":"2024-04-26T12:30:33.613744+0000","last_clean":"2024-04-26T12:30:33.613744+0000","last_became_active":"2024-04-26T12:30:32.613382+0000","last_became_peered":"2024-04-26T12:30:32.613382+0000","last_unstale":"2024-04-26T12:30:33.613744+0000","last_undegraded":"2024-04-26T12:30:33.613744+0000","last_fullsized":"2024-04-26T12:30:33.613744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613306+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:30:33.613306+0000","last_peered":"2024-04-26T12:30:33.613306+0000","last_clean":"2024-04-26T12:30:33.613306+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:30:33.613306+0000","last_undegraded":"2024-04-26T12:30:33.613306+0000","last_fullsized":"2024-04-26T12:30:33.613306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641132+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:30:34.641132+0000","last_peered":"2024-04-26T12:30:34.641132+0000","last_clean":"2024-04-26T12:30:34.641132+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:30:34.641132+0000","last_undegraded":"2024-04-26T12:30:34.641132+0000","last_fullsized":"2024-04-26T12:30:34.641132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613769+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:30:33.613769+0000","last_peered":"2024-04-26T12:30:33.613769+0000","last_clean":"2024-04-26T12:30:33.613769+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:30:33.613769+0000","last_undegraded":"2024-04-26T12:30:33.613769+0000","last_fullsized":"2024-04-26T12:30:33.613769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614206+0000","last_change":"2024-04-26T12:30:32.616474+0000","last_active":"2024-04-26T12:30:33.614206+0000","last_peered":"2024-04-26T12:30:33.614206+0000","last_clean":"2024-04-26T12:30:33.614206+0000","last_became_active":"2024-04-26T12:30:32.615780+0000","last_became_peered":"2024-04-26T12:30:32.615780+0000","last_unstale":"2024-04-26T12:30:33.614206+0000","last_undegraded":"2024-04-26T12:30:33.614206+0000","last_fullsized":"2024-04-26T12:30:33.614206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.298182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613314+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:30:33.613314+0000","last_peered":"2024-04-26T12:30:33.613314+0000","last_clean":"2024-04-26T12:30:33.613314+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:30:33.613314+0000","last_undegraded":"2024-04-26T12:30:33.613314+0000","last_fullsized":"2024-04-26T12:30:33.613314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613096+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:30:33.613096+0000","last_peered":"2024-04-26T12:30:33.613096+0000","last_clean":"2024-04-26T12:30:33.613096+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:30:33.613096+0000","last_undegraded":"2024-04-26T12:30:33.613096+0000","last_fullsized":"2024-04-26T12:30:33.613096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613926+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:30:33.613926+0000","last_peered":"2024-04-26T12:30:33.613926+0000","last_clean":"2024-04-26T12:30:33.613926+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:30:33.613926+0000","last_undegraded":"2024-04-26T12:30:33.613926+0000","last_fullsized":"2024-04-26T12:30:33.613926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613728+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:30:33.613728+0000","last_peered":"2024-04-26T12:30:33.613728+0000","last_clean":"2024-04-26T12:30:33.613728+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:30:33.613728+0000","last_undegraded":"2024-04-26T12:30:33.613728+0000","last_fullsized":"2024-04-26T12:30:33.613728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613416+0000","last_change":"2024-04-26T12:30:32.619340+0000","last_active":"2024-04-26T12:30:33.613416+0000","last_peered":"2024-04-26T12:30:33.613416+0000","last_clean":"2024-04-26T12:30:33.613416+0000","last_became_active":"2024-04-26T12:30:32.616781+0000","last_became_peered":"2024-04-26T12:30:32.616781+0000","last_unstale":"2024-04-26T12:30:33.613416+0000","last_undegraded":"2024-04-26T12:30:33.613416+0000","last_fullsized":"2024-04-26T12:30:33.613416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:30.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641153+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:30:34.641153+0000","last_peered":"2024-04-26T12:30:34.641153+0000","last_clean":"2024-04-26T12:30:34.641153+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:30:34.641153+0000","last_undegraded":"2024-04-26T12:30:34.641153+0000","last_fullsized":"2024-04-26T12:30:34.641153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614070+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:30:33.614070+0000","last_peered":"2024-04-26T12:30:33.614070+0000","last_clean":"2024-04-26T12:30:33.614070+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:30:33.614070+0000","last_undegraded":"2024-04-26T12:30:33.614070+0000","last_fullsized":"2024-04-26T12:30:33.614070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641094+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:30:34.641094+0000","last_peered":"2024-04-26T12:30:34.641094+0000","last_clean":"2024-04-26T12:30:34.641094+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:30:34.641094+0000","last_undegraded":"2024-04-26T12:30:34.641094+0000","last_fullsized":"2024-04-26T12:30:34.641094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614333+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:30:33.614333+0000","last_peered":"2024-04-26T12:30:33.614333+0000","last_clean":"2024-04-26T12:30:33.614333+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:30:33.614333+0000","last_undegraded":"2024-04-26T12:30:33.614333+0000","last_fullsized":"2024-04-26T12:30:33.614333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613733+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:30:33.613733+0000","last_peered":"2024-04-26T12:30:33.613733+0000","last_clean":"2024-04-26T12:30:33.613733+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:30:33.613733+0000","last_undegraded":"2024-04-26T12:30:33.613733+0000","last_fullsized":"2024-04-26T12:30:33.613733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613025+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:30:33.613025+0000","last_peered":"2024-04-26T12:30:33.613025+0000","last_clean":"2024-04-26T12:30:33.613025+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:30:33.613025+0000","last_undegraded":"2024-04-26T12:30:33.613025+0000","last_fullsized":"2024-04-26T12:30:33.613025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640404+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:30:34.640404+0000","last_peered":"2024-04-26T12:30:34.640404+0000","last_clean":"2024-04-26T12:30:34.640404+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:30:34.640404+0000","last_undegraded":"2024-04-26T12:30:34.640404+0000","last_fullsized":"2024-04-26T12:30:34.640404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613088+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:30:33.613088+0000","last_peered":"2024-04-26T12:30:33.613088+0000","last_clean":"2024-04-26T12:30:33.613088+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:30:33.613088+0000","last_undegraded":"2024-04-26T12:30:33.613088+0000","last_fullsized":"2024-04-26T12:30:33.613088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613910+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:30:33.613910+0000","last_peered":"2024-04-26T12:30:33.613910+0000","last_clean":"2024-04-26T12:30:33.613910+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:30:33.613910+0000","last_undegraded":"2024-04-26T12:30:33.613910+0000","last_fullsized":"2024-04-26T12:30:33.613910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641161+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:30:34.641161+0000","last_peered":"2024-04-26T12:30:34.641161+0000","last_clean":"2024-04-26T12:30:34.641161+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:30:34.641161+0000","last_undegraded":"2024-04-26T12:30:34.641161+0000","last_fullsized":"2024-04-26T12:30:34.641161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614220+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:30:33.614220+0000","last_peered":"2024-04-26T12:30:33.614220+0000","last_clean":"2024-04-26T12:30:33.614220+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:30:33.614220+0000","last_undegraded":"2024-04-26T12:30:33.614220+0000","last_fullsized":"2024-04-26T12:30:33.614220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613168+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:30:33.613168+0000","last_peered":"2024-04-26T12:30:33.613168+0000","last_clean":"2024-04-26T12:30:33.613168+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:33.613168+0000","last_undegraded":"2024-04-26T12:30:33.613168+0000","last_fullsized":"2024-04-26T12:30:33.613168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613699+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:30:33.613699+0000","last_peered":"2024-04-26T12:30:33.613699+0000","last_clean":"2024-04-26T12:30:33.613699+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:30:33.613699+0000","last_undegraded":"2024-04-26T12:30:33.613699+0000","last_fullsized":"2024-04-26T12:30:33.613699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640503+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:30:34.640503+0000","last_peered":"2024-04-26T12:30:34.640503+0000","last_clean":"2024-04-26T12:30:34.640503+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:30:34.640503+0000","last_undegraded":"2024-04-26T12:30:34.640503+0000","last_fullsized":"2024-04-26T12:30:34.640503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640234+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:30:34.640234+0000","last_peered":"2024-04-26T12:30:34.640234+0000","last_clean":"2024-04-26T12:30:34.640234+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:30:34.640234+0000","last_undegraded":"2024-04-26T12:30:34.640234+0000","last_fullsized":"2024-04-26T12:30:34.640234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614142+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:30:33.614142+0000","last_peered":"2024-04-26T12:30:33.614142+0000","last_clean":"2024-04-26T12:30:33.614142+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:30:33.614142+0000","last_undegraded":"2024-04-26T12:30:33.614142+0000","last_fullsized":"2024-04-26T12:30:33.614142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641363+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:30:34.641363+0000","last_peered":"2024-04-26T12:30:34.641363+0000","last_clean":"2024-04-26T12:30:34.641363+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:30:34.641363+0000","last_undegraded":"2024-04-26T12:30:34.641363+0000","last_fullsized":"2024-04-26T12:30:34.641363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640252+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:30:34.640252+0000","last_peered":"2024-04-26T12:30:34.640252+0000","last_clean":"2024-04-26T12:30:34.640252+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:30:34.640252+0000","last_undegraded":"2024-04-26T12:30:34.640252+0000","last_fullsized":"2024-04-26T12:30:34.640252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614092+0000","last_change":"2024-04-26T12:30:32.163546+0000","last_active":"2024-04-26T12:30:33.614092+0000","last_peered":"2024-04-26T12:30:33.614092+0000","last_clean":"2024-04-26T12:30:33.614092+0000","last_became_active":"2024-04-26T12:30:32.163231+0000","last_became_peered":"2024-04-26T12:30:32.163231+0000","last_unstale":"2024-04-26T12:30:33.614092+0000","last_undegraded":"2024-04-26T12:30:33.614092+0000","last_fullsized":"2024-04-26T12:30:33.614092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640548+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:30:34.640548+0000","last_peered":"2024-04-26T12:30:34.640548+0000","last_clean":"2024-04-26T12:30:34.640548+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:30:34.640548+0000","last_undegraded":"2024-04-26T12:30:34.640548+0000","last_fullsized":"2024-04-26T12:30:34.640548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640519+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:30:34.640519+0000","last_peered":"2024-04-26T12:30:34.640519+0000","last_clean":"2024-04-26T12:30:34.640519+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:30:34.640519+0000","last_undegraded":"2024-04-26T12:30:34.640519+0000","last_fullsized":"2024-04-26T12:30:34.640519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614299+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:30:33.614299+0000","last_peered":"2024-04-26T12:30:33.614299+0000","last_clean":"2024-04-26T12:30:33.614299+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:30:33.614299+0000","last_undegraded":"2024-04-26T12:30:33.614299+0000","last_fullsized":"2024-04-26T12:30:33.614299+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614095+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:30:33.614095+0000","last_peered":"2024-04-26T12:30:33.614095+0000","last_clean":"2024-04-26T12:30:33.614095+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:30:33.614095+0000","last_undegraded":"2024-04-26T12:30:33.614095+0000","last_fullsized":"2024-04-26T12:30:33.614095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613977+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:30:33.613977+0000","last_peered":"2024-04-26T12:30:33.613977+0000","last_clean":"2024-04-26T12:30:33.613977+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:30:33.613977+0000","last_undegraded":"2024-04-26T12:30:33.613977+0000","last_fullsized":"2024-04-26T12:30:33.613977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613519+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:30:33.613519+0000","last_peered":"2024-04-26T12:30:33.613519+0000","last_clean":"2024-04-26T12:30:33.613519+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:30:33.613519+0000","last_undegraded":"2024-04-26T12:30:33.613519+0000","last_fullsized":"2024-04-26T12:30:33.613519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640659+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:30:34.640659+0000","last_peered":"2024-04-26T12:30:34.640659+0000","last_clean":"2024-04-26T12:30:34.640659+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:30:34.640659+0000","last_undegraded":"2024-04-26T12:30:34.640659+0000","last_fullsized":"2024-04-26T12:30:34.640659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613920+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:30:33.613920+0000","last_peered":"2024-04-26T12:30:33.613920+0000","last_clean":"2024-04-26T12:30:33.613920+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:30:33.613920+0000","last_undegraded":"2024-04-26T12:30:33.613920+0000","last_fullsized":"2024-04-26T12:30:33.613920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613180+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:30:33.613180+0000","last_peered":"2024-04-26T12:30:33.613180+0000","last_clean":"2024-04-26T12:30:33.613180+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:30:33.613180+0000","last_undegraded":"2024-04-26T12:30:33.613180+0000","last_fullsized":"2024-04-26T12:30:33.613180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641338+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:30:34.641338+0000","last_peered":"2024-04-26T12:30:34.641338+0000","last_clean":"2024-04-26T12:30:34.641338+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:30:34.641338+0000","last_undegraded":"2024-04-26T12:30:34.641338+0000","last_fullsized":"2024-04-26T12:30:34.641338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613748+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:30:33.613748+0000","last_peered":"2024-04-26T12:30:33.613748+0000","last_clean":"2024-04-26T12:30:33.613748+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:30:33.613748+0000","last_undegraded":"2024-04-26T12:30:33.613748+0000","last_fullsized":"2024-04-26T12:30:33.613748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641478+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:30:34.641478+0000","last_peered":"2024-04-26T12:30:34.641478+0000","last_clean":"2024-04-26T12:30:34.641478+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:30:34.641478+0000","last_undegraded":"2024-04-26T12:30:34.641478+0000","last_fullsized":"2024-04-26T12:30:34.641478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614300+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:30:33.614300+0000","last_peered":"2024-04-26T12:30:33.614300+0000","last_clean":"2024-04-26T12:30:33.614300+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:30:33.614300+0000","last_undegraded":"2024-04-26T12:30:33.614300+0000","last_fullsized":"2024-04-26T12:30:33.614300+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613214+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:30:33.613214+0000","last_peered":"2024-04-26T12:30:33.613214+0000","last_clean":"2024-04-26T12:30:33.613214+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:30:33.613214+0000","last_undegraded":"2024-04-26T12:30:33.613214+0000","last_fullsized":"2024-04-26T12:30:33.613214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613464+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:30:33.613464+0000","last_peered":"2024-04-26T12:30:33.613464+0000","last_clean":"2024-04-26T12:30:33.613464+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:30:33.613464+0000","last_undegraded":"2024-04-26T12:30:33.613464+0000","last_fullsized":"2024-04-26T12:30:33.613464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614330+0000","last_change":"2024-04-26T12:30:32.159189+0000","last_active":"2024-04-26T12:30:33.614330+0000","last_peered":"2024-04-26T12:30:33.614330+0000","last_clean":"2024-04-26T12:30:33.614330+0000","last_became_active":"2024-04-26T12:30:32.158897+0000","last_became_peered":"2024-04-26T12:30:32.158897+0000","last_unstale":"2024-04-26T12:30:33.614330+0000","last_undegraded":"2024-04-26T12:30:33.614330+0000","last_fullsized":"2024-04-26T12:30:33.614330+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613885+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:30:33.613885+0000","last_peered":"2024-04-26T12:30:33.613885+0000","last_clean":"2024-04-26T12:30:33.613885+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:30:33.613885+0000","last_undegraded":"2024-04-26T12:30:33.613885+0000","last_fullsized":"2024-04-26T12:30:33.613885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640992+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:30:34.640992+0000","last_peered":"2024-04-26T12:30:34.640992+0000","last_clean":"2024-04-26T12:30:34.640992+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:30:34.640992+0000","last_undegraded":"2024-04-26T12:30:34.640992+0000","last_fullsized":"2024-04-26T12:30:34.640992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640809+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:30:34.640809+0000","last_peered":"2024-04-26T12:30:34.640809+0000","last_clean":"2024-04-26T12:30:34.640809+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:30:34.640809+0000","last_undegraded":"2024-04-26T12:30:34.640809+0000","last_fullsized":"2024-04-26T12:30:34.640809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614019+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:30:33.614019+0000","last_peered":"2024-04-26T12:30:33.614019+0000","last_clean":"2024-04-26T12:30:33.614019+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:30:33.614019+0000","last_undegraded":"2024-04-26T12:30:33.614019+0000","last_fullsized":"2024-04-26T12:30:33.614019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613501+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:30:33.613501+0000","last_peered":"2024-04-26T12:30:33.613501+0000","last_clean":"2024-04-26T12:30:33.613501+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:30:33.613501+0000","last_undegraded":"2024-04-26T12:30:33.613501+0000","last_fullsized":"2024-04-26T12:30:33.613501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614525+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:30:33.614525+0000","last_peered":"2024-04-26T12:30:33.614525+0000","last_clean":"2024-04-26T12:30:33.614525+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:30:33.614525+0000","last_undegraded":"2024-04-26T12:30:33.614525+0000","last_fullsized":"2024-04-26T12:30:33.614525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612940+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:30:33.612940+0000","last_peered":"2024-04-26T12:30:33.612940+0000","last_clean":"2024-04-26T12:30:33.612940+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:30:33.612940+0000","last_undegraded":"2024-04-26T12:30:33.612940+0000","last_fullsized":"2024-04-26T12:30:33.612940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614223+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:30:33.614223+0000","last_peered":"2024-04-26T12:30:33.614223+0000","last_clean":"2024-04-26T12:30:33.614223+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:30:33.614223+0000","last_undegraded":"2024-04-26T12:30:33.614223+0000","last_fullsized":"2024-04-26T12:30:33.614223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612992+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:30:33.612992+0000","last_peered":"2024-04-26T12:30:33.612992+0000","last_clean":"2024-04-26T12:30:33.612992+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:30:33.612992+0000","last_undegraded":"2024-04-26T12:30:33.612992+0000","last_fullsized":"2024-04-26T12:30:33.612992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641275+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:30:34.641275+0000","last_peered":"2024-04-26T12:30:34.641275+0000","last_clean":"2024-04-26T12:30:34.641275+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:30:34.641275+0000","last_undegraded":"2024-04-26T12:30:34.641275+0000","last_fullsized":"2024-04-26T12:30:34.641275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600450+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:30:32.600450+0000","last_peered":"2024-04-26T12:30:32.600450+0000","last_clean":"2024-04-26T12:30:32.600450+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:30:32.600450+0000","last_undegraded":"2024-04-26T12:30:32.600450+0000","last_fullsized":"2024-04-26T12:30:32.600450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614436+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:30:33.614436+0000","last_peered":"2024-04-26T12:30:33.614436+0000","last_clean":"2024-04-26T12:30:33.614436+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:30:33.614436+0000","last_undegraded":"2024-04-26T12:30:33.614436+0000","last_fullsized":"2024-04-26T12:30:33.614436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613294+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:30:33.613294+0000","last_peered":"2024-04-26T12:30:33.613294+0000","last_clean":"2024-04-26T12:30:33.613294+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:30:33.613294+0000","last_undegraded":"2024-04-26T12:30:33.613294+0000","last_fullsized":"2024-04-26T12:30:33.613294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607913+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:30:32.607913+0000","last_peered":"2024-04-26T12:30:32.607913+0000","last_clean":"2024-04-26T12:30:32.607913+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:30:32.607913+0000","last_undegraded":"2024-04-26T12:30:32.607913+0000","last_fullsized":"2024-04-26T12:30:32.607913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613849+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:30:33.613849+0000","last_peered":"2024-04-26T12:30:33.613849+0000","last_clean":"2024-04-26T12:30:33.613849+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:30:33.613849+0000","last_undegraded":"2024-04-26T12:30:33.613849+0000","last_fullsized":"2024-04-26T12:30:33.613849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641033+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:30:34.641033+0000","last_peered":"2024-04-26T12:30:34.641033+0000","last_clean":"2024-04-26T12:30:34.641033+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:30:34.641033+0000","last_undegraded":"2024-04-26T12:30:34.641033+0000","last_fullsized":"2024-04-26T12:30:34.641033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.599399+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:30:32.599399+0000","last_peered":"2024-04-26T12:30:32.599399+0000","last_clean":"2024-04-26T12:30:32.599399+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:30:32.599399+0000","last_undegraded":"2024-04-26T12:30:32.599399+0000","last_fullsized":"2024-04-26T12:30:32.599399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612917+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:30:33.612917+0000","last_peered":"2024-04-26T12:30:33.612917+0000","last_clean":"2024-04-26T12:30:33.612917+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:30:33.612917+0000","last_undegraded":"2024-04-26T12:30:33.612917+0000","last_fullsized":"2024-04-26T12:30:33.612917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641472+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:30:34.641472+0000","last_peered":"2024-04-26T12:30:34.641472+0000","last_clean":"2024-04-26T12:30:34.641472+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:30:34.641472+0000","last_undegraded":"2024-04-26T12:30:34.641472+0000","last_fullsized":"2024-04-26T12:30:34.641472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.610211+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:30:32.610211+0000","last_peered":"2024-04-26T12:30:32.610211+0000","last_clean":"2024-04-26T12:30:32.610211+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:30:32.610211+0000","last_undegraded":"2024-04-26T12:30:32.610211+0000","last_fullsized":"2024-04-26T12:30:32.610211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607337+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:30:32.607337+0000","last_peered":"2024-04-26T12:30:32.607337+0000","last_clean":"2024-04-26T12:30:32.607337+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:30:32.607337+0000","last_undegraded":"2024-04-26T12:30:32.607337+0000","last_fullsized":"2024-04-26T12:30:32.607337+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640452+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:30:34.640452+0000","last_peered":"2024-04-26T12:30:34.640452+0000","last_clean":"2024-04-26T12:30:34.640452+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:30:34.640452+0000","last_undegraded":"2024-04-26T12:30:34.640452+0000","last_fullsized":"2024-04-26T12:30:34.640452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614485+0000","last_change":"2024-04-26T12:30:32.620556+0000","last_active":"2024-04-26T12:30:33.614485+0000","last_peered":"2024-04-26T12:30:33.614485+0000","last_clean":"2024-04-26T12:30:33.614485+0000","last_became_active":"2024-04-26T12:30:32.620148+0000","last_became_peered":"2024-04-26T12:30:32.620148+0000","last_unstale":"2024-04-26T12:30:33.614485+0000","last_undegraded":"2024-04-26T12:30:33.614485+0000","last_fullsized":"2024-04-26T12:30:33.614485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607350+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:30:32.607350+0000","last_peered":"2024-04-26T12:30:32.607350+0000","last_clean":"2024-04-26T12:30:32.607350+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:30:32.607350+0000","last_undegraded":"2024-04-26T12:30:32.607350+0000","last_fullsized":"2024-04-26T12:30:32.607350+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640248+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:30:34.640248+0000","last_peered":"2024-04-26T12:30:34.640248+0000","last_clean":"2024-04-26T12:30:34.640248+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:30:34.640248+0000","last_undegraded":"2024-04-26T12:30:34.640248+0000","last_fullsized":"2024-04-26T12:30:34.640248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614007+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:30:33.614007+0000","last_peered":"2024-04-26T12:30:33.614007+0000","last_clean":"2024-04-26T12:30:33.614007+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:30:33.614007+0000","last_undegraded":"2024-04-26T12:30:33.614007+0000","last_fullsized":"2024-04-26T12:30:33.614007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.605563+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:30:32.605563+0000","last_peered":"2024-04-26T12:30:32.605563+0000","last_clean":"2024-04-26T12:30:32.605563+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:30:32.605563+0000","last_undegraded":"2024-04-26T12:30:32.605563+0000","last_fullsized":"2024-04-26T12:30:32.605563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640832+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:30:34.640832+0000","last_peered":"2024-04-26T12:30:34.640832+0000","last_clean":"2024-04-26T12:30:34.640832+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:30:34.640832+0000","last_undegraded":"2024-04-26T12:30:34.640832+0000","last_fullsized":"2024-04-26T12:30:34.640832+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613291+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:30:33.613291+0000","last_peered":"2024-04-26T12:30:33.613291+0000","last_clean":"2024-04-26T12:30:33.613291+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:30:33.613291+0000","last_undegraded":"2024-04-26T12:30:33.613291+0000","last_fullsized":"2024-04-26T12:30:33.613291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641247+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:30:34.641247+0000","last_peered":"2024-04-26T12:30:34.641247+0000","last_clean":"2024-04-26T12:30:34.641247+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:30:34.641247+0000","last_undegraded":"2024-04-26T12:30:34.641247+0000","last_fullsized":"2024-04-26T12:30:34.641247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600817+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:30:32.600817+0000","last_peered":"2024-04-26T12:30:32.600817+0000","last_clean":"2024-04-26T12:30:32.600817+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:30:32.600817+0000","last_undegraded":"2024-04-26T12:30:32.600817+0000","last_fullsized":"2024-04-26T12:30:32.600817+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640370+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:30:34.640370+0000","last_peered":"2024-04-26T12:30:34.640370+0000","last_clean":"2024-04-26T12:30:34.640370+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:30:34.640370+0000","last_undegraded":"2024-04-26T12:30:34.640370+0000","last_fullsized":"2024-04-26T12:30:34.640370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.608611+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:30:32.608611+0000","last_peered":"2024-04-26T12:30:32.608611+0000","last_clean":"2024-04-26T12:30:32.608611+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:30:32.608611+0000","last_undegraded":"2024-04-26T12:30:32.608611+0000","last_fullsized":"2024-04-26T12:30:32.608611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.995826+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:30:34.995826+0000","last_peered":"2024-04-26T12:30:34.995826+0000","last_clean":"2024-04-26T12:30:34.995826+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:30:34.995826+0000","last_undegraded":"2024-04-26T12:30:34.995826+0000","last_fullsized":"2024-04-26T12:30:34.995826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613310+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:30:33.613310+0000","last_peered":"2024-04-26T12:30:33.613310+0000","last_clean":"2024-04-26T12:30:33.613310+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:30:33.613310+0000","last_undegraded":"2024-04-26T12:30:33.613310+0000","last_fullsized":"2024-04-26T12:30:33.613310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613412+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:30:33.613412+0000","last_peered":"2024-04-26T12:30:33.613412+0000","last_clean":"2024-04-26T12:30:33.613412+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:30:33.613412+0000","last_undegraded":"2024-04-26T12:30:33.613412+0000","last_fullsized":"2024-04-26T12:30:33.613412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613632+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:30:33.613632+0000","last_peered":"2024-04-26T12:30:33.613632+0000","last_clean":"2024-04-26T12:30:33.613632+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:30:33.613632+0000","last_undegraded":"2024-04-26T12:30:33.613632+0000","last_fullsized":"2024-04-26T12:30:33.613632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614172+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:30:33.614172+0000","last_peered":"2024-04-26T12:30:33.614172+0000","last_clean":"2024-04-26T12:30:33.614172+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:30:33.614172+0000","last_undegraded":"2024-04-26T12:30:33.614172+0000","last_fullsized":"2024-04-26T12:30:33.614172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613790+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:30:33.613790+0000","last_peered":"2024-04-26T12:30:33.613790+0000","last_clean":"2024-04-26T12:30:33.613790+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:30:33.613790+0000","last_undegraded":"2024-04-26T12:30:33.613790+0000","last_fullsized":"2024-04-26T12:30:33.613790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613843+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:30:33.613843+0000","last_peered":"2024-04-26T12:30:33.613843+0000","last_clean":"2024-04-26T12:30:33.613843+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:30:33.613843+0000","last_undegraded":"2024-04-26T12:30:33.613843+0000","last_fullsized":"2024-04-26T12:30:33.613843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612884+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:30:33.612884+0000","last_peered":"2024-04-26T12:30:33.612884+0000","last_clean":"2024-04-26T12:30:33.612884+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:30:33.612884+0000","last_undegraded":"2024-04-26T12:30:33.612884+0000","last_fullsized":"2024-04-26T12:30:33.612884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641370+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:30:34.641370+0000","last_peered":"2024-04-26T12:30:34.641370+0000","last_clean":"2024-04-26T12:30:34.641370+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:30:34.641370+0000","last_undegraded":"2024-04-26T12:30:34.641370+0000","last_fullsized":"2024-04-26T12:30:34.641370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613737+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:30:33.613737+0000","last_peered":"2024-04-26T12:30:33.613737+0000","last_clean":"2024-04-26T12:30:33.613737+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:30:33.613737+0000","last_undegraded":"2024-04-26T12:30:33.613737+0000","last_fullsized":"2024-04-26T12:30:33.613737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613593+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:30:33.613593+0000","last_peered":"2024-04-26T12:30:33.613593+0000","last_clean":"2024-04-26T12:30:33.613593+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:30:33.613593+0000","last_undegraded":"2024-04-26T12:30:33.613593+0000","last_fullsized":"2024-04-26T12:30:33.613593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640266+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:30:34.640266+0000","last_peered":"2024-04-26T12:30:34.640266+0000","last_clean":"2024-04-26T12:30:34.640266+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:30:34.640266+0000","last_undegraded":"2024-04-26T12:30:34.640266+0000","last_fullsized":"2024-04-26T12:30:34.640266+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613341+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:30:33.613341+0000","last_peered":"2024-04-26T12:30:33.613341+0000","last_clean":"2024-04-26T12:30:33.613341+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:30:33.613341+0000","last_undegraded":"2024-04-26T12:30:33.613341+0000","last_fullsized":"2024-04-26T12:30:33.613341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640934+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:30:34.640934+0000","last_peered":"2024-04-26T12:30:34.640934+0000","last_clean":"2024-04-26T12:30:34.640934+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:30:34.640934+0000","last_undegraded":"2024-04-26T12:30:34.640934+0000","last_fullsized":"2024-04-26T12:30:34.640934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613671+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:30:33.613671+0000","last_peered":"2024-04-26T12:30:33.613671+0000","last_clean":"2024-04-26T12:30:33.613671+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:30:33.613671+0000","last_undegraded":"2024-04-26T12:30:33.613671+0000","last_fullsized":"2024-04-26T12:30:33.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":638777,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":135168,"data_stored":45552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":638161,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:41.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:41.461 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:41.463 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:30:41.475 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-26T12:30:40.970671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81640,"kb_used_data":556,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033880,"statfs":{"total":289910292480,"available":289826693120,"internally_reserved":0,"allocated":569344,"data_stored":1322490,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.368601"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613749+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:30:33.613749+0000","last_peered":"2024-04-26T12:30:33.613749+0000","last_clean":"2024-04-26T12:30:33.613749+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:30:33.613749+0000","last_undegraded":"2024-04-26T12:30:33.613749+0000","last_fullsized":"2024-04-26T12:30:33.613749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613688+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:30:33.613688+0000","last_peered":"2024-04-26T12:30:33.613688+0000","last_clean":"2024-04-26T12:30:33.613688+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:30:33.613688+0000","last_undegraded":"2024-04-26T12:30:33.613688+0000","last_fullsized":"2024-04-26T12:30:33.613688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614359+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:30:33.614359+0000","last_peered":"2024-04-26T12:30:33.614359+0000","last_clean":"2024-04-26T12:30:33.614359+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:30:33.614359+0000","last_undegraded":"2024-04-26T12:30:33.614359+0000","last_fullsized":"2024-04-26T12:30:33.614359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614425+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:30:33.614425+0000","last_peered":"2024-04-26T12:30:33.614425+0000","last_clean":"2024-04-26T12:30:33.614425+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:30:33.614425+0000","last_undegraded":"2024-04-26T12:30:33.614425+0000","last_fullsized":"2024-04-26T12:30:33.614425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613283+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:30:33.613283+0000","last_peered":"2024-04-26T12:30:33.613283+0000","last_clean":"2024-04-26T12:30:33.613283+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:30:33.613283+0000","last_undegraded":"2024-04-26T12:30:33.613283+0000","last_fullsized":"2024-04-26T12:30:33.613283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613479+0000","last_change":"2024-04-26T12:30:32.614596+0000","last_active":"2024-04-26T12:30:33.613479+0000","last_peered":"2024-04-26T12:30:33.613479+0000","last_clean":"2024-04-26T12:30:33.613479+0000","last_became_active":"2024-04-26T12:30:32.613418+0000","last_became_peered":"2024-04-26T12:30:32.613418+0000","last_unstale":"2024-04-26T12:30:33.613479+0000","last_undegraded":"2024-04-26T12:30:33.613479+0000","last_fullsized":"2024-04-26T12:30:33.613479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:32.926352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613744+0000","last_change":"2024-04-26T12:30:32.614280+0000","last_active":"2024-04-26T12:30:33.613744+0000","last_peered":"2024-04-26T12:30:33.613744+0000","last_clean":"2024-04-26T12:30:33.613744+0000","last_became_active":"2024-04-26T12:30:32.613382+0000","last_became_peered":"2024-04-26T12:30:32.613382+0000","last_unstale":"2024-04-26T12:30:33.613744+0000","last_undegraded":"2024-04-26T12:30:33.613744+0000","last_fullsized":"2024-04-26T12:30:33.613744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613306+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:30:33.613306+0000","last_peered":"2024-04-26T12:30:33.613306+0000","last_clean":"2024-04-26T12:30:33.613306+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:30:33.613306+0000","last_undegraded":"2024-04-26T12:30:33.613306+0000","last_fullsized":"2024-04-26T12:30:33.613306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641132+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:30:34.641132+0000","last_peered":"2024-04-26T12:30:34.641132+0000","last_clean":"2024-04-26T12:30:34.641132+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:30:34.641132+0000","last_undegraded":"2024-04-26T12:30:34.641132+0000","last_fullsized":"2024-04-26T12:30:34.641132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613769+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:30:33.613769+0000","last_peered":"2024-04-26T12:30:33.613769+0000","last_clean":"2024-04-26T12:30:33.613769+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:30:33.613769+0000","last_undegraded":"2024-04-26T12:30:33.613769+0000","last_fullsized":"2024-04-26T12:30:33.613769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614206+0000","last_change":"2024-04-26T12:30:32.616474+0000","last_active":"2024-04-26T12:30:33.614206+0000","last_peered":"2024-04-26T12:30:33.614206+0000","last_clean":"2024-04-26T12:30:33.614206+0000","last_became_active":"2024-04-26T12:30:32.615780+0000","last_became_peered":"2024-04-26T12:30:32.615780+0000","last_unstale":"2024-04-26T12:30:33.614206+0000","last_undegraded":"2024-04-26T12:30:33.614206+0000","last_fullsized":"2024-04-26T12:30:33.614206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.298182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613314+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:30:33.613314+0000","last_peered":"2024-04-26T12:30:33.613314+0000","last_clean":"2024-04-26T12:30:33.613314+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:30:33.613314+0000","last_undegraded":"2024-04-26T12:30:33.613314+0000","last_fullsized":"2024-04-26T12:30:33.613314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613096+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:30:33.613096+0000","last_peered":"2024-04-26T12:30:33.613096+0000","last_clean":"2024-04-26T12:30:33.613096+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:30:33.613096+0000","last_undegraded":"2024-04-26T12:30:33.613096+0000","last_fullsized":"2024-04-26T12:30:33.613096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613926+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:30:33.613926+0000","last_peered":"2024-04-26T12:30:33.613926+0000","last_clean":"2024-04-26T12:30:33.613926+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:30:33.613926+0000","last_undegraded":"2024-04-26T12:30:33.613926+0000","last_fullsized":"2024-04-26T12:30:33.613926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613728+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:30:33.613728+0000","last_peered":"2024-04-26T12:30:33.613728+0000","last_clean":"2024-04-26T12:30:33.613728+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:30:33.613728+0000","last_undegraded":"2024-04-26T12:30:33.613728+0000","last_fullsized":"2024-04-26T12:30:33.613728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613416+0000","last_change":"2024-04-26T12:30:32.619340+0000","last_active":"2024-04-26T12:30:33.613416+0000","last_peered":"2024-04-26T12:30:33.613416+0000","last_clean":"2024-04-26T12:30:33.613416+0000","last_became_active":"2024-04-26T12:30:32.616781+0000","last_became_peered":"2024-04-26T12:30:32.616781+0000","last_unstale":"2024-04-26T12:30:33.613416+0000","last_undegraded":"2024-04-26T12:30:33.613416+0000","last_fullsized":"2024-04-26T12:30:33.613416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:30.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641153+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:30:34.641153+0000","last_peered":"2024-04-26T12:30:34.641153+0000","last_clean":"2024-04-26T12:30:34.641153+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:30:34.641153+0000","last_undegraded":"2024-04-26T12:30:34.641153+0000","last_fullsized":"2024-04-26T12:30:34.641153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614070+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:30:33.614070+0000","last_peered":"2024-04-26T12:30:33.614070+0000","last_clean":"2024-04-26T12:30:33.614070+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:30:33.614070+0000","last_undegraded":"2024-04-26T12:30:33.614070+0000","last_fullsized":"2024-04-26T12:30:33.614070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641094+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:30:34.641094+0000","last_peered":"2024-04-26T12:30:34.641094+0000","last_clean":"2024-04-26T12:30:34.641094+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:30:34.641094+0000","last_undegraded":"2024-04-26T12:30:34.641094+0000","last_fullsized":"2024-04-26T12:30:34.641094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614333+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:30:33.614333+0000","last_peered":"2024-04-26T12:30:33.614333+0000","last_clean":"2024-04-26T12:30:33.614333+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:30:33.614333+0000","last_undegraded":"2024-04-26T12:30:33.614333+0000","last_fullsized":"2024-04-26T12:30:33.614333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613733+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:30:33.613733+0000","last_peered":"2024-04-26T12:30:33.613733+0000","last_clean":"2024-04-26T12:30:33.613733+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:30:33.613733+0000","last_undegraded":"2024-04-26T12:30:33.613733+0000","last_fullsized":"2024-04-26T12:30:33.613733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613025+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:30:33.613025+0000","last_peered":"2024-04-26T12:30:33.613025+0000","last_clean":"2024-04-26T12:30:33.613025+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:30:33.613025+0000","last_undegraded":"2024-04-26T12:30:33.613025+0000","last_fullsized":"2024-04-26T12:30:33.613025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640404+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:30:34.640404+0000","last_peered":"2024-04-26T12:30:34.640404+0000","last_clean":"2024-04-26T12:30:34.640404+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:30:34.640404+0000","last_undegraded":"2024-04-26T12:30:34.640404+0000","last_fullsized":"2024-04-26T12:30:34.640404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613088+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:30:33.613088+0000","last_peered":"2024-04-26T12:30:33.613088+0000","last_clean":"2024-04-26T12:30:33.613088+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:30:33.613088+0000","last_undegraded":"2024-04-26T12:30:33.613088+0000","last_fullsized":"2024-04-26T12:30:33.613088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613910+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:30:33.613910+0000","last_peered":"2024-04-26T12:30:33.613910+0000","last_clean":"2024-04-26T12:30:33.613910+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:30:33.613910+0000","last_undegraded":"2024-04-26T12:30:33.613910+0000","last_fullsized":"2024-04-26T12:30:33.613910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641161+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:30:34.641161+0000","last_peered":"2024-04-26T12:30:34.641161+0000","last_clean":"2024-04-26T12:30:34.641161+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:30:34.641161+0000","last_undegraded":"2024-04-26T12:30:34.641161+0000","last_fullsized":"2024-04-26T12:30:34.641161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614220+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:30:33.614220+0000","last_peered":"2024-04-26T12:30:33.614220+0000","last_clean":"2024-04-26T12:30:33.614220+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:30:33.614220+0000","last_undegraded":"2024-04-26T12:30:33.614220+0000","last_fullsized":"2024-04-26T12:30:33.614220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613168+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:30:33.613168+0000","last_peered":"2024-04-26T12:30:33.613168+0000","last_clean":"2024-04-26T12:30:33.613168+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:33.613168+0000","last_undegraded":"2024-04-26T12:30:33.613168+0000","last_fullsized":"2024-04-26T12:30:33.613168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613699+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:30:33.613699+0000","last_peered":"2024-04-26T12:30:33.613699+0000","last_clean":"2024-04-26T12:30:33.613699+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:30:33.613699+0000","last_undegraded":"2024-04-26T12:30:33.613699+0000","last_fullsized":"2024-04-26T12:30:33.613699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640503+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:30:34.640503+0000","last_peered":"2024-04-26T12:30:34.640503+0000","last_clean":"2024-04-26T12:30:34.640503+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:30:34.640503+0000","last_undegraded":"2024-04-26T12:30:34.640503+0000","last_fullsized":"2024-04-26T12:30:34.640503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640234+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:30:34.640234+0000","last_peered":"2024-04-26T12:30:34.640234+0000","last_clean":"2024-04-26T12:30:34.640234+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:30:34.640234+0000","last_undegraded":"2024-04-26T12:30:34.640234+0000","last_fullsized":"2024-04-26T12:30:34.640234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614142+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:30:33.614142+0000","last_peered":"2024-04-26T12:30:33.614142+0000","last_clean":"2024-04-26T12:30:33.614142+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:30:33.614142+0000","last_undegraded":"2024-04-26T12:30:33.614142+0000","last_fullsized":"2024-04-26T12:30:33.614142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641363+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:30:34.641363+0000","last_peered":"2024-04-26T12:30:34.641363+0000","last_clean":"2024-04-26T12:30:34.641363+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:30:34.641363+0000","last_undegraded":"2024-04-26T12:30:34.641363+0000","last_fullsized":"2024-04-26T12:30:34.641363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640252+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:30:34.640252+0000","last_peered":"2024-04-26T12:30:34.640252+0000","last_clean":"2024-04-26T12:30:34.640252+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:30:34.640252+0000","last_undegraded":"2024-04-26T12:30:34.640252+0000","last_fullsized":"2024-04-26T12:30:34.640252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614092+0000","last_change":"2024-04-26T12:30:32.163546+0000","last_active":"2024-04-26T12:30:33.614092+0000","last_peered":"2024-04-26T12:30:33.614092+0000","last_clean":"2024-04-26T12:30:33.614092+0000","last_became_active":"2024-04-26T12:30:32.163231+0000","last_became_peered":"2024-04-26T12:30:32.163231+0000","last_unstale":"2024-04-26T12:30:33.614092+0000","last_undegraded":"2024-04-26T12:30:33.614092+0000","last_fullsized":"2024-04-26T12:30:33.614092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640548+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:30:34.640548+0000","last_peered":"2024-04-26T12:30:34.640548+0000","last_clean":"2024-04-26T12:30:34.640548+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:30:34.640548+0000","last_undegraded":"2024-04-26T12:30:34.640548+0000","last_fullsized":"2024-04-26T12:30:34.640548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640519+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:30:34.640519+0000","last_peered":"2024-04-26T12:30:34.640519+0000","last_clean":"2024-04-26T12:30:34.640519+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:30:34.640519+0000","last_undegraded":"2024-04-26T12:30:34.640519+0000","last_fullsized":"2024-04-26T12:30:34.640519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614299+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:30:33.614299+0000","last_peered":"2024-04-26T12:30:33.614299+0000","last_clean":"2024-04-26T12:30:33.614299+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:30:33.614299+0000","last_undegraded":"2024-04-26T12:30:33.614299+0000","last_fullsized":"2024-04-26T12:30:33.614299+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614095+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:30:33.614095+0000","last_peered":"2024-04-26T12:30:33.614095+0000","last_clean":"2024-04-26T12:30:33.614095+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:30:33.614095+0000","last_undegraded":"2024-04-26T12:30:33.614095+0000","last_fullsized":"2024-04-26T12:30:33.614095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613977+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:30:33.613977+0000","last_peered":"2024-04-26T12:30:33.613977+0000","last_clean":"2024-04-26T12:30:33.613977+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:30:33.613977+0000","last_undegraded":"2024-04-26T12:30:33.613977+0000","last_fullsized":"2024-04-26T12:30:33.613977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613519+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:30:33.613519+0000","last_peered":"2024-04-26T12:30:33.613519+0000","last_clean":"2024-04-26T12:30:33.613519+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:30:33.613519+0000","last_undegraded":"2024-04-26T12:30:33.613519+0000","last_fullsized":"2024-04-26T12:30:33.613519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640659+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:30:34.640659+0000","last_peered":"2024-04-26T12:30:34.640659+0000","last_clean":"2024-04-26T12:30:34.640659+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:30:34.640659+0000","last_undegraded":"2024-04-26T12:30:34.640659+0000","last_fullsized":"2024-04-26T12:30:34.640659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613920+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:30:33.613920+0000","last_peered":"2024-04-26T12:30:33.613920+0000","last_clean":"2024-04-26T12:30:33.613920+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:30:33.613920+0000","last_undegraded":"2024-04-26T12:30:33.613920+0000","last_fullsized":"2024-04-26T12:30:33.613920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613180+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:30:33.613180+0000","last_peered":"2024-04-26T12:30:33.613180+0000","last_clean":"2024-04-26T12:30:33.613180+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:30:33.613180+0000","last_undegraded":"2024-04-26T12:30:33.613180+0000","last_fullsized":"2024-04-26T12:30:33.613180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641338+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:30:34.641338+0000","last_peered":"2024-04-26T12:30:34.641338+0000","last_clean":"2024-04-26T12:30:34.641338+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:30:34.641338+0000","last_undegraded":"2024-04-26T12:30:34.641338+0000","last_fullsized":"2024-04-26T12:30:34.641338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613748+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:30:33.613748+0000","last_peered":"2024-04-26T12:30:33.613748+0000","last_clean":"2024-04-26T12:30:33.613748+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:30:33.613748+0000","last_undegraded":"2024-04-26T12:30:33.613748+0000","last_fullsized":"2024-04-26T12:30:33.613748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641478+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:30:34.641478+0000","last_peered":"2024-04-26T12:30:34.641478+0000","last_clean":"2024-04-26T12:30:34.641478+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:30:34.641478+0000","last_undegraded":"2024-04-26T12:30:34.641478+0000","last_fullsized":"2024-04-26T12:30:34.641478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614300+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:30:33.614300+0000","last_peered":"2024-04-26T12:30:33.614300+0000","last_clean":"2024-04-26T12:30:33.614300+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:30:33.614300+0000","last_undegraded":"2024-04-26T12:30:33.614300+0000","last_fullsized":"2024-04-26T12:30:33.614300+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613214+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:30:33.613214+0000","last_peered":"2024-04-26T12:30:33.613214+0000","last_clean":"2024-04-26T12:30:33.613214+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:30:33.613214+0000","last_undegraded":"2024-04-26T12:30:33.613214+0000","last_fullsized":"2024-04-26T12:30:33.613214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613464+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:30:33.613464+0000","last_peered":"2024-04-26T12:30:33.613464+0000","last_clean":"2024-04-26T12:30:33.613464+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:30:33.613464+0000","last_undegraded":"2024-04-26T12:30:33.613464+0000","last_fullsized":"2024-04-26T12:30:33.613464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614330+0000","last_change":"2024-04-26T12:30:32.159189+0000","last_active":"2024-04-26T12:30:33.614330+0000","last_peered":"2024-04-26T12:30:33.614330+0000","last_clean":"2024-04-26T12:30:33.614330+0000","last_became_active":"2024-04-26T12:30:32.158897+0000","last_became_peered":"2024-04-26T12:30:32.158897+0000","last_unstale":"2024-04-26T12:30:33.614330+0000","last_undegraded":"2024-04-26T12:30:33.614330+0000","last_fullsized":"2024-04-26T12:30:33.614330+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613885+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:30:33.613885+0000","last_peered":"2024-04-26T12:30:33.613885+0000","last_clean":"2024-04-26T12:30:33.613885+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:30:33.613885+0000","last_undegraded":"2024-04-26T12:30:33.613885+0000","last_fullsized":"2024-04-26T12:30:33.613885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640992+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:30:34.640992+0000","last_peered":"2024-04-26T12:30:34.640992+0000","last_clean":"2024-04-26T12:30:34.640992+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:30:34.640992+0000","last_undegraded":"2024-04-26T12:30:34.640992+0000","last_fullsized":"2024-04-26T12:30:34.640992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640809+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:30:34.640809+0000","last_peered":"2024-04-26T12:30:34.640809+0000","last_clean":"2024-04-26T12:30:34.640809+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:30:34.640809+0000","last_undegraded":"2024-04-26T12:30:34.640809+0000","last_fullsized":"2024-04-26T12:30:34.640809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614019+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:30:33.614019+0000","last_peered":"2024-04-26T12:30:33.614019+0000","last_clean":"2024-04-26T12:30:33.614019+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:30:33.614019+0000","last_undegraded":"2024-04-26T12:30:33.614019+0000","last_fullsized":"2024-04-26T12:30:33.614019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613501+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:30:33.613501+0000","last_peered":"2024-04-26T12:30:33.613501+0000","last_clean":"2024-04-26T12:30:33.613501+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:30:33.613501+0000","last_undegraded":"2024-04-26T12:30:33.613501+0000","last_fullsized":"2024-04-26T12:30:33.613501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614525+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:30:33.614525+0000","last_peered":"2024-04-26T12:30:33.614525+0000","last_clean":"2024-04-26T12:30:33.614525+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:30:33.614525+0000","last_undegraded":"2024-04-26T12:30:33.614525+0000","last_fullsized":"2024-04-26T12:30:33.614525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612940+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:30:33.612940+0000","last_peered":"2024-04-26T12:30:33.612940+0000","last_clean":"2024-04-26T12:30:33.612940+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:30:33.612940+0000","last_undegraded":"2024-04-26T12:30:33.612940+0000","last_fullsized":"2024-04-26T12:30:33.612940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614223+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:30:33.614223+0000","last_peered":"2024-04-26T12:30:33.614223+0000","last_clean":"2024-04-26T12:30:33.614223+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:30:33.614223+0000","last_undegraded":"2024-04-26T12:30:33.614223+0000","last_fullsized":"2024-04-26T12:30:33.614223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612992+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:30:33.612992+0000","last_peered":"2024-04-26T12:30:33.612992+0000","last_clean":"2024-04-26T12:30:33.612992+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:30:33.612992+0000","last_undegraded":"2024-04-26T12:30:33.612992+0000","last_fullsized":"2024-04-26T12:30:33.612992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641275+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:30:34.641275+0000","last_peered":"2024-04-26T12:30:34.641275+0000","last_clean":"2024-04-26T12:30:34.641275+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:30:34.641275+0000","last_undegraded":"2024-04-26T12:30:34.641275+0000","last_fullsized":"2024-04-26T12:30:34.641275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600450+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:30:32.600450+0000","last_peered":"2024-04-26T12:30:32.600450+0000","last_clean":"2024-04-26T12:30:32.600450+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:30:32.600450+0000","last_undegraded":"2024-04-26T12:30:32.600450+0000","last_fullsized":"2024-04-26T12:30:32.600450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614436+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:30:33.614436+0000","last_peered":"2024-04-26T12:30:33.614436+0000","last_clean":"2024-04-26T12:30:33.614436+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:30:33.614436+0000","last_undegraded":"2024-04-26T12:30:33.614436+0000","last_fullsized":"2024-04-26T12:30:33.614436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613294+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:30:33.613294+0000","last_peered":"2024-04-26T12:30:33.613294+0000","last_clean":"2024-04-26T12:30:33.613294+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:30:33.613294+0000","last_undegraded":"2024-04-26T12:30:33.613294+0000","last_fullsized":"2024-04-26T12:30:33.613294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607913+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:30:32.607913+0000","last_peered":"2024-04-26T12:30:32.607913+0000","last_clean":"2024-04-26T12:30:32.607913+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:30:32.607913+0000","last_undegraded":"2024-04-26T12:30:32.607913+0000","last_fullsized":"2024-04-26T12:30:32.607913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613849+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:30:33.613849+0000","last_peered":"2024-04-26T12:30:33.613849+0000","last_clean":"2024-04-26T12:30:33.613849+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:30:33.613849+0000","last_undegraded":"2024-04-26T12:30:33.613849+0000","last_fullsized":"2024-04-26T12:30:33.613849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641033+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:30:34.641033+0000","last_peered":"2024-04-26T12:30:34.641033+0000","last_clean":"2024-04-26T12:30:34.641033+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:30:34.641033+0000","last_undegraded":"2024-04-26T12:30:34.641033+0000","last_fullsized":"2024-04-26T12:30:34.641033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.599399+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:30:32.599399+0000","last_peered":"2024-04-26T12:30:32.599399+0000","last_clean":"2024-04-26T12:30:32.599399+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:30:32.599399+0000","last_undegraded":"2024-04-26T12:30:32.599399+0000","last_fullsized":"2024-04-26T12:30:32.599399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612917+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:30:33.612917+0000","last_peered":"2024-04-26T12:30:33.612917+0000","last_clean":"2024-04-26T12:30:33.612917+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:30:33.612917+0000","last_undegraded":"2024-04-26T12:30:33.612917+0000","last_fullsized":"2024-04-26T12:30:33.612917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641472+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:30:34.641472+0000","last_peered":"2024-04-26T12:30:34.641472+0000","last_clean":"2024-04-26T12:30:34.641472+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:30:34.641472+0000","last_undegraded":"2024-04-26T12:30:34.641472+0000","last_fullsized":"2024-04-26T12:30:34.641472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.610211+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:30:32.610211+0000","last_peered":"2024-04-26T12:30:32.610211+0000","last_clean":"2024-04-26T12:30:32.610211+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:30:32.610211+0000","last_undegraded":"2024-04-26T12:30:32.610211+0000","last_fullsized":"2024-04-26T12:30:32.610211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607337+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:30:32.607337+0000","last_peered":"2024-04-26T12:30:32.607337+0000","last_clean":"2024-04-26T12:30:32.607337+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:30:32.607337+0000","last_undegraded":"2024-04-26T12:30:32.607337+0000","last_fullsized":"2024-04-26T12:30:32.607337+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640452+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:30:34.640452+0000","last_peered":"2024-04-26T12:30:34.640452+0000","last_clean":"2024-04-26T12:30:34.640452+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:30:34.640452+0000","last_undegraded":"2024-04-26T12:30:34.640452+0000","last_fullsized":"2024-04-26T12:30:34.640452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614485+0000","last_change":"2024-04-26T12:30:32.620556+0000","last_active":"2024-04-26T12:30:33.614485+0000","last_peered":"2024-04-26T12:30:33.614485+0000","last_clean":"2024-04-26T12:30:33.614485+0000","last_became_active":"2024-04-26T12:30:32.620148+0000","last_became_peered":"2024-04-26T12:30:32.620148+0000","last_unstale":"2024-04-26T12:30:33.614485+0000","last_undegraded":"2024-04-26T12:30:33.614485+0000","last_fullsized":"2024-04-26T12:30:33.614485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607350+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:30:32.607350+0000","last_peered":"2024-04-26T12:30:32.607350+0000","last_clean":"2024-04-26T12:30:32.607350+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:30:32.607350+0000","last_undegraded":"2024-04-26T12:30:32.607350+0000","last_fullsized":"2024-04-26T12:30:32.607350+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640248+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:30:34.640248+0000","last_peered":"2024-04-26T12:30:34.640248+0000","last_clean":"2024-04-26T12:30:34.640248+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:30:34.640248+0000","last_undegraded":"2024-04-26T12:30:34.640248+0000","last_fullsized":"2024-04-26T12:30:34.640248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614007+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:30:33.614007+0000","last_peered":"2024-04-26T12:30:33.614007+0000","last_clean":"2024-04-26T12:30:33.614007+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:30:33.614007+0000","last_undegraded":"2024-04-26T12:30:33.614007+0000","last_fullsized":"2024-04-26T12:30:33.614007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.605563+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:30:32.605563+0000","last_peered":"2024-04-26T12:30:32.605563+0000","last_clean":"2024-04-26T12:30:32.605563+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:30:32.605563+0000","last_undegraded":"2024-04-26T12:30:32.605563+0000","last_fullsized":"2024-04-26T12:30:32.605563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640832+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:30:34.640832+0000","last_peered":"2024-04-26T12:30:34.640832+0000","last_clean":"2024-04-26T12:30:34.640832+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:30:34.640832+0000","last_undegraded":"2024-04-26T12:30:34.640832+0000","last_fullsized":"2024-04-26T12:30:34.640832+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613291+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:30:33.613291+0000","last_peered":"2024-04-26T12:30:33.613291+0000","last_clean":"2024-04-26T12:30:33.613291+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:30:33.613291+0000","last_undegraded":"2024-04-26T12:30:33.613291+0000","last_fullsized":"2024-04-26T12:30:33.613291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641247+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:30:34.641247+0000","last_peered":"2024-04-26T12:30:34.641247+0000","last_clean":"2024-04-26T12:30:34.641247+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:30:34.641247+0000","last_undegraded":"2024-04-26T12:30:34.641247+0000","last_fullsized":"2024-04-26T12:30:34.641247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600817+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:30:32.600817+0000","last_peered":"2024-04-26T12:30:32.600817+0000","last_clean":"2024-04-26T12:30:32.600817+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:30:32.600817+0000","last_undegraded":"2024-04-26T12:30:32.600817+0000","last_fullsized":"2024-04-26T12:30:32.600817+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640370+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:30:34.640370+0000","last_peered":"2024-04-26T12:30:34.640370+0000","last_clean":"2024-04-26T12:30:34.640370+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:30:34.640370+0000","last_undegraded":"2024-04-26T12:30:34.640370+0000","last_fullsized":"2024-04-26T12:30:34.640370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.608611+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:30:32.608611+0000","last_peered":"2024-04-26T12:30:32.608611+0000","last_clean":"2024-04-26T12:30:32.608611+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:30:32.608611+0000","last_undegraded":"2024-04-26T12:30:32.608611+0000","last_fullsized":"2024-04-26T12:30:32.608611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.995826+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:30:34.995826+0000","last_peered":"2024-04-26T12:30:34.995826+0000","last_clean":"2024-04-26T12:30:34.995826+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:30:34.995826+0000","last_undegraded":"2024-04-26T12:30:34.995826+0000","last_fullsized":"2024-04-26T12:30:34.995826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613310+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:30:33.613310+0000","last_peered":"2024-04-26T12:30:33.613310+0000","last_clean":"2024-04-26T12:30:33.613310+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:30:33.613310+0000","last_undegraded":"2024-04-26T12:30:33.613310+0000","last_fullsized":"2024-04-26T12:30:33.613310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613412+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:30:33.613412+0000","last_peered":"2024-04-26T12:30:33.613412+0000","last_clean":"2024-04-26T12:30:33.613412+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:30:33.613412+0000","last_undegraded":"2024-04-26T12:30:33.613412+0000","last_fullsized":"2024-04-26T12:30:33.613412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613632+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:30:33.613632+0000","last_peered":"2024-04-26T12:30:33.613632+0000","last_clean":"2024-04-26T12:30:33.613632+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:30:33.613632+0000","last_undegraded":"2024-04-26T12:30:33.613632+0000","last_fullsized":"2024-04-26T12:30:33.613632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614172+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:30:33.614172+0000","last_peered":"2024-04-26T12:30:33.614172+0000","last_clean":"2024-04-26T12:30:33.614172+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:30:33.614172+0000","last_undegraded":"2024-04-26T12:30:33.614172+0000","last_fullsized":"2024-04-26T12:30:33.614172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613790+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:30:33.613790+0000","last_peered":"2024-04-26T12:30:33.613790+0000","last_clean":"2024-04-26T12:30:33.613790+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:30:33.613790+0000","last_undegraded":"2024-04-26T12:30:33.613790+0000","last_fullsized":"2024-04-26T12:30:33.613790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613843+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:30:33.613843+0000","last_peered":"2024-04-26T12:30:33.613843+0000","last_clean":"2024-04-26T12:30:33.613843+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:30:33.613843+0000","last_undegraded":"2024-04-26T12:30:33.613843+0000","last_fullsized":"2024-04-26T12:30:33.613843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612884+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:30:33.612884+0000","last_peered":"2024-04-26T12:30:33.612884+0000","last_clean":"2024-04-26T12:30:33.612884+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:30:33.612884+0000","last_undegraded":"2024-04-26T12:30:33.612884+0000","last_fullsized":"2024-04-26T12:30:33.612884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641370+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:30:34.641370+0000","last_peered":"2024-04-26T12:30:34.641370+0000","last_clean":"2024-04-26T12:30:34.641370+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:30:34.641370+0000","last_undegraded":"2024-04-26T12:30:34.641370+0000","last_fullsized":"2024-04-26T12:30:34.641370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613737+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:30:33.613737+0000","last_peered":"2024-04-26T12:30:33.613737+0000","last_clean":"2024-04-26T12:30:33.613737+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:30:33.613737+0000","last_undegraded":"2024-04-26T12:30:33.613737+0000","last_fullsized":"2024-04-26T12:30:33.613737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613593+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:30:33.613593+0000","last_peered":"2024-04-26T12:30:33.613593+0000","last_clean":"2024-04-26T12:30:33.613593+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:30:33.613593+0000","last_undegraded":"2024-04-26T12:30:33.613593+0000","last_fullsized":"2024-04-26T12:30:33.613593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640266+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:30:34.640266+0000","last_peered":"2024-04-26T12:30:34.640266+0000","last_clean":"2024-04-26T12:30:34.640266+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:30:34.640266+0000","last_undegraded":"2024-04-26T12:30:34.640266+0000","last_fullsized":"2024-04-26T12:30:34.640266+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613341+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:30:33.613341+0000","last_peered":"2024-04-26T12:30:33.613341+0000","last_clean":"2024-04-26T12:30:33.613341+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:30:33.613341+0000","last_undegraded":"2024-04-26T12:30:33.613341+0000","last_fullsized":"2024-04-26T12:30:33.613341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640934+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:30:34.640934+0000","last_peered":"2024-04-26T12:30:34.640934+0000","last_clean":"2024-04-26T12:30:34.640934+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:30:34.640934+0000","last_undegraded":"2024-04-26T12:30:34.640934+0000","last_fullsized":"2024-04-26T12:30:34.640934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613671+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:30:33.613671+0000","last_peered":"2024-04-26T12:30:33.613671+0000","last_clean":"2024-04-26T12:30:33.613671+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:30:33.613671+0000","last_undegraded":"2024-04-26T12:30:33.613671+0000","last_fullsized":"2024-04-26T12:30:33.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":638777,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":135168,"data_stored":45552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":638161,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:41.479 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:30:41.479 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T12:30:41.479 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T12:30:41.479 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T12:30:41.928 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:41.928 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T12:30:41.946 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T12:30:41.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:42.313 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:42.313 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":15,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:33.595371+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:42.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:30:25.029168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:30:25.763407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:30:30.379996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:30:31.544710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:30:42.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:30:42.695 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-04-26T12:30:42.712 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:30:43.080 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2024-04-26T12:30:43.097 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:30:43.459 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-04-26T12:30:43.475 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:30:43.840 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2024-04-26T12:30:43.865 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:30:44.289 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:44.289 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:30:32.589261+0000","modified":"2024-04-26T12:30:35.618890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6803/1003606543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1003606543},{"type":"v1","addr":"172.21.15.38:6803","nonce":1003606543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:30:44.297 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2024-04-26T12:30:44.306 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:44.683 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:44.684 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":15,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:33.595371+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:44.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:30:25.029168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:30:25.763407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:30:30.379996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:30:31.544710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:30:44.700 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:30:45.075 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-04-26T12:30:45.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:30:45.460 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2024-04-26T12:30:45.476 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:30:45.841 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-04-26T12:30:45.856 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:30:46.223 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2024-04-26T12:30:46.239 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:30:46.651 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:46.652 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:30:32.589261+0000","modified":"2024-04-26T12:30:35.618890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6803/1003606543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1003606543},{"type":"v1","addr":"172.21.15.38:6803","nonce":1003606543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:30:46.654 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2024-04-26T12:30:46.668 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:47.039 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:47.039 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":15,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:30:33.595371+0000","last_up_change":"2024-04-26T12:30:24.744360+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:47.055 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:30:47.470 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:47.470 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:30:32.589261+0000","modified":"2024-04-26T12:30:35.618890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6803/1003606543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1003606543},{"type":"v1","addr":"172.21.15.38:6803","nonce":1003606543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:30:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2024-04-26T12:30:47.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T12:30:32.589261+0000', 'modified': '2024-04-26T12:30:35.618890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4190}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4190': {'gid': 4190, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.38:6803/1003606543', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6802', 'nonce': 1003606543}, {'type': 'v1', 'addr': '172.21.15.38:6803', 'nonce': 1003606543}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T12:30:47.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T12:30:47.587 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T12:30:47.749 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-26T12:30:47.749+0000 7f1fa17fa700 0 client.4456 ms_handle_reset on v2:172.21.15.38:6802/1003606543 2024-04-26T12:30:47.773 INFO:teuthology.orchestra.run.smithi038.stderr:2024-04-26T12:30:47.773+0000 7f1fa17fa700 0 client.4462 ms_handle_reset on v2:172.21.15.38:6802/1003606543 2024-04-26T12:30:47.774 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-26T12:30:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "64cc8c72-72d6-4335-8e3d-3304aaa6cad9", 2024-04-26T12:30:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2024-04-26T12:30:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4190, 2024-04-26T12:30:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2024-04-26T12:30:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2024-04-26T12:30:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2024-04-26T12:30:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 15.176020357000001, 2024-04-26T12:30:47.774 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 6, 2024-04-26T12:30:47.775 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 15, 2024-04-26T12:30:47.775 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 15, 2024-04-26T12:30:47.775 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 20.867865715000001 2024-04-26T12:30:47.775 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-26T12:30:47.788 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T12:30:47.798 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T12:30:47.798 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T12:30:47.798 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T12:30:47.798 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T12:30:47.798 DEBUG:teuthology.orchestra.run.smithi038:> sync 2024-04-26T12:30:47.926 DEBUG:teuthology.orchestra.run.smithi098:> sync 2024-04-26T12:30:47.989 DEBUG:teuthology.orchestra.run.smithi116:> sync 2024-04-26T12:30:48.071 DEBUG:teuthology.orchestra.run.smithi133:> sync 2024-04-26T12:30:48.185 DEBUG:tasks.thrashosds:checking console status of smithi038 2024-04-26T12:30:48.185 DEBUG:teuthology.orchestra.console.smithi038:Waiting for login prompt 2024-04-26T12:30:48.185 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi038 2024-04-26T12:30:48.360 DEBUG:teuthology.orchestra.console.smithi038:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:30:48.360 DEBUG:teuthology.orchestra.console.smithi038:expect after: smithi038 login: 2024-04-26T12:30:48.413 DEBUG:teuthology.orchestra.console.smithi038:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi038 login: [disconnect] 2024-04-26T12:30:48.513 DEBUG:tasks.thrashosds:checking console status of smithi098 2024-04-26T12:30:48.514 DEBUG:teuthology.orchestra.console.smithi098:Waiting for login prompt 2024-04-26T12:30:48.514 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi098 2024-04-26T12:30:48.659 DEBUG:teuthology.orchestra.console.smithi098:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:30:48.659 DEBUG:teuthology.orchestra.console.smithi098:expect after: smithi098 login: 2024-04-26T12:30:48.712 DEBUG:teuthology.orchestra.console.smithi098:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi098 login: [disconnect] 2024-04-26T12:30:48.812 DEBUG:tasks.thrashosds:checking console status of smithi116 2024-04-26T12:30:48.812 DEBUG:teuthology.orchestra.console.smithi116:Waiting for login prompt 2024-04-26T12:30:48.813 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi116 2024-04-26T12:30:48.949 DEBUG:teuthology.orchestra.console.smithi116:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:30:48.949 DEBUG:teuthology.orchestra.console.smithi116:expect after: smithi116 login: 2024-04-26T12:30:49.001 DEBUG:teuthology.orchestra.console.smithi116:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi116 login: [disconnect] 2024-04-26T12:30:49.101 DEBUG:tasks.thrashosds:checking console status of smithi133 2024-04-26T12:30:49.102 DEBUG:teuthology.orchestra.console.smithi133:Waiting for login prompt 2024-04-26T12:30:49.102 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi133 2024-04-26T12:30:49.199 DEBUG:teuthology.orchestra.console.smithi133:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:30:49.199 DEBUG:teuthology.orchestra.console.smithi133:expect after: smithi133 login: 2024-04-26T12:30:49.251 DEBUG:teuthology.orchestra.console.smithi133:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi133 login: [disconnect] 2024-04-26T12:30:49.352 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T12:30:49.764 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T12:30:49.764 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:30:49.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:50.136 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:50.139 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:30:50.149 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T12:30:48.972322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81640,"kb_used_data":556,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033880,"statfs":{"total":289910292480,"available":289826693120,"internally_reserved":0,"allocated":569344,"data_stored":1322490,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002593"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613749+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:30:33.613749+0000","last_peered":"2024-04-26T12:30:33.613749+0000","last_clean":"2024-04-26T12:30:33.613749+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:30:33.613749+0000","last_undegraded":"2024-04-26T12:30:33.613749+0000","last_fullsized":"2024-04-26T12:30:33.613749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613688+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:30:33.613688+0000","last_peered":"2024-04-26T12:30:33.613688+0000","last_clean":"2024-04-26T12:30:33.613688+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:30:33.613688+0000","last_undegraded":"2024-04-26T12:30:33.613688+0000","last_fullsized":"2024-04-26T12:30:33.613688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614359+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:30:33.614359+0000","last_peered":"2024-04-26T12:30:33.614359+0000","last_clean":"2024-04-26T12:30:33.614359+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:30:33.614359+0000","last_undegraded":"2024-04-26T12:30:33.614359+0000","last_fullsized":"2024-04-26T12:30:33.614359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614425+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:30:33.614425+0000","last_peered":"2024-04-26T12:30:33.614425+0000","last_clean":"2024-04-26T12:30:33.614425+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:30:33.614425+0000","last_undegraded":"2024-04-26T12:30:33.614425+0000","last_fullsized":"2024-04-26T12:30:33.614425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613283+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:30:33.613283+0000","last_peered":"2024-04-26T12:30:33.613283+0000","last_clean":"2024-04-26T12:30:33.613283+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:30:33.613283+0000","last_undegraded":"2024-04-26T12:30:33.613283+0000","last_fullsized":"2024-04-26T12:30:33.613283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613479+0000","last_change":"2024-04-26T12:30:32.614596+0000","last_active":"2024-04-26T12:30:33.613479+0000","last_peered":"2024-04-26T12:30:33.613479+0000","last_clean":"2024-04-26T12:30:33.613479+0000","last_became_active":"2024-04-26T12:30:32.613418+0000","last_became_peered":"2024-04-26T12:30:32.613418+0000","last_unstale":"2024-04-26T12:30:33.613479+0000","last_undegraded":"2024-04-26T12:30:33.613479+0000","last_fullsized":"2024-04-26T12:30:33.613479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:32.926352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613744+0000","last_change":"2024-04-26T12:30:32.614280+0000","last_active":"2024-04-26T12:30:33.613744+0000","last_peered":"2024-04-26T12:30:33.613744+0000","last_clean":"2024-04-26T12:30:33.613744+0000","last_became_active":"2024-04-26T12:30:32.613382+0000","last_became_peered":"2024-04-26T12:30:32.613382+0000","last_unstale":"2024-04-26T12:30:33.613744+0000","last_undegraded":"2024-04-26T12:30:33.613744+0000","last_fullsized":"2024-04-26T12:30:33.613744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613306+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:30:33.613306+0000","last_peered":"2024-04-26T12:30:33.613306+0000","last_clean":"2024-04-26T12:30:33.613306+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:30:33.613306+0000","last_undegraded":"2024-04-26T12:30:33.613306+0000","last_fullsized":"2024-04-26T12:30:33.613306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641132+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:30:34.641132+0000","last_peered":"2024-04-26T12:30:34.641132+0000","last_clean":"2024-04-26T12:30:34.641132+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:30:34.641132+0000","last_undegraded":"2024-04-26T12:30:34.641132+0000","last_fullsized":"2024-04-26T12:30:34.641132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613769+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:30:33.613769+0000","last_peered":"2024-04-26T12:30:33.613769+0000","last_clean":"2024-04-26T12:30:33.613769+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:30:33.613769+0000","last_undegraded":"2024-04-26T12:30:33.613769+0000","last_fullsized":"2024-04-26T12:30:33.613769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614206+0000","last_change":"2024-04-26T12:30:32.616474+0000","last_active":"2024-04-26T12:30:33.614206+0000","last_peered":"2024-04-26T12:30:33.614206+0000","last_clean":"2024-04-26T12:30:33.614206+0000","last_became_active":"2024-04-26T12:30:32.615780+0000","last_became_peered":"2024-04-26T12:30:32.615780+0000","last_unstale":"2024-04-26T12:30:33.614206+0000","last_undegraded":"2024-04-26T12:30:33.614206+0000","last_fullsized":"2024-04-26T12:30:33.614206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.298182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613314+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:30:33.613314+0000","last_peered":"2024-04-26T12:30:33.613314+0000","last_clean":"2024-04-26T12:30:33.613314+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:30:33.613314+0000","last_undegraded":"2024-04-26T12:30:33.613314+0000","last_fullsized":"2024-04-26T12:30:33.613314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613096+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:30:33.613096+0000","last_peered":"2024-04-26T12:30:33.613096+0000","last_clean":"2024-04-26T12:30:33.613096+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:30:33.613096+0000","last_undegraded":"2024-04-26T12:30:33.613096+0000","last_fullsized":"2024-04-26T12:30:33.613096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613926+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:30:33.613926+0000","last_peered":"2024-04-26T12:30:33.613926+0000","last_clean":"2024-04-26T12:30:33.613926+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:30:33.613926+0000","last_undegraded":"2024-04-26T12:30:33.613926+0000","last_fullsized":"2024-04-26T12:30:33.613926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613728+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:30:33.613728+0000","last_peered":"2024-04-26T12:30:33.613728+0000","last_clean":"2024-04-26T12:30:33.613728+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:30:33.613728+0000","last_undegraded":"2024-04-26T12:30:33.613728+0000","last_fullsized":"2024-04-26T12:30:33.613728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613416+0000","last_change":"2024-04-26T12:30:32.619340+0000","last_active":"2024-04-26T12:30:33.613416+0000","last_peered":"2024-04-26T12:30:33.613416+0000","last_clean":"2024-04-26T12:30:33.613416+0000","last_became_active":"2024-04-26T12:30:32.616781+0000","last_became_peered":"2024-04-26T12:30:32.616781+0000","last_unstale":"2024-04-26T12:30:33.613416+0000","last_undegraded":"2024-04-26T12:30:33.613416+0000","last_fullsized":"2024-04-26T12:30:33.613416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:30.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641153+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:30:34.641153+0000","last_peered":"2024-04-26T12:30:34.641153+0000","last_clean":"2024-04-26T12:30:34.641153+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:30:34.641153+0000","last_undegraded":"2024-04-26T12:30:34.641153+0000","last_fullsized":"2024-04-26T12:30:34.641153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614070+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:30:33.614070+0000","last_peered":"2024-04-26T12:30:33.614070+0000","last_clean":"2024-04-26T12:30:33.614070+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:30:33.614070+0000","last_undegraded":"2024-04-26T12:30:33.614070+0000","last_fullsized":"2024-04-26T12:30:33.614070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641094+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:30:34.641094+0000","last_peered":"2024-04-26T12:30:34.641094+0000","last_clean":"2024-04-26T12:30:34.641094+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:30:34.641094+0000","last_undegraded":"2024-04-26T12:30:34.641094+0000","last_fullsized":"2024-04-26T12:30:34.641094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614333+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:30:33.614333+0000","last_peered":"2024-04-26T12:30:33.614333+0000","last_clean":"2024-04-26T12:30:33.614333+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:30:33.614333+0000","last_undegraded":"2024-04-26T12:30:33.614333+0000","last_fullsized":"2024-04-26T12:30:33.614333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613733+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:30:33.613733+0000","last_peered":"2024-04-26T12:30:33.613733+0000","last_clean":"2024-04-26T12:30:33.613733+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:30:33.613733+0000","last_undegraded":"2024-04-26T12:30:33.613733+0000","last_fullsized":"2024-04-26T12:30:33.613733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613025+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:30:33.613025+0000","last_peered":"2024-04-26T12:30:33.613025+0000","last_clean":"2024-04-26T12:30:33.613025+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:30:33.613025+0000","last_undegraded":"2024-04-26T12:30:33.613025+0000","last_fullsized":"2024-04-26T12:30:33.613025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640404+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:30:34.640404+0000","last_peered":"2024-04-26T12:30:34.640404+0000","last_clean":"2024-04-26T12:30:34.640404+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:30:34.640404+0000","last_undegraded":"2024-04-26T12:30:34.640404+0000","last_fullsized":"2024-04-26T12:30:34.640404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613088+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:30:33.613088+0000","last_peered":"2024-04-26T12:30:33.613088+0000","last_clean":"2024-04-26T12:30:33.613088+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:30:33.613088+0000","last_undegraded":"2024-04-26T12:30:33.613088+0000","last_fullsized":"2024-04-26T12:30:33.613088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613910+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:30:33.613910+0000","last_peered":"2024-04-26T12:30:33.613910+0000","last_clean":"2024-04-26T12:30:33.613910+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:30:33.613910+0000","last_undegraded":"2024-04-26T12:30:33.613910+0000","last_fullsized":"2024-04-26T12:30:33.613910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641161+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:30:34.641161+0000","last_peered":"2024-04-26T12:30:34.641161+0000","last_clean":"2024-04-26T12:30:34.641161+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:30:34.641161+0000","last_undegraded":"2024-04-26T12:30:34.641161+0000","last_fullsized":"2024-04-26T12:30:34.641161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614220+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:30:33.614220+0000","last_peered":"2024-04-26T12:30:33.614220+0000","last_clean":"2024-04-26T12:30:33.614220+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:30:33.614220+0000","last_undegraded":"2024-04-26T12:30:33.614220+0000","last_fullsized":"2024-04-26T12:30:33.614220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613168+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:30:33.613168+0000","last_peered":"2024-04-26T12:30:33.613168+0000","last_clean":"2024-04-26T12:30:33.613168+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:33.613168+0000","last_undegraded":"2024-04-26T12:30:33.613168+0000","last_fullsized":"2024-04-26T12:30:33.613168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613699+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:30:33.613699+0000","last_peered":"2024-04-26T12:30:33.613699+0000","last_clean":"2024-04-26T12:30:33.613699+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:30:33.613699+0000","last_undegraded":"2024-04-26T12:30:33.613699+0000","last_fullsized":"2024-04-26T12:30:33.613699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640503+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:30:34.640503+0000","last_peered":"2024-04-26T12:30:34.640503+0000","last_clean":"2024-04-26T12:30:34.640503+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:30:34.640503+0000","last_undegraded":"2024-04-26T12:30:34.640503+0000","last_fullsized":"2024-04-26T12:30:34.640503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640234+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:30:34.640234+0000","last_peered":"2024-04-26T12:30:34.640234+0000","last_clean":"2024-04-26T12:30:34.640234+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:30:34.640234+0000","last_undegraded":"2024-04-26T12:30:34.640234+0000","last_fullsized":"2024-04-26T12:30:34.640234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614142+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:30:33.614142+0000","last_peered":"2024-04-26T12:30:33.614142+0000","last_clean":"2024-04-26T12:30:33.614142+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:30:33.614142+0000","last_undegraded":"2024-04-26T12:30:33.614142+0000","last_fullsized":"2024-04-26T12:30:33.614142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641363+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:30:34.641363+0000","last_peered":"2024-04-26T12:30:34.641363+0000","last_clean":"2024-04-26T12:30:34.641363+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:30:34.641363+0000","last_undegraded":"2024-04-26T12:30:34.641363+0000","last_fullsized":"2024-04-26T12:30:34.641363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640252+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:30:34.640252+0000","last_peered":"2024-04-26T12:30:34.640252+0000","last_clean":"2024-04-26T12:30:34.640252+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:30:34.640252+0000","last_undegraded":"2024-04-26T12:30:34.640252+0000","last_fullsized":"2024-04-26T12:30:34.640252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614092+0000","last_change":"2024-04-26T12:30:32.163546+0000","last_active":"2024-04-26T12:30:33.614092+0000","last_peered":"2024-04-26T12:30:33.614092+0000","last_clean":"2024-04-26T12:30:33.614092+0000","last_became_active":"2024-04-26T12:30:32.163231+0000","last_became_peered":"2024-04-26T12:30:32.163231+0000","last_unstale":"2024-04-26T12:30:33.614092+0000","last_undegraded":"2024-04-26T12:30:33.614092+0000","last_fullsized":"2024-04-26T12:30:33.614092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640548+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:30:34.640548+0000","last_peered":"2024-04-26T12:30:34.640548+0000","last_clean":"2024-04-26T12:30:34.640548+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:30:34.640548+0000","last_undegraded":"2024-04-26T12:30:34.640548+0000","last_fullsized":"2024-04-26T12:30:34.640548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640519+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:30:34.640519+0000","last_peered":"2024-04-26T12:30:34.640519+0000","last_clean":"2024-04-26T12:30:34.640519+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:30:34.640519+0000","last_undegraded":"2024-04-26T12:30:34.640519+0000","last_fullsized":"2024-04-26T12:30:34.640519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614299+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:30:33.614299+0000","last_peered":"2024-04-26T12:30:33.614299+0000","last_clean":"2024-04-26T12:30:33.614299+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:30:33.614299+0000","last_undegraded":"2024-04-26T12:30:33.614299+0000","last_fullsized":"2024-04-26T12:30:33.614299+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614095+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:30:33.614095+0000","last_peered":"2024-04-26T12:30:33.614095+0000","last_clean":"2024-04-26T12:30:33.614095+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:30:33.614095+0000","last_undegraded":"2024-04-26T12:30:33.614095+0000","last_fullsized":"2024-04-26T12:30:33.614095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613977+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:30:33.613977+0000","last_peered":"2024-04-26T12:30:33.613977+0000","last_clean":"2024-04-26T12:30:33.613977+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:30:33.613977+0000","last_undegraded":"2024-04-26T12:30:33.613977+0000","last_fullsized":"2024-04-26T12:30:33.613977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613519+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:30:33.613519+0000","last_peered":"2024-04-26T12:30:33.613519+0000","last_clean":"2024-04-26T12:30:33.613519+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:30:33.613519+0000","last_undegraded":"2024-04-26T12:30:33.613519+0000","last_fullsized":"2024-04-26T12:30:33.613519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640659+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:30:34.640659+0000","last_peered":"2024-04-26T12:30:34.640659+0000","last_clean":"2024-04-26T12:30:34.640659+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:30:34.640659+0000","last_undegraded":"2024-04-26T12:30:34.640659+0000","last_fullsized":"2024-04-26T12:30:34.640659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613920+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:30:33.613920+0000","last_peered":"2024-04-26T12:30:33.613920+0000","last_clean":"2024-04-26T12:30:33.613920+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:30:33.613920+0000","last_undegraded":"2024-04-26T12:30:33.613920+0000","last_fullsized":"2024-04-26T12:30:33.613920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613180+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:30:33.613180+0000","last_peered":"2024-04-26T12:30:33.613180+0000","last_clean":"2024-04-26T12:30:33.613180+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:30:33.613180+0000","last_undegraded":"2024-04-26T12:30:33.613180+0000","last_fullsized":"2024-04-26T12:30:33.613180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641338+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:30:34.641338+0000","last_peered":"2024-04-26T12:30:34.641338+0000","last_clean":"2024-04-26T12:30:34.641338+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:30:34.641338+0000","last_undegraded":"2024-04-26T12:30:34.641338+0000","last_fullsized":"2024-04-26T12:30:34.641338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613748+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:30:33.613748+0000","last_peered":"2024-04-26T12:30:33.613748+0000","last_clean":"2024-04-26T12:30:33.613748+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:30:33.613748+0000","last_undegraded":"2024-04-26T12:30:33.613748+0000","last_fullsized":"2024-04-26T12:30:33.613748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641478+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:30:34.641478+0000","last_peered":"2024-04-26T12:30:34.641478+0000","last_clean":"2024-04-26T12:30:34.641478+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:30:34.641478+0000","last_undegraded":"2024-04-26T12:30:34.641478+0000","last_fullsized":"2024-04-26T12:30:34.641478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614300+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:30:33.614300+0000","last_peered":"2024-04-26T12:30:33.614300+0000","last_clean":"2024-04-26T12:30:33.614300+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:30:33.614300+0000","last_undegraded":"2024-04-26T12:30:33.614300+0000","last_fullsized":"2024-04-26T12:30:33.614300+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613214+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:30:33.613214+0000","last_peered":"2024-04-26T12:30:33.613214+0000","last_clean":"2024-04-26T12:30:33.613214+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:30:33.613214+0000","last_undegraded":"2024-04-26T12:30:33.613214+0000","last_fullsized":"2024-04-26T12:30:33.613214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613464+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:30:33.613464+0000","last_peered":"2024-04-26T12:30:33.613464+0000","last_clean":"2024-04-26T12:30:33.613464+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:30:33.613464+0000","last_undegraded":"2024-04-26T12:30:33.613464+0000","last_fullsized":"2024-04-26T12:30:33.613464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614330+0000","last_change":"2024-04-26T12:30:32.159189+0000","last_active":"2024-04-26T12:30:33.614330+0000","last_peered":"2024-04-26T12:30:33.614330+0000","last_clean":"2024-04-26T12:30:33.614330+0000","last_became_active":"2024-04-26T12:30:32.158897+0000","last_became_peered":"2024-04-26T12:30:32.158897+0000","last_unstale":"2024-04-26T12:30:33.614330+0000","last_undegraded":"2024-04-26T12:30:33.614330+0000","last_fullsized":"2024-04-26T12:30:33.614330+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613885+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:30:33.613885+0000","last_peered":"2024-04-26T12:30:33.613885+0000","last_clean":"2024-04-26T12:30:33.613885+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:30:33.613885+0000","last_undegraded":"2024-04-26T12:30:33.613885+0000","last_fullsized":"2024-04-26T12:30:33.613885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640992+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:30:34.640992+0000","last_peered":"2024-04-26T12:30:34.640992+0000","last_clean":"2024-04-26T12:30:34.640992+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:30:34.640992+0000","last_undegraded":"2024-04-26T12:30:34.640992+0000","last_fullsized":"2024-04-26T12:30:34.640992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640809+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:30:34.640809+0000","last_peered":"2024-04-26T12:30:34.640809+0000","last_clean":"2024-04-26T12:30:34.640809+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:30:34.640809+0000","last_undegraded":"2024-04-26T12:30:34.640809+0000","last_fullsized":"2024-04-26T12:30:34.640809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614019+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:30:33.614019+0000","last_peered":"2024-04-26T12:30:33.614019+0000","last_clean":"2024-04-26T12:30:33.614019+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:30:33.614019+0000","last_undegraded":"2024-04-26T12:30:33.614019+0000","last_fullsized":"2024-04-26T12:30:33.614019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613501+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:30:33.613501+0000","last_peered":"2024-04-26T12:30:33.613501+0000","last_clean":"2024-04-26T12:30:33.613501+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:30:33.613501+0000","last_undegraded":"2024-04-26T12:30:33.613501+0000","last_fullsized":"2024-04-26T12:30:33.613501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614525+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:30:33.614525+0000","last_peered":"2024-04-26T12:30:33.614525+0000","last_clean":"2024-04-26T12:30:33.614525+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:30:33.614525+0000","last_undegraded":"2024-04-26T12:30:33.614525+0000","last_fullsized":"2024-04-26T12:30:33.614525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612940+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:30:33.612940+0000","last_peered":"2024-04-26T12:30:33.612940+0000","last_clean":"2024-04-26T12:30:33.612940+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:30:33.612940+0000","last_undegraded":"2024-04-26T12:30:33.612940+0000","last_fullsized":"2024-04-26T12:30:33.612940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614223+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:30:33.614223+0000","last_peered":"2024-04-26T12:30:33.614223+0000","last_clean":"2024-04-26T12:30:33.614223+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:30:33.614223+0000","last_undegraded":"2024-04-26T12:30:33.614223+0000","last_fullsized":"2024-04-26T12:30:33.614223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612992+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:30:33.612992+0000","last_peered":"2024-04-26T12:30:33.612992+0000","last_clean":"2024-04-26T12:30:33.612992+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:30:33.612992+0000","last_undegraded":"2024-04-26T12:30:33.612992+0000","last_fullsized":"2024-04-26T12:30:33.612992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641275+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:30:34.641275+0000","last_peered":"2024-04-26T12:30:34.641275+0000","last_clean":"2024-04-26T12:30:34.641275+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:30:34.641275+0000","last_undegraded":"2024-04-26T12:30:34.641275+0000","last_fullsized":"2024-04-26T12:30:34.641275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600450+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:30:32.600450+0000","last_peered":"2024-04-26T12:30:32.600450+0000","last_clean":"2024-04-26T12:30:32.600450+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:30:32.600450+0000","last_undegraded":"2024-04-26T12:30:32.600450+0000","last_fullsized":"2024-04-26T12:30:32.600450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614436+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:30:33.614436+0000","last_peered":"2024-04-26T12:30:33.614436+0000","last_clean":"2024-04-26T12:30:33.614436+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:30:33.614436+0000","last_undegraded":"2024-04-26T12:30:33.614436+0000","last_fullsized":"2024-04-26T12:30:33.614436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613294+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:30:33.613294+0000","last_peered":"2024-04-26T12:30:33.613294+0000","last_clean":"2024-04-26T12:30:33.613294+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:30:33.613294+0000","last_undegraded":"2024-04-26T12:30:33.613294+0000","last_fullsized":"2024-04-26T12:30:33.613294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607913+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:30:32.607913+0000","last_peered":"2024-04-26T12:30:32.607913+0000","last_clean":"2024-04-26T12:30:32.607913+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:30:32.607913+0000","last_undegraded":"2024-04-26T12:30:32.607913+0000","last_fullsized":"2024-04-26T12:30:32.607913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613849+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:30:33.613849+0000","last_peered":"2024-04-26T12:30:33.613849+0000","last_clean":"2024-04-26T12:30:33.613849+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:30:33.613849+0000","last_undegraded":"2024-04-26T12:30:33.613849+0000","last_fullsized":"2024-04-26T12:30:33.613849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641033+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:30:34.641033+0000","last_peered":"2024-04-26T12:30:34.641033+0000","last_clean":"2024-04-26T12:30:34.641033+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:30:34.641033+0000","last_undegraded":"2024-04-26T12:30:34.641033+0000","last_fullsized":"2024-04-26T12:30:34.641033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.599399+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:30:32.599399+0000","last_peered":"2024-04-26T12:30:32.599399+0000","last_clean":"2024-04-26T12:30:32.599399+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:30:32.599399+0000","last_undegraded":"2024-04-26T12:30:32.599399+0000","last_fullsized":"2024-04-26T12:30:32.599399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612917+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:30:33.612917+0000","last_peered":"2024-04-26T12:30:33.612917+0000","last_clean":"2024-04-26T12:30:33.612917+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:30:33.612917+0000","last_undegraded":"2024-04-26T12:30:33.612917+0000","last_fullsized":"2024-04-26T12:30:33.612917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641472+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:30:34.641472+0000","last_peered":"2024-04-26T12:30:34.641472+0000","last_clean":"2024-04-26T12:30:34.641472+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:30:34.641472+0000","last_undegraded":"2024-04-26T12:30:34.641472+0000","last_fullsized":"2024-04-26T12:30:34.641472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.610211+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:30:32.610211+0000","last_peered":"2024-04-26T12:30:32.610211+0000","last_clean":"2024-04-26T12:30:32.610211+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:30:32.610211+0000","last_undegraded":"2024-04-26T12:30:32.610211+0000","last_fullsized":"2024-04-26T12:30:32.610211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607337+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:30:32.607337+0000","last_peered":"2024-04-26T12:30:32.607337+0000","last_clean":"2024-04-26T12:30:32.607337+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:30:32.607337+0000","last_undegraded":"2024-04-26T12:30:32.607337+0000","last_fullsized":"2024-04-26T12:30:32.607337+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640452+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:30:34.640452+0000","last_peered":"2024-04-26T12:30:34.640452+0000","last_clean":"2024-04-26T12:30:34.640452+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:30:34.640452+0000","last_undegraded":"2024-04-26T12:30:34.640452+0000","last_fullsized":"2024-04-26T12:30:34.640452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614485+0000","last_change":"2024-04-26T12:30:32.620556+0000","last_active":"2024-04-26T12:30:33.614485+0000","last_peered":"2024-04-26T12:30:33.614485+0000","last_clean":"2024-04-26T12:30:33.614485+0000","last_became_active":"2024-04-26T12:30:32.620148+0000","last_became_peered":"2024-04-26T12:30:32.620148+0000","last_unstale":"2024-04-26T12:30:33.614485+0000","last_undegraded":"2024-04-26T12:30:33.614485+0000","last_fullsized":"2024-04-26T12:30:33.614485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607350+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:30:32.607350+0000","last_peered":"2024-04-26T12:30:32.607350+0000","last_clean":"2024-04-26T12:30:32.607350+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:30:32.607350+0000","last_undegraded":"2024-04-26T12:30:32.607350+0000","last_fullsized":"2024-04-26T12:30:32.607350+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640248+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:30:34.640248+0000","last_peered":"2024-04-26T12:30:34.640248+0000","last_clean":"2024-04-26T12:30:34.640248+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:30:34.640248+0000","last_undegraded":"2024-04-26T12:30:34.640248+0000","last_fullsized":"2024-04-26T12:30:34.640248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614007+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:30:33.614007+0000","last_peered":"2024-04-26T12:30:33.614007+0000","last_clean":"2024-04-26T12:30:33.614007+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:30:33.614007+0000","last_undegraded":"2024-04-26T12:30:33.614007+0000","last_fullsized":"2024-04-26T12:30:33.614007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.605563+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:30:32.605563+0000","last_peered":"2024-04-26T12:30:32.605563+0000","last_clean":"2024-04-26T12:30:32.605563+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:30:32.605563+0000","last_undegraded":"2024-04-26T12:30:32.605563+0000","last_fullsized":"2024-04-26T12:30:32.605563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640832+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:30:34.640832+0000","last_peered":"2024-04-26T12:30:34.640832+0000","last_clean":"2024-04-26T12:30:34.640832+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:30:34.640832+0000","last_undegraded":"2024-04-26T12:30:34.640832+0000","last_fullsized":"2024-04-26T12:30:34.640832+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613291+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:30:33.613291+0000","last_peered":"2024-04-26T12:30:33.613291+0000","last_clean":"2024-04-26T12:30:33.613291+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:30:33.613291+0000","last_undegraded":"2024-04-26T12:30:33.613291+0000","last_fullsized":"2024-04-26T12:30:33.613291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641247+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:30:34.641247+0000","last_peered":"2024-04-26T12:30:34.641247+0000","last_clean":"2024-04-26T12:30:34.641247+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:30:34.641247+0000","last_undegraded":"2024-04-26T12:30:34.641247+0000","last_fullsized":"2024-04-26T12:30:34.641247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600817+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:30:32.600817+0000","last_peered":"2024-04-26T12:30:32.600817+0000","last_clean":"2024-04-26T12:30:32.600817+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:30:32.600817+0000","last_undegraded":"2024-04-26T12:30:32.600817+0000","last_fullsized":"2024-04-26T12:30:32.600817+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640370+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:30:34.640370+0000","last_peered":"2024-04-26T12:30:34.640370+0000","last_clean":"2024-04-26T12:30:34.640370+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:30:34.640370+0000","last_undegraded":"2024-04-26T12:30:34.640370+0000","last_fullsized":"2024-04-26T12:30:34.640370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.608611+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:30:32.608611+0000","last_peered":"2024-04-26T12:30:32.608611+0000","last_clean":"2024-04-26T12:30:32.608611+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:30:32.608611+0000","last_undegraded":"2024-04-26T12:30:32.608611+0000","last_fullsized":"2024-04-26T12:30:32.608611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.995826+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:30:34.995826+0000","last_peered":"2024-04-26T12:30:34.995826+0000","last_clean":"2024-04-26T12:30:34.995826+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:30:34.995826+0000","last_undegraded":"2024-04-26T12:30:34.995826+0000","last_fullsized":"2024-04-26T12:30:34.995826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613310+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:30:33.613310+0000","last_peered":"2024-04-26T12:30:33.613310+0000","last_clean":"2024-04-26T12:30:33.613310+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:30:33.613310+0000","last_undegraded":"2024-04-26T12:30:33.613310+0000","last_fullsized":"2024-04-26T12:30:33.613310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613412+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:30:33.613412+0000","last_peered":"2024-04-26T12:30:33.613412+0000","last_clean":"2024-04-26T12:30:33.613412+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:30:33.613412+0000","last_undegraded":"2024-04-26T12:30:33.613412+0000","last_fullsized":"2024-04-26T12:30:33.613412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613632+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:30:33.613632+0000","last_peered":"2024-04-26T12:30:33.613632+0000","last_clean":"2024-04-26T12:30:33.613632+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:30:33.613632+0000","last_undegraded":"2024-04-26T12:30:33.613632+0000","last_fullsized":"2024-04-26T12:30:33.613632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614172+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:30:33.614172+0000","last_peered":"2024-04-26T12:30:33.614172+0000","last_clean":"2024-04-26T12:30:33.614172+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:30:33.614172+0000","last_undegraded":"2024-04-26T12:30:33.614172+0000","last_fullsized":"2024-04-26T12:30:33.614172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613790+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:30:33.613790+0000","last_peered":"2024-04-26T12:30:33.613790+0000","last_clean":"2024-04-26T12:30:33.613790+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:30:33.613790+0000","last_undegraded":"2024-04-26T12:30:33.613790+0000","last_fullsized":"2024-04-26T12:30:33.613790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613843+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:30:33.613843+0000","last_peered":"2024-04-26T12:30:33.613843+0000","last_clean":"2024-04-26T12:30:33.613843+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:30:33.613843+0000","last_undegraded":"2024-04-26T12:30:33.613843+0000","last_fullsized":"2024-04-26T12:30:33.613843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612884+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:30:33.612884+0000","last_peered":"2024-04-26T12:30:33.612884+0000","last_clean":"2024-04-26T12:30:33.612884+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:30:33.612884+0000","last_undegraded":"2024-04-26T12:30:33.612884+0000","last_fullsized":"2024-04-26T12:30:33.612884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641370+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:30:34.641370+0000","last_peered":"2024-04-26T12:30:34.641370+0000","last_clean":"2024-04-26T12:30:34.641370+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:30:34.641370+0000","last_undegraded":"2024-04-26T12:30:34.641370+0000","last_fullsized":"2024-04-26T12:30:34.641370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613737+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:30:33.613737+0000","last_peered":"2024-04-26T12:30:33.613737+0000","last_clean":"2024-04-26T12:30:33.613737+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:30:33.613737+0000","last_undegraded":"2024-04-26T12:30:33.613737+0000","last_fullsized":"2024-04-26T12:30:33.613737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613593+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:30:33.613593+0000","last_peered":"2024-04-26T12:30:33.613593+0000","last_clean":"2024-04-26T12:30:33.613593+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:30:33.613593+0000","last_undegraded":"2024-04-26T12:30:33.613593+0000","last_fullsized":"2024-04-26T12:30:33.613593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640266+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:30:34.640266+0000","last_peered":"2024-04-26T12:30:34.640266+0000","last_clean":"2024-04-26T12:30:34.640266+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:30:34.640266+0000","last_undegraded":"2024-04-26T12:30:34.640266+0000","last_fullsized":"2024-04-26T12:30:34.640266+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613341+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:30:33.613341+0000","last_peered":"2024-04-26T12:30:33.613341+0000","last_clean":"2024-04-26T12:30:33.613341+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:30:33.613341+0000","last_undegraded":"2024-04-26T12:30:33.613341+0000","last_fullsized":"2024-04-26T12:30:33.613341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640934+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:30:34.640934+0000","last_peered":"2024-04-26T12:30:34.640934+0000","last_clean":"2024-04-26T12:30:34.640934+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:30:34.640934+0000","last_undegraded":"2024-04-26T12:30:34.640934+0000","last_fullsized":"2024-04-26T12:30:34.640934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613671+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:30:33.613671+0000","last_peered":"2024-04-26T12:30:33.613671+0000","last_clean":"2024-04-26T12:30:33.613671+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:30:33.613671+0000","last_undegraded":"2024-04-26T12:30:33.613671+0000","last_fullsized":"2024-04-26T12:30:33.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":638777,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":135168,"data_stored":45552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":638161,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:50.154 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:50.561 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:50.563 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:30:50.575 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T12:30:48.972322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81640,"kb_used_data":556,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033880,"statfs":{"total":289910292480,"available":289826693120,"internally_reserved":0,"allocated":569344,"data_stored":1322490,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002593"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613749+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:30:33.613749+0000","last_peered":"2024-04-26T12:30:33.613749+0000","last_clean":"2024-04-26T12:30:33.613749+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:30:33.613749+0000","last_undegraded":"2024-04-26T12:30:33.613749+0000","last_fullsized":"2024-04-26T12:30:33.613749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613688+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:30:33.613688+0000","last_peered":"2024-04-26T12:30:33.613688+0000","last_clean":"2024-04-26T12:30:33.613688+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:30:33.613688+0000","last_undegraded":"2024-04-26T12:30:33.613688+0000","last_fullsized":"2024-04-26T12:30:33.613688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614359+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:30:33.614359+0000","last_peered":"2024-04-26T12:30:33.614359+0000","last_clean":"2024-04-26T12:30:33.614359+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:30:33.614359+0000","last_undegraded":"2024-04-26T12:30:33.614359+0000","last_fullsized":"2024-04-26T12:30:33.614359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614425+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:30:33.614425+0000","last_peered":"2024-04-26T12:30:33.614425+0000","last_clean":"2024-04-26T12:30:33.614425+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:30:33.614425+0000","last_undegraded":"2024-04-26T12:30:33.614425+0000","last_fullsized":"2024-04-26T12:30:33.614425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613283+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:30:33.613283+0000","last_peered":"2024-04-26T12:30:33.613283+0000","last_clean":"2024-04-26T12:30:33.613283+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:30:33.613283+0000","last_undegraded":"2024-04-26T12:30:33.613283+0000","last_fullsized":"2024-04-26T12:30:33.613283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613479+0000","last_change":"2024-04-26T12:30:32.614596+0000","last_active":"2024-04-26T12:30:33.613479+0000","last_peered":"2024-04-26T12:30:33.613479+0000","last_clean":"2024-04-26T12:30:33.613479+0000","last_became_active":"2024-04-26T12:30:32.613418+0000","last_became_peered":"2024-04-26T12:30:32.613418+0000","last_unstale":"2024-04-26T12:30:33.613479+0000","last_undegraded":"2024-04-26T12:30:33.613479+0000","last_fullsized":"2024-04-26T12:30:33.613479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:32.926352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613744+0000","last_change":"2024-04-26T12:30:32.614280+0000","last_active":"2024-04-26T12:30:33.613744+0000","last_peered":"2024-04-26T12:30:33.613744+0000","last_clean":"2024-04-26T12:30:33.613744+0000","last_became_active":"2024-04-26T12:30:32.613382+0000","last_became_peered":"2024-04-26T12:30:32.613382+0000","last_unstale":"2024-04-26T12:30:33.613744+0000","last_undegraded":"2024-04-26T12:30:33.613744+0000","last_fullsized":"2024-04-26T12:30:33.613744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613306+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:30:33.613306+0000","last_peered":"2024-04-26T12:30:33.613306+0000","last_clean":"2024-04-26T12:30:33.613306+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:30:33.613306+0000","last_undegraded":"2024-04-26T12:30:33.613306+0000","last_fullsized":"2024-04-26T12:30:33.613306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641132+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:30:34.641132+0000","last_peered":"2024-04-26T12:30:34.641132+0000","last_clean":"2024-04-26T12:30:34.641132+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:30:34.641132+0000","last_undegraded":"2024-04-26T12:30:34.641132+0000","last_fullsized":"2024-04-26T12:30:34.641132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613769+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:30:33.613769+0000","last_peered":"2024-04-26T12:30:33.613769+0000","last_clean":"2024-04-26T12:30:33.613769+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:30:33.613769+0000","last_undegraded":"2024-04-26T12:30:33.613769+0000","last_fullsized":"2024-04-26T12:30:33.613769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614206+0000","last_change":"2024-04-26T12:30:32.616474+0000","last_active":"2024-04-26T12:30:33.614206+0000","last_peered":"2024-04-26T12:30:33.614206+0000","last_clean":"2024-04-26T12:30:33.614206+0000","last_became_active":"2024-04-26T12:30:32.615780+0000","last_became_peered":"2024-04-26T12:30:32.615780+0000","last_unstale":"2024-04-26T12:30:33.614206+0000","last_undegraded":"2024-04-26T12:30:33.614206+0000","last_fullsized":"2024-04-26T12:30:33.614206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.298182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613314+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:30:33.613314+0000","last_peered":"2024-04-26T12:30:33.613314+0000","last_clean":"2024-04-26T12:30:33.613314+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:30:33.613314+0000","last_undegraded":"2024-04-26T12:30:33.613314+0000","last_fullsized":"2024-04-26T12:30:33.613314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613096+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:30:33.613096+0000","last_peered":"2024-04-26T12:30:33.613096+0000","last_clean":"2024-04-26T12:30:33.613096+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:30:33.613096+0000","last_undegraded":"2024-04-26T12:30:33.613096+0000","last_fullsized":"2024-04-26T12:30:33.613096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613926+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:30:33.613926+0000","last_peered":"2024-04-26T12:30:33.613926+0000","last_clean":"2024-04-26T12:30:33.613926+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:30:33.613926+0000","last_undegraded":"2024-04-26T12:30:33.613926+0000","last_fullsized":"2024-04-26T12:30:33.613926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613728+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:30:33.613728+0000","last_peered":"2024-04-26T12:30:33.613728+0000","last_clean":"2024-04-26T12:30:33.613728+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:30:33.613728+0000","last_undegraded":"2024-04-26T12:30:33.613728+0000","last_fullsized":"2024-04-26T12:30:33.613728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613416+0000","last_change":"2024-04-26T12:30:32.619340+0000","last_active":"2024-04-26T12:30:33.613416+0000","last_peered":"2024-04-26T12:30:33.613416+0000","last_clean":"2024-04-26T12:30:33.613416+0000","last_became_active":"2024-04-26T12:30:32.616781+0000","last_became_peered":"2024-04-26T12:30:32.616781+0000","last_unstale":"2024-04-26T12:30:33.613416+0000","last_undegraded":"2024-04-26T12:30:33.613416+0000","last_fullsized":"2024-04-26T12:30:33.613416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:30.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641153+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:30:34.641153+0000","last_peered":"2024-04-26T12:30:34.641153+0000","last_clean":"2024-04-26T12:30:34.641153+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:30:34.641153+0000","last_undegraded":"2024-04-26T12:30:34.641153+0000","last_fullsized":"2024-04-26T12:30:34.641153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614070+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:30:33.614070+0000","last_peered":"2024-04-26T12:30:33.614070+0000","last_clean":"2024-04-26T12:30:33.614070+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:30:33.614070+0000","last_undegraded":"2024-04-26T12:30:33.614070+0000","last_fullsized":"2024-04-26T12:30:33.614070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641094+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:30:34.641094+0000","last_peered":"2024-04-26T12:30:34.641094+0000","last_clean":"2024-04-26T12:30:34.641094+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:30:34.641094+0000","last_undegraded":"2024-04-26T12:30:34.641094+0000","last_fullsized":"2024-04-26T12:30:34.641094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614333+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:30:33.614333+0000","last_peered":"2024-04-26T12:30:33.614333+0000","last_clean":"2024-04-26T12:30:33.614333+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:30:33.614333+0000","last_undegraded":"2024-04-26T12:30:33.614333+0000","last_fullsized":"2024-04-26T12:30:33.614333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613733+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:30:33.613733+0000","last_peered":"2024-04-26T12:30:33.613733+0000","last_clean":"2024-04-26T12:30:33.613733+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:30:33.613733+0000","last_undegraded":"2024-04-26T12:30:33.613733+0000","last_fullsized":"2024-04-26T12:30:33.613733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613025+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:30:33.613025+0000","last_peered":"2024-04-26T12:30:33.613025+0000","last_clean":"2024-04-26T12:30:33.613025+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:30:33.613025+0000","last_undegraded":"2024-04-26T12:30:33.613025+0000","last_fullsized":"2024-04-26T12:30:33.613025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640404+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:30:34.640404+0000","last_peered":"2024-04-26T12:30:34.640404+0000","last_clean":"2024-04-26T12:30:34.640404+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:30:34.640404+0000","last_undegraded":"2024-04-26T12:30:34.640404+0000","last_fullsized":"2024-04-26T12:30:34.640404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613088+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:30:33.613088+0000","last_peered":"2024-04-26T12:30:33.613088+0000","last_clean":"2024-04-26T12:30:33.613088+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:30:33.613088+0000","last_undegraded":"2024-04-26T12:30:33.613088+0000","last_fullsized":"2024-04-26T12:30:33.613088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613910+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:30:33.613910+0000","last_peered":"2024-04-26T12:30:33.613910+0000","last_clean":"2024-04-26T12:30:33.613910+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:30:33.613910+0000","last_undegraded":"2024-04-26T12:30:33.613910+0000","last_fullsized":"2024-04-26T12:30:33.613910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641161+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:30:34.641161+0000","last_peered":"2024-04-26T12:30:34.641161+0000","last_clean":"2024-04-26T12:30:34.641161+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:30:34.641161+0000","last_undegraded":"2024-04-26T12:30:34.641161+0000","last_fullsized":"2024-04-26T12:30:34.641161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614220+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:30:33.614220+0000","last_peered":"2024-04-26T12:30:33.614220+0000","last_clean":"2024-04-26T12:30:33.614220+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:30:33.614220+0000","last_undegraded":"2024-04-26T12:30:33.614220+0000","last_fullsized":"2024-04-26T12:30:33.614220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613168+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:30:33.613168+0000","last_peered":"2024-04-26T12:30:33.613168+0000","last_clean":"2024-04-26T12:30:33.613168+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:33.613168+0000","last_undegraded":"2024-04-26T12:30:33.613168+0000","last_fullsized":"2024-04-26T12:30:33.613168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613699+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:30:33.613699+0000","last_peered":"2024-04-26T12:30:33.613699+0000","last_clean":"2024-04-26T12:30:33.613699+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:30:33.613699+0000","last_undegraded":"2024-04-26T12:30:33.613699+0000","last_fullsized":"2024-04-26T12:30:33.613699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640503+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:30:34.640503+0000","last_peered":"2024-04-26T12:30:34.640503+0000","last_clean":"2024-04-26T12:30:34.640503+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:30:34.640503+0000","last_undegraded":"2024-04-26T12:30:34.640503+0000","last_fullsized":"2024-04-26T12:30:34.640503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640234+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:30:34.640234+0000","last_peered":"2024-04-26T12:30:34.640234+0000","last_clean":"2024-04-26T12:30:34.640234+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:30:34.640234+0000","last_undegraded":"2024-04-26T12:30:34.640234+0000","last_fullsized":"2024-04-26T12:30:34.640234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614142+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:30:33.614142+0000","last_peered":"2024-04-26T12:30:33.614142+0000","last_clean":"2024-04-26T12:30:33.614142+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:30:33.614142+0000","last_undegraded":"2024-04-26T12:30:33.614142+0000","last_fullsized":"2024-04-26T12:30:33.614142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641363+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:30:34.641363+0000","last_peered":"2024-04-26T12:30:34.641363+0000","last_clean":"2024-04-26T12:30:34.641363+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:30:34.641363+0000","last_undegraded":"2024-04-26T12:30:34.641363+0000","last_fullsized":"2024-04-26T12:30:34.641363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640252+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:30:34.640252+0000","last_peered":"2024-04-26T12:30:34.640252+0000","last_clean":"2024-04-26T12:30:34.640252+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:30:34.640252+0000","last_undegraded":"2024-04-26T12:30:34.640252+0000","last_fullsized":"2024-04-26T12:30:34.640252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614092+0000","last_change":"2024-04-26T12:30:32.163546+0000","last_active":"2024-04-26T12:30:33.614092+0000","last_peered":"2024-04-26T12:30:33.614092+0000","last_clean":"2024-04-26T12:30:33.614092+0000","last_became_active":"2024-04-26T12:30:32.163231+0000","last_became_peered":"2024-04-26T12:30:32.163231+0000","last_unstale":"2024-04-26T12:30:33.614092+0000","last_undegraded":"2024-04-26T12:30:33.614092+0000","last_fullsized":"2024-04-26T12:30:33.614092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640548+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:30:34.640548+0000","last_peered":"2024-04-26T12:30:34.640548+0000","last_clean":"2024-04-26T12:30:34.640548+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:30:34.640548+0000","last_undegraded":"2024-04-26T12:30:34.640548+0000","last_fullsized":"2024-04-26T12:30:34.640548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640519+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:30:34.640519+0000","last_peered":"2024-04-26T12:30:34.640519+0000","last_clean":"2024-04-26T12:30:34.640519+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:30:34.640519+0000","last_undegraded":"2024-04-26T12:30:34.640519+0000","last_fullsized":"2024-04-26T12:30:34.640519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614299+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:30:33.614299+0000","last_peered":"2024-04-26T12:30:33.614299+0000","last_clean":"2024-04-26T12:30:33.614299+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:30:33.614299+0000","last_undegraded":"2024-04-26T12:30:33.614299+0000","last_fullsized":"2024-04-26T12:30:33.614299+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614095+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:30:33.614095+0000","last_peered":"2024-04-26T12:30:33.614095+0000","last_clean":"2024-04-26T12:30:33.614095+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:30:33.614095+0000","last_undegraded":"2024-04-26T12:30:33.614095+0000","last_fullsized":"2024-04-26T12:30:33.614095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613977+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:30:33.613977+0000","last_peered":"2024-04-26T12:30:33.613977+0000","last_clean":"2024-04-26T12:30:33.613977+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:30:33.613977+0000","last_undegraded":"2024-04-26T12:30:33.613977+0000","last_fullsized":"2024-04-26T12:30:33.613977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613519+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:30:33.613519+0000","last_peered":"2024-04-26T12:30:33.613519+0000","last_clean":"2024-04-26T12:30:33.613519+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:30:33.613519+0000","last_undegraded":"2024-04-26T12:30:33.613519+0000","last_fullsized":"2024-04-26T12:30:33.613519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640659+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:30:34.640659+0000","last_peered":"2024-04-26T12:30:34.640659+0000","last_clean":"2024-04-26T12:30:34.640659+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:30:34.640659+0000","last_undegraded":"2024-04-26T12:30:34.640659+0000","last_fullsized":"2024-04-26T12:30:34.640659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613920+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:30:33.613920+0000","last_peered":"2024-04-26T12:30:33.613920+0000","last_clean":"2024-04-26T12:30:33.613920+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:30:33.613920+0000","last_undegraded":"2024-04-26T12:30:33.613920+0000","last_fullsized":"2024-04-26T12:30:33.613920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613180+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:30:33.613180+0000","last_peered":"2024-04-26T12:30:33.613180+0000","last_clean":"2024-04-26T12:30:33.613180+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:30:33.613180+0000","last_undegraded":"2024-04-26T12:30:33.613180+0000","last_fullsized":"2024-04-26T12:30:33.613180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641338+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:30:34.641338+0000","last_peered":"2024-04-26T12:30:34.641338+0000","last_clean":"2024-04-26T12:30:34.641338+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:30:34.641338+0000","last_undegraded":"2024-04-26T12:30:34.641338+0000","last_fullsized":"2024-04-26T12:30:34.641338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613748+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:30:33.613748+0000","last_peered":"2024-04-26T12:30:33.613748+0000","last_clean":"2024-04-26T12:30:33.613748+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:30:33.613748+0000","last_undegraded":"2024-04-26T12:30:33.613748+0000","last_fullsized":"2024-04-26T12:30:33.613748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641478+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:30:34.641478+0000","last_peered":"2024-04-26T12:30:34.641478+0000","last_clean":"2024-04-26T12:30:34.641478+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:30:34.641478+0000","last_undegraded":"2024-04-26T12:30:34.641478+0000","last_fullsized":"2024-04-26T12:30:34.641478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614300+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:30:33.614300+0000","last_peered":"2024-04-26T12:30:33.614300+0000","last_clean":"2024-04-26T12:30:33.614300+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:30:33.614300+0000","last_undegraded":"2024-04-26T12:30:33.614300+0000","last_fullsized":"2024-04-26T12:30:33.614300+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613214+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:30:33.613214+0000","last_peered":"2024-04-26T12:30:33.613214+0000","last_clean":"2024-04-26T12:30:33.613214+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:30:33.613214+0000","last_undegraded":"2024-04-26T12:30:33.613214+0000","last_fullsized":"2024-04-26T12:30:33.613214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613464+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:30:33.613464+0000","last_peered":"2024-04-26T12:30:33.613464+0000","last_clean":"2024-04-26T12:30:33.613464+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:30:33.613464+0000","last_undegraded":"2024-04-26T12:30:33.613464+0000","last_fullsized":"2024-04-26T12:30:33.613464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614330+0000","last_change":"2024-04-26T12:30:32.159189+0000","last_active":"2024-04-26T12:30:33.614330+0000","last_peered":"2024-04-26T12:30:33.614330+0000","last_clean":"2024-04-26T12:30:33.614330+0000","last_became_active":"2024-04-26T12:30:32.158897+0000","last_became_peered":"2024-04-26T12:30:32.158897+0000","last_unstale":"2024-04-26T12:30:33.614330+0000","last_undegraded":"2024-04-26T12:30:33.614330+0000","last_fullsized":"2024-04-26T12:30:33.614330+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613885+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:30:33.613885+0000","last_peered":"2024-04-26T12:30:33.613885+0000","last_clean":"2024-04-26T12:30:33.613885+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:30:33.613885+0000","last_undegraded":"2024-04-26T12:30:33.613885+0000","last_fullsized":"2024-04-26T12:30:33.613885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640992+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:30:34.640992+0000","last_peered":"2024-04-26T12:30:34.640992+0000","last_clean":"2024-04-26T12:30:34.640992+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:30:34.640992+0000","last_undegraded":"2024-04-26T12:30:34.640992+0000","last_fullsized":"2024-04-26T12:30:34.640992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640809+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:30:34.640809+0000","last_peered":"2024-04-26T12:30:34.640809+0000","last_clean":"2024-04-26T12:30:34.640809+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:30:34.640809+0000","last_undegraded":"2024-04-26T12:30:34.640809+0000","last_fullsized":"2024-04-26T12:30:34.640809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614019+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:30:33.614019+0000","last_peered":"2024-04-26T12:30:33.614019+0000","last_clean":"2024-04-26T12:30:33.614019+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:30:33.614019+0000","last_undegraded":"2024-04-26T12:30:33.614019+0000","last_fullsized":"2024-04-26T12:30:33.614019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613501+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:30:33.613501+0000","last_peered":"2024-04-26T12:30:33.613501+0000","last_clean":"2024-04-26T12:30:33.613501+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:30:33.613501+0000","last_undegraded":"2024-04-26T12:30:33.613501+0000","last_fullsized":"2024-04-26T12:30:33.613501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614525+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:30:33.614525+0000","last_peered":"2024-04-26T12:30:33.614525+0000","last_clean":"2024-04-26T12:30:33.614525+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:30:33.614525+0000","last_undegraded":"2024-04-26T12:30:33.614525+0000","last_fullsized":"2024-04-26T12:30:33.614525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612940+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:30:33.612940+0000","last_peered":"2024-04-26T12:30:33.612940+0000","last_clean":"2024-04-26T12:30:33.612940+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:30:33.612940+0000","last_undegraded":"2024-04-26T12:30:33.612940+0000","last_fullsized":"2024-04-26T12:30:33.612940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614223+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:30:33.614223+0000","last_peered":"2024-04-26T12:30:33.614223+0000","last_clean":"2024-04-26T12:30:33.614223+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:30:33.614223+0000","last_undegraded":"2024-04-26T12:30:33.614223+0000","last_fullsized":"2024-04-26T12:30:33.614223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612992+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:30:33.612992+0000","last_peered":"2024-04-26T12:30:33.612992+0000","last_clean":"2024-04-26T12:30:33.612992+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:30:33.612992+0000","last_undegraded":"2024-04-26T12:30:33.612992+0000","last_fullsized":"2024-04-26T12:30:33.612992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641275+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:30:34.641275+0000","last_peered":"2024-04-26T12:30:34.641275+0000","last_clean":"2024-04-26T12:30:34.641275+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:30:34.641275+0000","last_undegraded":"2024-04-26T12:30:34.641275+0000","last_fullsized":"2024-04-26T12:30:34.641275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600450+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:30:32.600450+0000","last_peered":"2024-04-26T12:30:32.600450+0000","last_clean":"2024-04-26T12:30:32.600450+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:30:32.600450+0000","last_undegraded":"2024-04-26T12:30:32.600450+0000","last_fullsized":"2024-04-26T12:30:32.600450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614436+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:30:33.614436+0000","last_peered":"2024-04-26T12:30:33.614436+0000","last_clean":"2024-04-26T12:30:33.614436+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:30:33.614436+0000","last_undegraded":"2024-04-26T12:30:33.614436+0000","last_fullsized":"2024-04-26T12:30:33.614436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613294+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:30:33.613294+0000","last_peered":"2024-04-26T12:30:33.613294+0000","last_clean":"2024-04-26T12:30:33.613294+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:30:33.613294+0000","last_undegraded":"2024-04-26T12:30:33.613294+0000","last_fullsized":"2024-04-26T12:30:33.613294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607913+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:30:32.607913+0000","last_peered":"2024-04-26T12:30:32.607913+0000","last_clean":"2024-04-26T12:30:32.607913+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:30:32.607913+0000","last_undegraded":"2024-04-26T12:30:32.607913+0000","last_fullsized":"2024-04-26T12:30:32.607913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613849+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:30:33.613849+0000","last_peered":"2024-04-26T12:30:33.613849+0000","last_clean":"2024-04-26T12:30:33.613849+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:30:33.613849+0000","last_undegraded":"2024-04-26T12:30:33.613849+0000","last_fullsized":"2024-04-26T12:30:33.613849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641033+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:30:34.641033+0000","last_peered":"2024-04-26T12:30:34.641033+0000","last_clean":"2024-04-26T12:30:34.641033+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:30:34.641033+0000","last_undegraded":"2024-04-26T12:30:34.641033+0000","last_fullsized":"2024-04-26T12:30:34.641033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.599399+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:30:32.599399+0000","last_peered":"2024-04-26T12:30:32.599399+0000","last_clean":"2024-04-26T12:30:32.599399+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:30:32.599399+0000","last_undegraded":"2024-04-26T12:30:32.599399+0000","last_fullsized":"2024-04-26T12:30:32.599399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612917+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:30:33.612917+0000","last_peered":"2024-04-26T12:30:33.612917+0000","last_clean":"2024-04-26T12:30:33.612917+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:30:33.612917+0000","last_undegraded":"2024-04-26T12:30:33.612917+0000","last_fullsized":"2024-04-26T12:30:33.612917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641472+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:30:34.641472+0000","last_peered":"2024-04-26T12:30:34.641472+0000","last_clean":"2024-04-26T12:30:34.641472+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:30:34.641472+0000","last_undegraded":"2024-04-26T12:30:34.641472+0000","last_fullsized":"2024-04-26T12:30:34.641472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.610211+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:30:32.610211+0000","last_peered":"2024-04-26T12:30:32.610211+0000","last_clean":"2024-04-26T12:30:32.610211+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:30:32.610211+0000","last_undegraded":"2024-04-26T12:30:32.610211+0000","last_fullsized":"2024-04-26T12:30:32.610211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607337+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:30:32.607337+0000","last_peered":"2024-04-26T12:30:32.607337+0000","last_clean":"2024-04-26T12:30:32.607337+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:30:32.607337+0000","last_undegraded":"2024-04-26T12:30:32.607337+0000","last_fullsized":"2024-04-26T12:30:32.607337+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640452+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:30:34.640452+0000","last_peered":"2024-04-26T12:30:34.640452+0000","last_clean":"2024-04-26T12:30:34.640452+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:30:34.640452+0000","last_undegraded":"2024-04-26T12:30:34.640452+0000","last_fullsized":"2024-04-26T12:30:34.640452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614485+0000","last_change":"2024-04-26T12:30:32.620556+0000","last_active":"2024-04-26T12:30:33.614485+0000","last_peered":"2024-04-26T12:30:33.614485+0000","last_clean":"2024-04-26T12:30:33.614485+0000","last_became_active":"2024-04-26T12:30:32.620148+0000","last_became_peered":"2024-04-26T12:30:32.620148+0000","last_unstale":"2024-04-26T12:30:33.614485+0000","last_undegraded":"2024-04-26T12:30:33.614485+0000","last_fullsized":"2024-04-26T12:30:33.614485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607350+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:30:32.607350+0000","last_peered":"2024-04-26T12:30:32.607350+0000","last_clean":"2024-04-26T12:30:32.607350+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:30:32.607350+0000","last_undegraded":"2024-04-26T12:30:32.607350+0000","last_fullsized":"2024-04-26T12:30:32.607350+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640248+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:30:34.640248+0000","last_peered":"2024-04-26T12:30:34.640248+0000","last_clean":"2024-04-26T12:30:34.640248+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:30:34.640248+0000","last_undegraded":"2024-04-26T12:30:34.640248+0000","last_fullsized":"2024-04-26T12:30:34.640248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614007+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:30:33.614007+0000","last_peered":"2024-04-26T12:30:33.614007+0000","last_clean":"2024-04-26T12:30:33.614007+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:30:33.614007+0000","last_undegraded":"2024-04-26T12:30:33.614007+0000","last_fullsized":"2024-04-26T12:30:33.614007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.605563+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:30:32.605563+0000","last_peered":"2024-04-26T12:30:32.605563+0000","last_clean":"2024-04-26T12:30:32.605563+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:30:32.605563+0000","last_undegraded":"2024-04-26T12:30:32.605563+0000","last_fullsized":"2024-04-26T12:30:32.605563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640832+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:30:34.640832+0000","last_peered":"2024-04-26T12:30:34.640832+0000","last_clean":"2024-04-26T12:30:34.640832+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:30:34.640832+0000","last_undegraded":"2024-04-26T12:30:34.640832+0000","last_fullsized":"2024-04-26T12:30:34.640832+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613291+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:30:33.613291+0000","last_peered":"2024-04-26T12:30:33.613291+0000","last_clean":"2024-04-26T12:30:33.613291+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:30:33.613291+0000","last_undegraded":"2024-04-26T12:30:33.613291+0000","last_fullsized":"2024-04-26T12:30:33.613291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641247+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:30:34.641247+0000","last_peered":"2024-04-26T12:30:34.641247+0000","last_clean":"2024-04-26T12:30:34.641247+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:30:34.641247+0000","last_undegraded":"2024-04-26T12:30:34.641247+0000","last_fullsized":"2024-04-26T12:30:34.641247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600817+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:30:32.600817+0000","last_peered":"2024-04-26T12:30:32.600817+0000","last_clean":"2024-04-26T12:30:32.600817+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:30:32.600817+0000","last_undegraded":"2024-04-26T12:30:32.600817+0000","last_fullsized":"2024-04-26T12:30:32.600817+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640370+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:30:34.640370+0000","last_peered":"2024-04-26T12:30:34.640370+0000","last_clean":"2024-04-26T12:30:34.640370+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:30:34.640370+0000","last_undegraded":"2024-04-26T12:30:34.640370+0000","last_fullsized":"2024-04-26T12:30:34.640370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.608611+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:30:32.608611+0000","last_peered":"2024-04-26T12:30:32.608611+0000","last_clean":"2024-04-26T12:30:32.608611+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:30:32.608611+0000","last_undegraded":"2024-04-26T12:30:32.608611+0000","last_fullsized":"2024-04-26T12:30:32.608611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.995826+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:30:34.995826+0000","last_peered":"2024-04-26T12:30:34.995826+0000","last_clean":"2024-04-26T12:30:34.995826+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:30:34.995826+0000","last_undegraded":"2024-04-26T12:30:34.995826+0000","last_fullsized":"2024-04-26T12:30:34.995826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613310+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:30:33.613310+0000","last_peered":"2024-04-26T12:30:33.613310+0000","last_clean":"2024-04-26T12:30:33.613310+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:30:33.613310+0000","last_undegraded":"2024-04-26T12:30:33.613310+0000","last_fullsized":"2024-04-26T12:30:33.613310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613412+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:30:33.613412+0000","last_peered":"2024-04-26T12:30:33.613412+0000","last_clean":"2024-04-26T12:30:33.613412+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:30:33.613412+0000","last_undegraded":"2024-04-26T12:30:33.613412+0000","last_fullsized":"2024-04-26T12:30:33.613412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613632+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:30:33.613632+0000","last_peered":"2024-04-26T12:30:33.613632+0000","last_clean":"2024-04-26T12:30:33.613632+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:30:33.613632+0000","last_undegraded":"2024-04-26T12:30:33.613632+0000","last_fullsized":"2024-04-26T12:30:33.613632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614172+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:30:33.614172+0000","last_peered":"2024-04-26T12:30:33.614172+0000","last_clean":"2024-04-26T12:30:33.614172+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:30:33.614172+0000","last_undegraded":"2024-04-26T12:30:33.614172+0000","last_fullsized":"2024-04-26T12:30:33.614172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613790+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:30:33.613790+0000","last_peered":"2024-04-26T12:30:33.613790+0000","last_clean":"2024-04-26T12:30:33.613790+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:30:33.613790+0000","last_undegraded":"2024-04-26T12:30:33.613790+0000","last_fullsized":"2024-04-26T12:30:33.613790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613843+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:30:33.613843+0000","last_peered":"2024-04-26T12:30:33.613843+0000","last_clean":"2024-04-26T12:30:33.613843+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:30:33.613843+0000","last_undegraded":"2024-04-26T12:30:33.613843+0000","last_fullsized":"2024-04-26T12:30:33.613843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612884+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:30:33.612884+0000","last_peered":"2024-04-26T12:30:33.612884+0000","last_clean":"2024-04-26T12:30:33.612884+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:30:33.612884+0000","last_undegraded":"2024-04-26T12:30:33.612884+0000","last_fullsized":"2024-04-26T12:30:33.612884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641370+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:30:34.641370+0000","last_peered":"2024-04-26T12:30:34.641370+0000","last_clean":"2024-04-26T12:30:34.641370+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:30:34.641370+0000","last_undegraded":"2024-04-26T12:30:34.641370+0000","last_fullsized":"2024-04-26T12:30:34.641370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613737+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:30:33.613737+0000","last_peered":"2024-04-26T12:30:33.613737+0000","last_clean":"2024-04-26T12:30:33.613737+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:30:33.613737+0000","last_undegraded":"2024-04-26T12:30:33.613737+0000","last_fullsized":"2024-04-26T12:30:33.613737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613593+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:30:33.613593+0000","last_peered":"2024-04-26T12:30:33.613593+0000","last_clean":"2024-04-26T12:30:33.613593+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:30:33.613593+0000","last_undegraded":"2024-04-26T12:30:33.613593+0000","last_fullsized":"2024-04-26T12:30:33.613593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640266+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:30:34.640266+0000","last_peered":"2024-04-26T12:30:34.640266+0000","last_clean":"2024-04-26T12:30:34.640266+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:30:34.640266+0000","last_undegraded":"2024-04-26T12:30:34.640266+0000","last_fullsized":"2024-04-26T12:30:34.640266+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613341+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:30:33.613341+0000","last_peered":"2024-04-26T12:30:33.613341+0000","last_clean":"2024-04-26T12:30:33.613341+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:30:33.613341+0000","last_undegraded":"2024-04-26T12:30:33.613341+0000","last_fullsized":"2024-04-26T12:30:33.613341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640934+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:30:34.640934+0000","last_peered":"2024-04-26T12:30:34.640934+0000","last_clean":"2024-04-26T12:30:34.640934+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:30:34.640934+0000","last_undegraded":"2024-04-26T12:30:34.640934+0000","last_fullsized":"2024-04-26T12:30:34.640934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613671+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:30:33.613671+0000","last_peered":"2024-04-26T12:30:33.613671+0000","last_clean":"2024-04-26T12:30:33.613671+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:30:33.613671+0000","last_undegraded":"2024-04-26T12:30:33.613671+0000","last_fullsized":"2024-04-26T12:30:33.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":638777,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":135168,"data_stored":45552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":638161,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:50.579 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:30:50.579 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T12:30:50.983 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 15 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:fsid 64cc8c72-72d6-4335-8e3d-3304aaa6cad9 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:created 2024-04-26T12:30:16.108777+0000 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:modified 2024-04-26T12:30:33.595371+0000 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:crush_version 4 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:full_ratio 0.95 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:backfillfull_ratio 0.9 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:nearfull_ratio 0.85 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:require_min_compat_client luminous 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:min_compat_client jewel 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:require_osd_release reef 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:stretch_mode_enabled false 2024-04-26T12:30:50.984 INFO:teuthology.orchestra.run.smithi038.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T12:30:50.985 INFO:teuthology.orchestra.run.smithi038.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T12:30:50.985 INFO:teuthology.orchestra.run.smithi038.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T12:30:50.985 INFO:teuthology.orchestra.run.smithi038.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T12:30:50.985 INFO:teuthology.orchestra.run.smithi038.stdout:max_osd 3 2024-04-26T12:30:50.985 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/40381,v1:172.21.15.98:6801/40381] [v2:172.21.15.98:6802/40381,v1:172.21.15.98:6803/40381] exists,up 25a1a54a-7d63-4c77-a385-f8147232ba3f 2024-04-26T12:30:50.985 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/40366,v1:172.21.15.116:6801/40366] [v2:172.21.15.116:6802/40366,v1:172.21.15.116:6803/40366] exists,up 2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc 2024-04-26T12:30:50.985 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6800/40554,v1:172.21.15.133:6801/40554] [v2:172.21.15.133:6802/40554,v1:172.21.15.133:6803/40554] exists,up 0ddc67e1-ee46-4691-bc16-6366296d9929 2024-04-26T12:30:51.000 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/40381,v1:172.21.15.98:6801/40381] [v2:172.21.15.98:6802/40381,v1:172.21.15.98:6803/40381] exists,up 25a1a54a-7d63-4c77-a385-f8147232ba3f', 'osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/40366,v1:172.21.15.116:6801/40366] [v2:172.21.15.116:6802/40366,v1:172.21.15.116:6803/40366] exists,up 2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc', 'osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.133:6800/40554,v1:172.21.15.133:6801/40554] [v2:172.21.15.133:6802/40554,v1:172.21.15.133:6803/40554] exists,up 0ddc67e1-ee46-4691-bc16-6366296d9929'] 2024-04-26T12:30:51.000 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T12:30:51.139 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-26T12:30:51.139 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mon.a", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster": "ceph", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "admin_socket_mode": "", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_client_required": "cephx, none", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_cluster_required": "cephx", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_debug": "true", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_service_required": "cephx", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T12:30:51.140 INFO:teuthology.orchestra.run.smithi038.stdout: "auth_supported": "cephx", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_aio": "true", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_aio_reap_max": "16", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_async_discard": "false", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_block_size": "4096", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_debug_aio": "false", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T12:30:51.141 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_enable_discard": "false", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_flock_retry": "3", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_inject_crash": "0", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_ioring": "false", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_ioring_hipri": "false", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T12:30:51.142 INFO:teuthology.orchestra.run.smithi038.stdout: "bdev_type": "", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_allocator": "hybrid", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_buffered_io": "true", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T12:30:51.143 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_replay_recovery": "false", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_sync_write": "false", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T12:30:51.144 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_allocator": "hybrid", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_create": "true", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_db_create": "false", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_db_path": "", 2024-04-26T12:30:51.145 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_db_size": "0", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_path": "", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_size": "107374182400", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_wal_create": "false", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_wal_path": "", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_bluefs": "true", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T12:30:51.146 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_autotune": "true", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_size": "0", 2024-04-26T12:30:51.147 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_type": "2q", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_clone_cow": "true", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T12:30:51.148 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_compression_mode": "none", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_freelist": "false", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T12:30:51.149 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T12:30:51.150 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T12:30:51.151 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fail_eio": "false", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T12:30:51.152 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T12:30:51.153 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_max_blob_size": "0", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T12:30:51.154 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T12:30:51.155 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_spdk_mem": "512", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T12:30:51.156 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T12:30:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_tracing": "false", 2024-04-26T12:30:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T12:30:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T12:30:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T12:30:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T12:30:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T12:30:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T12:30:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T12:30:51.157 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T12:30:51.158 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephx_cluster_require_version": "2", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephx_require_signatures": "false", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephx_require_version": "2", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephx_service_require_signatures": "false", 2024-04-26T12:30:51.159 INFO:teuthology.orchestra.run.smithi038.stdout: "cephx_service_require_version": "2", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "cephx_sign_messages": "true", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "chdir": "", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_acl_type": "", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_asio_thread_count": "2", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_cache_mid": "0.750000", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_cache_size": "16384", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_caps_release_delay": "5", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_check_pool_perm": "true", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_debug_force_sync_read": "false", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_debug_getattr_caps": "false", 2024-04-26T12:30:51.160 INFO:teuthology.orchestra.run.smithi038.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_die_on_failed_remount": "false", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_dirsize_rbytes": "true", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_force_lazyio": "false", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_fs": "", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_inject_release_failure": "false", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_max_inline_size": "4096", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_mds_namespace": "", 2024-04-26T12:30:51.161 INFO:teuthology.orchestra.run.smithi038.stdout: "client_metadata": "", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_mount_gid": "-1", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_mount_timeout": "300", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_mount_uid": "-1", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_mountpoint": "/", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_notify_timeout": "10", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_oc": "true", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_oc_max_objects": "1000", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_oc_size": "209715200", 2024-04-26T12:30:51.162 INFO:teuthology.orchestra.run.smithi038.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_permissions": "true", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_quota": "true", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_quota_df": "true", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_readahead_max_bytes": "0", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_readahead_max_periods": "4", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_readahead_min": "131072", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_reconnect_stale": "false", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_shutdown_timeout": "30", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_snapdir": ".snap", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_tick_interval": "1", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_trace": "", 2024-04-26T12:30:51.163 INFO:teuthology.orchestra.run.smithi038.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "client_use_faked_inos": "false", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "client_use_random_mds": "false", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "clog_to_graylog": "false", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "clog_to_graylog_port": "12201", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "clog_to_monitors": "default=true", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "clog_to_syslog": "false", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "clog_to_syslog_level": "info", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "-", 2024-04-26T12:30:51.164 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_network": "", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_network_interface": "", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "compressor_zlib_isal": "false", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "compressor_zlib_level": "5", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "compressor_zstd_level": "1", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T12:30:51.165 INFO:teuthology.orchestra.run.smithi038.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "crimson_seastar_smp": "1", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_location": "", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_location_hook": "", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_location_hook_timeout": "10", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "daemonize": "false", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "daos_pool": "tank", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_alienstore": "0/5", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T12:30:51.166 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_asok": "1/5", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_asok_assert_abort": "false", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_auth": "20/20", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_bdev": "1/3", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_bluefs": "1/5", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_bluestore": "1/5", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_buffer": "0/1", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T12:30:51.167 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_cephsqlite": "0/5", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_client": "0/5", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_compressor": "1/5", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_context": "0/1", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_crush": "1/1", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_crypto": "1/5", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_cyanstore": "0/5", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_dpdk": "1/5", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_eventtrace": "1/5", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_filer": "0/1", 2024-04-26T12:30:51.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_filestore": "1/3", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_finisher": "1/1", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_fuse": "1/5", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_javaclient": "1/5", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_journal": "1/3", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_journaler": "0/5", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_kstore": "1/5", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_leveldb": "4/5", 2024-04-26T12:30:51.169 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_lockdep": "0/1", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mclock": "1/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mds": "1/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mds_balancer": "1/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mds_locker": "1/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mds_log": "1/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mds_migrator": "1/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_memstore": "1/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mgr": "2/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mgrc": "1/5", 2024-04-26T12:30:51.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_mon": "20/20", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_monc": "0/10", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_ms": "1/1", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_none": "0/5", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_objclass": "0/5", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_objectcacher": "0/5", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_objecter": "0/1", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_optracker": "0/5", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_osd": "1/5", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_paxos": "20/20", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_perfcounter": "1/5", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_prioritycache": "1/5", 2024-04-26T12:30:51.171 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rados": "0/5", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rbd": "0/5", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rbd_replay": "0/5", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_refs": "0/0", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_reserver": "1/1", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rgw": "1/5", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rgw_access": "1/5", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T12:30:51.172 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rgw_flight": "1/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rgw_sync": "1/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_rocksdb": "4/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore": "0/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_backref": "0/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_cache": "0/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_device": "0/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_epm": "0/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_journal": "0/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_lba": "0/5", 2024-04-26T12:30:51.173 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_odata": "0/5", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_omap": "0/5", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_onode": "0/5", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_t": "0/5", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_seastore_tm": "0/5", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_striper": "0/1", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_test": "0/5", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_throttle": "1/1", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_timer": "0/1", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "debug_tp": "0/5", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "device_failure_prediction_mode": "none", 2024-04-26T12:30:51.174 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "err_to_graylog": "false", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "err_to_journald": "false", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "err_to_stderr": "true", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "err_to_syslog": "false", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "event_tracing": "false", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "exporter_http_port": "9926", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "exporter_prio_limit": "5", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "exporter_sort_metrics": "true", 2024-04-26T12:30:51.175 INFO:teuthology.orchestra.run.smithi038.stdout: "exporter_stats_period": "5", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "fake_statfs_for_testing": "0", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "fatal_signal_handlers": "true", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filer_max_purge_ops": "10", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filer_max_truncate_ops": "128", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_blackhole": "false", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_btrfs_snap": "true", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_caller_concurrency": "10", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T12:30:51.176 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_debug_omap_check": "false", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_debug_verify_split": "false", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_dump_file": "", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_fadvise": "true", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_fail_eio": "true", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_fd_cache_size": "128", 2024-04-26T12:30:51.177 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_fiemap": "false", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_inject_stall": "0", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_journal_parallel": "false", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_journal_trailing": "false", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_journal_writeahead": "false", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_kill_at": "0", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T12:30:51.178 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T12:30:51.179 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_merge_threshold": "-10", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_odsync_write": "false", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_omap_backend_path": "", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_op_threads": "2", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_punch_hole": "false", 2024-04-26T12:30:51.180 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_queue_max_ops": "50", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T12:30:51.181 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_seek_data_hole": "false", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_sloppy_crc": "false", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_splice": "false", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_split_multiple": "2", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_split_rand_factor": "20", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_update_to": "1000", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T12:30:51.182 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_xfs_extsize": "false", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "filestore_zfs_snap": "false", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "fio_dir": "/tmp/fio", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "64cc8c72-72d6-4335-8e3d-3304aaa6cad9", 2024-04-26T12:30:51.183 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_allow_other": "true", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_big_writes": "true", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_debug": "false", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_default_permissions": "false", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_disable_pagecache": "false", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_max_write": "0", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_multithreaded": "true", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_require_active_mds": "true", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_set_user_groups": "true", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_splice_move": "true", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_splice_read": "true", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_splice_write": "true", 2024-04-26T12:30:51.184 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "gss_target_name": "ceph", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_file": "", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_inject_failure": "0", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_interval": "5", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "host": "smithi038", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T12:30:51.185 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "inject_early_sigterm": "false", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "jaeger_agent_port": "6799", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "jaeger_tracing_enable": "false", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_aio": "true", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_align_min_size": "65536", 2024-04-26T12:30:51.186 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_block_align": "true", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_block_size": "4096", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_dio": "true", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_discard": "false", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_force_aio": "false", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_ignore_corruption": "false", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_max_write_entries": "100", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_replay_from": "0", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T12:30:51.187 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_write_header_frequency": "0", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "journal_zero_on_create": "false", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "journaler_prefetch_periods": "10", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "journaler_prezero_periods": "5", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "journaler_write_head_interval": "15", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "key": "", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "keyfile": "", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_backend": "rocksdb", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_max_bytes": "67108864", 2024-04-26T12:30:51.188 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_max_ops": "512", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_onode_map_size": "1024", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "kstore_sync_transaction": "false", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_block_size": "65536", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_bloom_size": "0", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_cache_size": "536870912", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_compression": "false", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_log": "", 2024-04-26T12:30:51.189 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_max_open_files": "0", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_paranoid": "false", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "librados_thread_count": "2", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "lockdep": "false", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "lockdep_force_backtrace": "false", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "log_coarse_timestamps": "true", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "log_flush_on_exit": "false", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T12:30:51.190 INFO:teuthology.orchestra.run.smithi038.stdout: "log_graylog_port": "12201", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_max_new": "1000", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_max_recent": "10000", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_stderr_prefix": "", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": "true", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_graylog": "false", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_journald": "false", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_stderr": "false", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_syslog": "false", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T12:30:51.191 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_action_on_write_error": "1", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_alternate_name_max": "8192", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_asio_thread_count": "2", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_export_pin": "true", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_interval": "10", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_max": "-1", 2024-04-26T12:30:51.192 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_max_until": "-1", 2024-04-26T12:30:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_merge_size": "50", 2024-04-26T12:30:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T12:30:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T12:30:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T12:30:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T12:30:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_mode": "0", 2024-04-26T12:30:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T12:30:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T12:30:51.193 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_split_bits": "3", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_split_size": "10000", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T12:30:51.194 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache_mid": "0.700000", 2024-04-26T12:30:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T12:30:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T12:30:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T12:30:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache_trim_interval": "1", 2024-04-26T12:30:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T12:30:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T12:30:51.195 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_debug_auth_pins": "false", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_debug_frag": "false", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_debug_scatterstat": "false", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_debug_subtrees": "false", 2024-04-26T12:30:51.196 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_default_dir_hash": "2", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_defer_session_stale": "true", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_dir_max_entries": "0", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_dir_prefetch": "true", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T12:30:51.197 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_early_reply": "true", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_enable_op_tracker": "true", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_enforce_unique_name": "true", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T12:30:51.198 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_inject_health_dummy": "false", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T12:30:51.199 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_join_fs": "", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_journal_format": "1", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_create_at": "0", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_export_at": "0", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_import_at": "0", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_journal_at": "0", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_link_at": "0", 2024-04-26T12:30:51.200 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_openc_at": "0", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_rename_at": "0", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log_max_events": "-1", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log_max_segments": "128", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log_pause": "false", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log_segment_size": "0", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T12:30:51.201 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_completed_requests": "100000", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_export_size": "20971520", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_file_recover": "32", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_purge_files": "64", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_purge_ops": "8192", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_metrics_update_interval": "2", 2024-04-26T12:30:51.202 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_min_caps_per_client": "100", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_numa_node": "-1", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_op_history_duration": "600", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_op_history_size": "20", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_op_log_threshold": "5", 2024-04-26T12:30:51.203 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_ping_grace": "15", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_ping_interval": "5", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_recall_max_caps": "30000", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_replay_interval": "1.000000", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T12:30:51.204 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_root_ino_gid": "0", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_root_ino_uid": "0", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T12:30:51.205 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_shutdown_check": "0", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_skip_ino": "0", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_snap_min_uid": "0", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_snap_rstat": "false", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_symlink_recovery": "true", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T12:30:51.206 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_thrash_exports": "0", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_thrash_fragments": "0", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_tick_interval": "5.000000", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_valgrind_exit": "false", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_verify_backtrace": "1", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_verify_scatter": "false", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_wipe_sessions": "false", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool_debug": "false", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T12:30:51.207 INFO:teuthology.orchestra.run.smithi038.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "memstore_page_set": "false", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "memstore_page_size": "65536", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_client_bytes": "134217728", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_client_messages": "512", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_disabled_modules": "", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T12:30:51.208 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_mds_messages": "128", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_mon_messages": "128", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_osd_messages": "8192", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_pool": "true", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_standby_modules": "true", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_stats_period": "5", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_stats_threshold": "5", 2024-04-26T12:30:51.209 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_tick_period": "2", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_allow_pool_delete": "true", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_bytes": "104857600", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T12:30:51.210 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T12:30:51.211 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_compact_on_start": "false", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_compact_on_trim": "true", 2024-04-26T12:30:51.212 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_cpu_threads": "4", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_data_avail_crit": "5", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_data_avail_warn": "5", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_dump_json": "false", 2024-04-26T12:30:51.213 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_extra_checks": "false", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_election_default_strategy": "1", 2024-04-26T12:30:51.214 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_election_timeout": "5.000000", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_enable_op_tracker": "true", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_fake_pool_delete": "false", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_force_quorum_join": "false", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_health_log_update_period": "5", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_health_max_detail": "50", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_health_to_clog": "true", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T12:30:51.215 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_host": "172.21.15.38,[v2:172.21.15.38:3301,v1:172.21.15.38:6790],[v2:172.21.15.38:3302,v1:172.21.15.38:6791]", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_host_override": "", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_initial_members": "", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_lease": "5.000000", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T12:30:51.216 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_log_full_interval": "50", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_log_max": "10000", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_log_max_summary": "50", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_max_log_epochs": "500", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_max_osd": "10000", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T12:30:51.217 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_memory_autotune": "true", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_memory_target": "2147483648", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_mgr_digest_period": "5", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T12:30:51.218 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_op_complaint_time": "30", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_op_history_duration": "600", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_op_history_size": "20", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_op_log_threshold": "5", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T12:30:51.219 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_cache_size": "500", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T12:30:51.220 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T12:30:51.221 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_report_timeout": "900", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T12:30:51.222 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_reweight_max_osds": "4", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T12:30:51.223 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_scrub_interval": "86400", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_scrub_max_keys": "100", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_scrub_timeout": "300", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_session_timeout": "300", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_smart_report_timeout": "5", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_stretch_pool_size": "4", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T12:30:51.224 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_sync_debug": "false", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_tick_interval": "5", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T12:30:51.225 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_older_version": "true", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T12:30:51.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "monmap": "", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T12:30:51.227 INFO:teuthology.orchestra.run.smithi038.stdout: "motr_tracing_enabled": "false", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_op_threads": "3", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_cm": "false", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_device_name": "", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T12:30:51.228 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_sl": "3", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_rdma_type": "ib", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_async_reap_threshold": "5", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_before_connect": "false", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_ipv4": "true", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_ipv6": "false", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_msgr1": "true", 2024-04-26T12:30:51.229 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_msgr2": "true", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_port_max": "7568", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_port_min": "6800", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_retry_count": "3", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_bind_retry_delay": "5", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_blackhole_client": "false", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_blackhole_mds": "false", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_blackhole_mgr": "false", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_blackhole_mon": "false", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_blackhole_osd": "false", 2024-04-26T12:30:51.230 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_client_mode": "crc secure", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_cluster_type": "", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_compress_secure": "false", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_crc_data": "true", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_crc_header": "true", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_die_on_bug": "true", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_die_on_old_message": "true", 2024-04-26T12:30:51.231 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_hugepages": "", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_lro": "true", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T12:30:51.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_pmd": "", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_port_id": "0", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_dump_on_send": "false", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_inject_delay_type": "", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_inject_network_congestion": "0", 2024-04-26T12:30:51.233 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_inject_socket_failures": "0", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_max_accept_failures": "4", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_max_backoff": "15.000000", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_osd_compress_mode": "none", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T12:30:51.234 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_pq_min_cost": "65536", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_public_type": "", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_service_mode": "crc secure", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_tcp_nodelay": "true", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "ms_type": "async+posix", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "no_config_file": "false", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T12:30:51.235 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter_inflight_ops": "1024", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter_timeout": "10.000000", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "objectstore_blackhole": "false", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "openssl_engine_opts": "", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T12:30:51.236 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_agent_max_ops": "4", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_agent_slop": "0.020000", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_asio_thread_count": "2", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_backfill_scan_max": "512", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_backfill_scan_min": "64", 2024-04-26T12:30:51.237 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_backoff_on_peering": "false", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_beacon_report_interval": "300", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bench_duration": "30", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_blkin_trace_all": "false", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T12:30:51.238 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_class_update_on_start": "true", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_client_message_cap": "256", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_client_op_priority": "63", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_client_watch_timeout": "30", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_command_max_records": "256", 2024-04-26T12:30:51.239 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_compact_on_start": "false", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_crush_update_on_start": "true", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T12:30:51.240 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_op_order": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_shutdown": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T12:30:51.241 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T12:30:51.242 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_default_notify_timeout": "30", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_enable_op_tracker": "true", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T12:30:51.243 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_fast_info": "true", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_fast_shutdown": "true", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_function_tracing": "false", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_heartbeat_grace": "20", 2024-04-26T12:30:51.244 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_heartbeat_interval": "6", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_heartbeat_stale": "600", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T12:30:51.245 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_journal_size": "5120", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_kill_backfill_at": "0", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_map_cache_size": "50", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_map_dedup": "true", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_map_message_max": "40", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T12:30:51.246 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_attr_name_len": "100", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_attr_size": "0", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_backfills": "1", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_markdown_count": "5", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_markdown_period": "600", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_object_name_len": "2048", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_object_size": "134217728", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T12:30:51.247 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_pgls": "1024", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_push_cost": "8388608", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_push_objects": "10", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_scrubs": "3", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_max_write_size": "90", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T12:30:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_profile": "balanced", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T12:30:51.249 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_memory_base": "805306368", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_memory_target": "4294967296", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_memory_target_autotune": "false", 2024-04-26T12:30:51.250 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_min_recovery_priority": "0", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mon_report_interval": "5", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_num_cache_shards": "32", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_numa_node": "-1", 2024-04-26T12:30:51.251 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_objecter_finishers": "1", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_objectstore": "bluestore", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_objectstore_fuse": "false", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_objectstore_tracing": "false", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_history_duration": "600", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_history_size": "20", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_log_threshold": "5", 2024-04-26T12:30:51.252 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_num_shards": "0", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T12:30:51.253 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_op_thread_timeout": "15", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_open_classes_on_start": "true", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_os_flags": "0", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_peering_op_priority": "255", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_delete_priority": "5", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_log_dups_tracked": "10000", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T12:30:51.254 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_crimson": "false", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T12:30:51.255 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_flags": "0", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_min_size": "0", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_size": "2", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_default_type": "replicated", 2024-04-26T12:30:51.256 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_cost": "20971520", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_max_active": "0", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T12:30:51.257 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_op_priority": "3", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_priority": "5", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_repair_during_recovery": "false", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T12:30:51.258 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_cost": "52428800", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_end_hour": "0", 2024-04-26T12:30:51.259 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_priority": "5", 2024-04-26T12:30:51.260 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_skip_data_digest": "false", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_smart_report_timeout": "5", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_snap_trim_priority": "5", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T12:30:51.261 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_target_transaction_size": "30", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T12:30:51.262 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_tracing": "false", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_use_stale_snap": "false", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_kill_at": "0", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_max_join_drift": "10", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_min": "500", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_min_wait": "0.050000", 2024-04-26T12:30:51.263 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_service_trim_max": "500", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_service_trim_min": "250", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_stash_full_interval": "25", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_trim_max": "500", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "paxos_trim_min": "250", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "perf": "true", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "-", 2024-04-26T12:30:51.264 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrv": "", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "public_bind_addr": "-", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "public_network": "", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "public_network_interface": "", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "qat_compressor_enabled": "false", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "rados_mon_op_timeout": "0", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "rados_osd_op_timeout": "0", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "rados_tracing": "false", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_atime_update_interval": "60", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T12:30:51.265 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_cache": "true", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_cache_policy": "writearound", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_cache_size": "33554432", 2024-04-26T12:30:51.266 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_compression_hint": "none", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_clone_format": "auto", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_data_pool": "", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_features": "61", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_format": "2", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_map_options": "", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_order": "22", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_pool": "rbd", 2024-04-26T12:30:51.267 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_stripe_count": "0", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_io_scheduler": "simple", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T12:30:51.268 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_order": "24", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_pool": "", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_journal_splay_width": "4", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T12:30:51.269 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T12:30:51.270 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T12:30:51.271 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_op_threads": "1", 2024-04-26T12:30:51.272 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_plugins": "", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T12:30:51.273 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T12:30:51.274 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_tracing": "false", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_validate_names": "true", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_validate_pool": "true", 2024-04-26T12:30:51.275 INFO:teuthology.orchestra.run.smithi038.stdout: "restapi_base_url": "", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "restapi_log_level": "", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_admin_entry": "admin", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_backend_store": "rados", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_barbican_url": "", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_beast_enable_async": "true", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T12:30:51.276 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_cache_enabled": "true", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_config_store": "rados", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_content_length_compat": "false", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_cross_domain_policy": "", 2024-04-26T12:30:51.277 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T12:30:51.278 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T12:30:51.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T12:30:51.280 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T12:30:51.281 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_data_log_window": "30", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T12:30:51.282 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T12:30:51.283 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dns_name": "", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dns_s3website_name": "", 2024-04-26T12:30:51.284 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_enable_ops_log": "false", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_enable_static_website": "false", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_enable_usage_log": "false", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T12:30:51.285 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_expose_bucket": "false", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_extended_http_attrs": "", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_filter": "none", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_gc_max_objs": "32", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T12:30:51.286 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_init_timeout": "300", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T12:30:51.287 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_admin_password": "", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_admin_project": "", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_admin_token": "", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_admin_user": "", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_api_version": "2", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T12:30:51.288 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_url": "", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T12:30:51.289 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_lc_max_objs": "32", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_lc_max_worker": "3", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T12:30:51.290 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_log_http_headers": "", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_attr_size": "0", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T12:30:51.291 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_listing_results": "1000", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_notify_retries": "10", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T12:30:51.292 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T12:30:51.293 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T12:30:51.294 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_num_control_oids": "8", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_numa_node": "-1", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_op_tracing": "false", 2024-04-26T12:30:51.295 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_opa_token": "", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_opa_url": "", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ops_log_rados": "false", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T12:30:51.296 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_print_continue": "true", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_rados_tracing": "false", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_realm": "", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_realm_id": "", 2024-04-26T12:30:51.297 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_region": "", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_request_uri": "", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T12:30:51.298 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_resolve_cname": "false", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_run_sync_thread": "true", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T12:30:51.299 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_script_uri": "", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_service_provider_name": "", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sts_client_id": "", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sts_client_secret": "", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sts_entry": "sts", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sts_key": "sts", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T12:30:51.300 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_auth_url": "", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_custom_header": "", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_need_stats": "true", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_tenant_name": "", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_url": "", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T12:30:51.301 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_lease_period": "120", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T12:30:51.302 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_thread_pool_size": "512", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_torrent_comment": "", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_torrent_createby": "", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_torrent_encoding": "", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_torrent_flag": "false", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_torrent_origin": "", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_torrent_tracker": "", 2024-04-26T12:30:51.303 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_usage_max_shards": "32", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_use_opa_authz": "false", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T12:30:51.304 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_user_unique_email": "true", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_verify_ssl": "true", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_zone": "", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_zone_id": "", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_zonegroup": "", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_zonegroup_id": "", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T12:30:51.305 INFO:teuthology.orchestra.run.smithi038.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_block_size": "4096", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T12:30:51.306 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_partition_filters": "false", 2024-04-26T12:30:51.307 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_perf": "false", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "run_dir": "/var/run/ceph", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_block_create": "true", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_device_size": "53687091200", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T12:30:51.308 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_main_device_type": "SSD", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "seastore_segment_size": "67108864", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "set_keepcaps": "false", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "setgroup": "", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "setuser": "", 2024-04-26T12:30:51.309 INFO:teuthology.orchestra.run.smithi038.stdout: "setuser_match_path": "", 2024-04-26T12:30:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T12:30:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "thp": "false", 2024-04-26T12:30:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "threadpool_default_timeout": "60", 2024-04-26T12:30:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T12:30:51.310 INFO:teuthology.orchestra.run.smithi038.stdout: "throttler_perf_counter": "true" 2024-04-26T12:30:51.310 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-26T12:30:51.312 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T12:30:51.472 INFO:teuthology.orchestra.run.smithi038.stdout:mon.a: {} 2024-04-26T12:30:51.482 INFO:teuthology.orchestra.run.smithi038.stdout:mon.b: {} 2024-04-26T12:30:51.493 INFO:teuthology.orchestra.run.smithi038.stdout:mon.c: {} 2024-04-26T12:30:51.494 INFO:teuthology.orchestra.run.smithi038.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:30:51.494 INFO:teuthology.orchestra.run.smithi038.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:30:51.494 INFO:teuthology.orchestra.run.smithi038.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:30:51.507 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T12:30:51.507 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T12:30:51.530 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T12:30:51.530 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-26T12:30:51.530 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T12:30:51.530 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T12:30:51.530 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:51.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:51.531 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-04-26T12:30:51.531 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T12:30:51.531 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:30:51.531 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:30:51.532 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T12:30:51.532 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T12:30:51.532 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:30:51.533 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T12:30:51.533 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:30:51.533 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T12:30:51.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:30:51.535 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:51.532+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:51.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:51.555 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2024-04-26T12:30:51.633 INFO:teuthology.orchestra.run.smithi038.stderr:Cannot find device "ceph-brx" 2024-04-26T12:30:51.633 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:51.632+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:51.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:30:51.635 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T12:30:51.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T12:30:51.676 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:30:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:30:51.677 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:30:51.677 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:30:51.687 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:30:51.712 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:30:51.734 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:30:51.735 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:51.733+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:51.773 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:30:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:30:51.775 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:30:51.776 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:30:51.815 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:51.815 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:51.826 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:30:51.836 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:51.834+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:51.936 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:51.935+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:51.994 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:51.994 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:52.005 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:30:52.049 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:52.048+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:52.087 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:30:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:30:52.103 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:30:52.108 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T12:30:52.125 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T12:30:52.125 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T12:30:52.125 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2024-04-26T12:30:52.125 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T12:30:52.125 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:52.126 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T12:30:52.126 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T12:30:52.126 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T12:30:52.126 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T12:30:52.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:52.126 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2024-04-26T12:30:52.138 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:52.137+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:52.150 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:52.151 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:52.161 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:30:52.184 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T12:30:52.184 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T12:30:52.184 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T12:30:52.184 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-04-26T12:30:52.184 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-26T12:30:52.185 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42274sec preferred_lft 42274sec 2024-04-26T12:30:52.186 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2024-04-26T12:30:52.186 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2024-04-26T12:30:52.186 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T12:30:52.186 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2024-04-26T12:30:52.186 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2024-04-26T12:30:52.186 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T12:30:52.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:52.187 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-04-26T12:30:52.187 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-04-26T12:30:52.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add name ceph-brx type bridge 2024-04-26T12:30:52.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr flush dev ceph-brx 2024-04-26T12:30:52.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set ceph-brx up 2024-04-26T12:30:52.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T12:30:52.187 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-04-26T12:30:52.238 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:52.238+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:52.329 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:52.330 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:52.339 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:52.338+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:52.340 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:30:52.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:52.369 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T12:30:52.401 INFO:teuthology.orchestra.run.smithi038.stdout:1 2024-04-26T12:30:52.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:52.403 DEBUG:teuthology.orchestra.run.smithi038:> route 2024-04-26T12:30:52.440 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:52.438+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:52.467 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:52.467 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:52.477 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:30:52.480 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2024-04-26T12:30:52.480 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T12:30:52.480 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T12:30:52.480 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T12:30:52.480 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T12:30:52.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:52.481 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-04-26T12:30:52.481 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-04-26T12:30:52.481 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T12:30:52.481 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T12:30:52.481 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T12:30:52.481 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-04-26T12:30:52.540 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:52.539+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:52.618 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:52.618 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:52.628 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:30:52.670 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:52.669+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:52.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:52.718 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-04-26T12:30:52.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:52.740 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2024-04-26T12:30:52.741 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:52.741+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:52.799 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:52.799 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:52.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:52.802 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-04-26T12:30:52.802 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-04-26T12:30:52.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T12:30:52.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T12:30:52.802 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-04-26T12:30:52.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:30:52.842 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:52.841+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:52.913 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T12:30:52.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:52.914 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-04-26T12:30:52.914 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-04-26T12:30:52.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T12:30:52.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T12:30:52.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T12:30:52.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T12:30:52.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T12:30:52.914 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-04-26T12:30:52.943 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:52.942+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:52.977 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:52.977 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:52.987 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:30:53.044 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:53.044+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:53.088 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:30:53.103 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:30:53.128 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:53.128 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:53.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:53.129 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2024-04-26T12:30:53.129 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2024-04-26T12:30:53.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2024-04-26T12:30:53.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T12:30:53.130 DEBUG:teuthology.orchestra.run.smithi038:> ') 2024-04-26T12:30:53.138 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:30:53.145 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:53.144+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:53.245 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:53.244+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:53.267 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:53.268 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:53.275 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T12:30:53.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T12:30:53.276 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:53.278 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:30:53.296 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T12:30:53.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T12:30:53.297 DEBUG:teuthology.orchestra.run.smithi038:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:53.346 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:53.346+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:53.355 DEBUG:teuthology.orchestra.run.smithi038:> sudo modprobe fuse 2024-04-26T12:30:53.406 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:53.406 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:53.416 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:30:53.426 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T12:30:53.426 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T12:30:53.460 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:53.459+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:53.498 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T12:30:53.500 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T12:30:53.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:53.501 DEBUG:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2024-04-26T12:30:53.549 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:53.547+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:53.556 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:53.556 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:53.560 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T12:30:53.561 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T12:30:53.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:30:53.603 DEBUG:teuthology.orchestra.run.smithi038:> sudo modprobe fuse 2024-04-26T12:30:53.637 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T12:30:53.637 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T12:30:53.650 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:53.649+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:53.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:2024-04-26T12:30:53.708+0000 7f810bb195c0 -1 init, newargv = 0x5600c3c8a000 newargc=15 2024-04-26T12:30:53.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:ceph-fuse[43891]: starting ceph client 2024-04-26T12:30:53.710 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T12:30:53.711 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T12:30:53.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:53.712 DEBUG:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2024-04-26T12:30:53.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:ceph-fuse[43891]: starting fuse 2024-04-26T12:30:53.732 INFO:teuthology.orchestra.run.smithi038.stdout:47 2024-04-26T12:30:53.732 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> import glob 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> import re 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> import os 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> import subprocess 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> def _find_admin_socket(client_name): 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> files = glob.glob(asok_path) 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> # Given a non-glob path, it better be there 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> if "*" not in asok_path: 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> assert(len(files) == 1) 2024-04-26T12:30:53.733 DEBUG:teuthology.orchestra.run.smithi038:> return files[0] 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> for f in files: 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> contents = proc_f.read() 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> if mountpoint in contents: 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> return f 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> 2024-04-26T12:30:53.734 DEBUG:teuthology.orchestra.run.smithi038:> print(_find_admin_socket("client.0")) 2024-04-26T12:30:53.735 DEBUG:teuthology.orchestra.run.smithi038:> ' 2024-04-26T12:30:53.737 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:53.737 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:53.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:30:53.750 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:53.750+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:53.795 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:30:53.851 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:53.850+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:53.871 INFO:teuthology.orchestra.run.smithi038.stdout:/var/run/ceph/ceph-client.0.43891.asok 2024-04-26T12:30:53.875 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:53.875 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:53.885 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:30:53.952 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:53.951+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:53.960 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:30:53.981 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:30:54.003 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:30:54.004 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:30:54.021 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:30:54.021 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:30:54.021 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:30:54.022 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:30:54.032 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:30:54.051 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43891.asok 2024-04-26T12:30:54.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:54.054 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43891.asok status 2024-04-26T12:30:54.073 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:54.072+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:54.102 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:30:54.103 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:30:54.120 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:30:54.120 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:54.156 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:54.155+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:54.200 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:30:54.200 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:30:54.200 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:30:54.200 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:30:54.200 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:30:54.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": { 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_sha1": "dc093b5e41f728edab6e0330295fdf9156d31664", 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 18.2.2-1256-gdc093b5e (dc093b5e41f728edab6e0330295fdf9156d31664) reef (stable)", 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "entity_id": "0", 2024-04-26T12:30:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": "smithi038", 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "pid": "43891", 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "root": "/" 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_count": 0, 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_pinned_count": 0, 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4532, 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "inst": { 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "name": { 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "client", 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "num": 4532 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2024-04-26T12:30:54.233 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "192.168.0.1:0", 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 2928252043 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "192.168.0.1:0", 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 2928252043 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "inst_str": "client.4532 192.168.0.1:0/2928252043", 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "addr_str": "192.168.0.1:0/2928252043", 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "inode_count": 1, 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_epoch": 6, 2024-04-26T12:30:54.234 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch": 17, 2024-04-26T12:30:54.235 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch_barrier": 0, 2024-04-26T12:30:54.235 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklisted": false, 2024-04-26T12:30:54.235 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs" 2024-04-26T12:30:54.235 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-26T12:30:54.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:54.245 DEBUG:teuthology.orchestra.run.smithi038:> stat --file-system '--printf=%T 2024-04-26T12:30:54.245 DEBUG:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:54.258 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:54.256+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:54.266 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2024-04-26T12:30:54.266 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:54.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:30:54.266 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:54.338 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T12:30:54.352 INFO:tasks.workunit:Pulling workunits from ref 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T12:30:54.352 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T12:30:54.352 INFO:tasks.workunit:timeout=3h 2024-04-26T12:30:54.352 INFO:tasks.workunit:cleanup=True 2024-04-26T12:30:54.353 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:54.355 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:30:54.355 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:30:54.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.048423959000001, 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.356 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.357 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.357 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:30:54.357 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.357 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.358 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:30:54.358 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.358 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.358 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.359 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:30:54.359 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.359 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.359 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.359 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.359 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:30:54.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:30:54.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.360 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.360 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.360 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:30:54.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:30:54.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.361 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:30:54.361 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:30:54.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.362 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:30:54.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:30:54.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.362 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.363 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.364 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:30:54.364 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:30:54.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.364 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.364 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:30:54.364 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:30:54.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.366 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.366 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:30:54.366 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.735167797999999, 2024-04-26T12:30:54.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:30:54.366 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.366 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.366 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:30:54.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:30:54.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:30:54.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:30:54.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.735126119, 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:30:54.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:30:54.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:30:54.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.735097339999999, 2024-04-26T12:30:54.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:54.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:30:54.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:30:54.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:30:54.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:30:54.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.386 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.735067692000001, 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:30:54.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:30:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.393 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.735028878000001, 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:30:54.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:30:54.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:30:54.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.73500009, 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:30:54.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:30:54.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:30:54.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:30:54.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:30:54.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:30:54.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:30:54.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:30:54.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:30:54.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:30:54.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:30:54.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:30:54.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:30:54.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:30:54.410 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.410 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.410 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.411 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.411 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:30:54.411 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734972948999999, 2024-04-26T12:30:54.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:30:54.411 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.411 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.412 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:30:54.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:30:54.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:30:54.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:30:54.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:30:54.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:30:54.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:30:54.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:30:54.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:30:54.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:30:54.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:30:54.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:30:54.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.427 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734931229000001, 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.428 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:54.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:54.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:54.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:30:54.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:30:54.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:30:54.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:30:54.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:30:54.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:30:54.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:30:54.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:30:54.436 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734888112, 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:30:54.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:30:54.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734869425999999, 2024-04-26T12:30:54.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:54.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:30:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:30:54.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734846557000001, 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:30:54.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734815675, 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.456 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:30:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:30:54.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734798204000001, 2024-04-26T12:30:54.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:30:54.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:54.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734775468999999, 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.474 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734745926999999, 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:30:54.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:30:54.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:30:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:30:54.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734720485, 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:30:54.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:30:54.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:30:54.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734691319, 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:30:54.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:30:54.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:30:54.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734677393999998, 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:30:54.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 21.734660058999999, 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:30:54.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.504 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.505 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.505 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:54.505 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:54.505 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:30:54.505 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:30:54.507 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:54.506+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:54.525 INFO:teuthology.orchestra.run.smithi038.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:54.525 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-26T12:30:54.525 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 2fh/47d Inode: 1 Links: 2 2024-04-26T12:30:54.525 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:30:54.525 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-26T12:30:54.525 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T12:30:54.526 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2024-04-26 12:30:32.598153789 +0000 2024-04-26T12:30:54.526 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2024-04-26 12:30:54.336157477 +0000 2024-04-26T12:30:54.526 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2024-04-26T12:30:54.526 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T12:30:54.526 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T12:30:54.559 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:54.562 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:30:54.570 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-26T12:30:54.096082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81640,"kb_used_data":556,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033880,"statfs":{"total":289910292480,"available":289826693120,"internally_reserved":0,"allocated":569344,"data_stored":1322490,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.124292"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613749+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:30:33.613749+0000","last_peered":"2024-04-26T12:30:33.613749+0000","last_clean":"2024-04-26T12:30:33.613749+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:30:33.613749+0000","last_undegraded":"2024-04-26T12:30:33.613749+0000","last_fullsized":"2024-04-26T12:30:33.613749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613688+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:30:33.613688+0000","last_peered":"2024-04-26T12:30:33.613688+0000","last_clean":"2024-04-26T12:30:33.613688+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:30:33.613688+0000","last_undegraded":"2024-04-26T12:30:33.613688+0000","last_fullsized":"2024-04-26T12:30:33.613688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614359+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:30:33.614359+0000","last_peered":"2024-04-26T12:30:33.614359+0000","last_clean":"2024-04-26T12:30:33.614359+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:30:33.614359+0000","last_undegraded":"2024-04-26T12:30:33.614359+0000","last_fullsized":"2024-04-26T12:30:33.614359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614425+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:30:33.614425+0000","last_peered":"2024-04-26T12:30:33.614425+0000","last_clean":"2024-04-26T12:30:33.614425+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:30:33.614425+0000","last_undegraded":"2024-04-26T12:30:33.614425+0000","last_fullsized":"2024-04-26T12:30:33.614425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613283+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:30:33.613283+0000","last_peered":"2024-04-26T12:30:33.613283+0000","last_clean":"2024-04-26T12:30:33.613283+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:30:33.613283+0000","last_undegraded":"2024-04-26T12:30:33.613283+0000","last_fullsized":"2024-04-26T12:30:33.613283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613479+0000","last_change":"2024-04-26T12:30:32.614596+0000","last_active":"2024-04-26T12:30:33.613479+0000","last_peered":"2024-04-26T12:30:33.613479+0000","last_clean":"2024-04-26T12:30:33.613479+0000","last_became_active":"2024-04-26T12:30:32.613418+0000","last_became_peered":"2024-04-26T12:30:32.613418+0000","last_unstale":"2024-04-26T12:30:33.613479+0000","last_undegraded":"2024-04-26T12:30:33.613479+0000","last_fullsized":"2024-04-26T12:30:33.613479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:32.926352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613744+0000","last_change":"2024-04-26T12:30:32.614280+0000","last_active":"2024-04-26T12:30:33.613744+0000","last_peered":"2024-04-26T12:30:33.613744+0000","last_clean":"2024-04-26T12:30:33.613744+0000","last_became_active":"2024-04-26T12:30:32.613382+0000","last_became_peered":"2024-04-26T12:30:32.613382+0000","last_unstale":"2024-04-26T12:30:33.613744+0000","last_undegraded":"2024-04-26T12:30:33.613744+0000","last_fullsized":"2024-04-26T12:30:33.613744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613306+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:30:33.613306+0000","last_peered":"2024-04-26T12:30:33.613306+0000","last_clean":"2024-04-26T12:30:33.613306+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:30:33.613306+0000","last_undegraded":"2024-04-26T12:30:33.613306+0000","last_fullsized":"2024-04-26T12:30:33.613306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641132+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:30:34.641132+0000","last_peered":"2024-04-26T12:30:34.641132+0000","last_clean":"2024-04-26T12:30:34.641132+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:30:34.641132+0000","last_undegraded":"2024-04-26T12:30:34.641132+0000","last_fullsized":"2024-04-26T12:30:34.641132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613769+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:30:33.613769+0000","last_peered":"2024-04-26T12:30:33.613769+0000","last_clean":"2024-04-26T12:30:33.613769+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:30:33.613769+0000","last_undegraded":"2024-04-26T12:30:33.613769+0000","last_fullsized":"2024-04-26T12:30:33.613769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614206+0000","last_change":"2024-04-26T12:30:32.616474+0000","last_active":"2024-04-26T12:30:33.614206+0000","last_peered":"2024-04-26T12:30:33.614206+0000","last_clean":"2024-04-26T12:30:33.614206+0000","last_became_active":"2024-04-26T12:30:32.615780+0000","last_became_peered":"2024-04-26T12:30:32.615780+0000","last_unstale":"2024-04-26T12:30:33.614206+0000","last_undegraded":"2024-04-26T12:30:33.614206+0000","last_fullsized":"2024-04-26T12:30:33.614206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.298182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613314+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:30:33.613314+0000","last_peered":"2024-04-26T12:30:33.613314+0000","last_clean":"2024-04-26T12:30:33.613314+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:30:33.613314+0000","last_undegraded":"2024-04-26T12:30:33.613314+0000","last_fullsized":"2024-04-26T12:30:33.613314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613096+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:30:33.613096+0000","last_peered":"2024-04-26T12:30:33.613096+0000","last_clean":"2024-04-26T12:30:33.613096+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:30:33.613096+0000","last_undegraded":"2024-04-26T12:30:33.613096+0000","last_fullsized":"2024-04-26T12:30:33.613096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613926+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:30:33.613926+0000","last_peered":"2024-04-26T12:30:33.613926+0000","last_clean":"2024-04-26T12:30:33.613926+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:30:33.613926+0000","last_undegraded":"2024-04-26T12:30:33.613926+0000","last_fullsized":"2024-04-26T12:30:33.613926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613728+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:30:33.613728+0000","last_peered":"2024-04-26T12:30:33.613728+0000","last_clean":"2024-04-26T12:30:33.613728+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:30:33.613728+0000","last_undegraded":"2024-04-26T12:30:33.613728+0000","last_fullsized":"2024-04-26T12:30:33.613728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613416+0000","last_change":"2024-04-26T12:30:32.619340+0000","last_active":"2024-04-26T12:30:33.613416+0000","last_peered":"2024-04-26T12:30:33.613416+0000","last_clean":"2024-04-26T12:30:33.613416+0000","last_became_active":"2024-04-26T12:30:32.616781+0000","last_became_peered":"2024-04-26T12:30:32.616781+0000","last_unstale":"2024-04-26T12:30:33.613416+0000","last_undegraded":"2024-04-26T12:30:33.613416+0000","last_fullsized":"2024-04-26T12:30:33.613416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:30.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641153+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:30:34.641153+0000","last_peered":"2024-04-26T12:30:34.641153+0000","last_clean":"2024-04-26T12:30:34.641153+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:30:34.641153+0000","last_undegraded":"2024-04-26T12:30:34.641153+0000","last_fullsized":"2024-04-26T12:30:34.641153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614070+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:30:33.614070+0000","last_peered":"2024-04-26T12:30:33.614070+0000","last_clean":"2024-04-26T12:30:33.614070+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:30:33.614070+0000","last_undegraded":"2024-04-26T12:30:33.614070+0000","last_fullsized":"2024-04-26T12:30:33.614070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641094+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:30:34.641094+0000","last_peered":"2024-04-26T12:30:34.641094+0000","last_clean":"2024-04-26T12:30:34.641094+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:30:34.641094+0000","last_undegraded":"2024-04-26T12:30:34.641094+0000","last_fullsized":"2024-04-26T12:30:34.641094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614333+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:30:33.614333+0000","last_peered":"2024-04-26T12:30:33.614333+0000","last_clean":"2024-04-26T12:30:33.614333+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:30:33.614333+0000","last_undegraded":"2024-04-26T12:30:33.614333+0000","last_fullsized":"2024-04-26T12:30:33.614333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613733+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:30:33.613733+0000","last_peered":"2024-04-26T12:30:33.613733+0000","last_clean":"2024-04-26T12:30:33.613733+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:30:33.613733+0000","last_undegraded":"2024-04-26T12:30:33.613733+0000","last_fullsized":"2024-04-26T12:30:33.613733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613025+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:30:33.613025+0000","last_peered":"2024-04-26T12:30:33.613025+0000","last_clean":"2024-04-26T12:30:33.613025+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:30:33.613025+0000","last_undegraded":"2024-04-26T12:30:33.613025+0000","last_fullsized":"2024-04-26T12:30:33.613025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640404+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:30:34.640404+0000","last_peered":"2024-04-26T12:30:34.640404+0000","last_clean":"2024-04-26T12:30:34.640404+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:30:34.640404+0000","last_undegraded":"2024-04-26T12:30:34.640404+0000","last_fullsized":"2024-04-26T12:30:34.640404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613088+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:30:33.613088+0000","last_peered":"2024-04-26T12:30:33.613088+0000","last_clean":"2024-04-26T12:30:33.613088+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:30:33.613088+0000","last_undegraded":"2024-04-26T12:30:33.613088+0000","last_fullsized":"2024-04-26T12:30:33.613088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613910+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:30:33.613910+0000","last_peered":"2024-04-26T12:30:33.613910+0000","last_clean":"2024-04-26T12:30:33.613910+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:30:33.613910+0000","last_undegraded":"2024-04-26T12:30:33.613910+0000","last_fullsized":"2024-04-26T12:30:33.613910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641161+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:30:34.641161+0000","last_peered":"2024-04-26T12:30:34.641161+0000","last_clean":"2024-04-26T12:30:34.641161+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:30:34.641161+0000","last_undegraded":"2024-04-26T12:30:34.641161+0000","last_fullsized":"2024-04-26T12:30:34.641161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614220+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:30:33.614220+0000","last_peered":"2024-04-26T12:30:33.614220+0000","last_clean":"2024-04-26T12:30:33.614220+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:30:33.614220+0000","last_undegraded":"2024-04-26T12:30:33.614220+0000","last_fullsized":"2024-04-26T12:30:33.614220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613168+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:30:33.613168+0000","last_peered":"2024-04-26T12:30:33.613168+0000","last_clean":"2024-04-26T12:30:33.613168+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:33.613168+0000","last_undegraded":"2024-04-26T12:30:33.613168+0000","last_fullsized":"2024-04-26T12:30:33.613168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613699+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:30:33.613699+0000","last_peered":"2024-04-26T12:30:33.613699+0000","last_clean":"2024-04-26T12:30:33.613699+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:30:33.613699+0000","last_undegraded":"2024-04-26T12:30:33.613699+0000","last_fullsized":"2024-04-26T12:30:33.613699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640503+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:30:34.640503+0000","last_peered":"2024-04-26T12:30:34.640503+0000","last_clean":"2024-04-26T12:30:34.640503+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:30:34.640503+0000","last_undegraded":"2024-04-26T12:30:34.640503+0000","last_fullsized":"2024-04-26T12:30:34.640503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640234+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:30:34.640234+0000","last_peered":"2024-04-26T12:30:34.640234+0000","last_clean":"2024-04-26T12:30:34.640234+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:30:34.640234+0000","last_undegraded":"2024-04-26T12:30:34.640234+0000","last_fullsized":"2024-04-26T12:30:34.640234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614142+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:30:33.614142+0000","last_peered":"2024-04-26T12:30:33.614142+0000","last_clean":"2024-04-26T12:30:33.614142+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:30:33.614142+0000","last_undegraded":"2024-04-26T12:30:33.614142+0000","last_fullsized":"2024-04-26T12:30:33.614142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641363+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:30:34.641363+0000","last_peered":"2024-04-26T12:30:34.641363+0000","last_clean":"2024-04-26T12:30:34.641363+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:30:34.641363+0000","last_undegraded":"2024-04-26T12:30:34.641363+0000","last_fullsized":"2024-04-26T12:30:34.641363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640252+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:30:34.640252+0000","last_peered":"2024-04-26T12:30:34.640252+0000","last_clean":"2024-04-26T12:30:34.640252+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:30:34.640252+0000","last_undegraded":"2024-04-26T12:30:34.640252+0000","last_fullsized":"2024-04-26T12:30:34.640252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614092+0000","last_change":"2024-04-26T12:30:32.163546+0000","last_active":"2024-04-26T12:30:33.614092+0000","last_peered":"2024-04-26T12:30:33.614092+0000","last_clean":"2024-04-26T12:30:33.614092+0000","last_became_active":"2024-04-26T12:30:32.163231+0000","last_became_peered":"2024-04-26T12:30:32.163231+0000","last_unstale":"2024-04-26T12:30:33.614092+0000","last_undegraded":"2024-04-26T12:30:33.614092+0000","last_fullsized":"2024-04-26T12:30:33.614092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640548+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:30:34.640548+0000","last_peered":"2024-04-26T12:30:34.640548+0000","last_clean":"2024-04-26T12:30:34.640548+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:30:34.640548+0000","last_undegraded":"2024-04-26T12:30:34.640548+0000","last_fullsized":"2024-04-26T12:30:34.640548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640519+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:30:34.640519+0000","last_peered":"2024-04-26T12:30:34.640519+0000","last_clean":"2024-04-26T12:30:34.640519+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:30:34.640519+0000","last_undegraded":"2024-04-26T12:30:34.640519+0000","last_fullsized":"2024-04-26T12:30:34.640519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614299+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:30:33.614299+0000","last_peered":"2024-04-26T12:30:33.614299+0000","last_clean":"2024-04-26T12:30:33.614299+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:30:33.614299+0000","last_undegraded":"2024-04-26T12:30:33.614299+0000","last_fullsized":"2024-04-26T12:30:33.614299+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614095+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:30:33.614095+0000","last_peered":"2024-04-26T12:30:33.614095+0000","last_clean":"2024-04-26T12:30:33.614095+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:30:33.614095+0000","last_undegraded":"2024-04-26T12:30:33.614095+0000","last_fullsized":"2024-04-26T12:30:33.614095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613977+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:30:33.613977+0000","last_peered":"2024-04-26T12:30:33.613977+0000","last_clean":"2024-04-26T12:30:33.613977+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:30:33.613977+0000","last_undegraded":"2024-04-26T12:30:33.613977+0000","last_fullsized":"2024-04-26T12:30:33.613977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613519+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:30:33.613519+0000","last_peered":"2024-04-26T12:30:33.613519+0000","last_clean":"2024-04-26T12:30:33.613519+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:30:33.613519+0000","last_undegraded":"2024-04-26T12:30:33.613519+0000","last_fullsized":"2024-04-26T12:30:33.613519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640659+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:30:34.640659+0000","last_peered":"2024-04-26T12:30:34.640659+0000","last_clean":"2024-04-26T12:30:34.640659+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:30:34.640659+0000","last_undegraded":"2024-04-26T12:30:34.640659+0000","last_fullsized":"2024-04-26T12:30:34.640659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613920+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:30:33.613920+0000","last_peered":"2024-04-26T12:30:33.613920+0000","last_clean":"2024-04-26T12:30:33.613920+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:30:33.613920+0000","last_undegraded":"2024-04-26T12:30:33.613920+0000","last_fullsized":"2024-04-26T12:30:33.613920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613180+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:30:33.613180+0000","last_peered":"2024-04-26T12:30:33.613180+0000","last_clean":"2024-04-26T12:30:33.613180+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:30:33.613180+0000","last_undegraded":"2024-04-26T12:30:33.613180+0000","last_fullsized":"2024-04-26T12:30:33.613180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641338+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:30:34.641338+0000","last_peered":"2024-04-26T12:30:34.641338+0000","last_clean":"2024-04-26T12:30:34.641338+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:30:34.641338+0000","last_undegraded":"2024-04-26T12:30:34.641338+0000","last_fullsized":"2024-04-26T12:30:34.641338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613748+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:30:33.613748+0000","last_peered":"2024-04-26T12:30:33.613748+0000","last_clean":"2024-04-26T12:30:33.613748+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:30:33.613748+0000","last_undegraded":"2024-04-26T12:30:33.613748+0000","last_fullsized":"2024-04-26T12:30:33.613748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641478+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:30:34.641478+0000","last_peered":"2024-04-26T12:30:34.641478+0000","last_clean":"2024-04-26T12:30:34.641478+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:30:34.641478+0000","last_undegraded":"2024-04-26T12:30:34.641478+0000","last_fullsized":"2024-04-26T12:30:34.641478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614300+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:30:33.614300+0000","last_peered":"2024-04-26T12:30:33.614300+0000","last_clean":"2024-04-26T12:30:33.614300+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:30:33.614300+0000","last_undegraded":"2024-04-26T12:30:33.614300+0000","last_fullsized":"2024-04-26T12:30:33.614300+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613214+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:30:33.613214+0000","last_peered":"2024-04-26T12:30:33.613214+0000","last_clean":"2024-04-26T12:30:33.613214+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:30:33.613214+0000","last_undegraded":"2024-04-26T12:30:33.613214+0000","last_fullsized":"2024-04-26T12:30:33.613214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613464+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:30:33.613464+0000","last_peered":"2024-04-26T12:30:33.613464+0000","last_clean":"2024-04-26T12:30:33.613464+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:30:33.613464+0000","last_undegraded":"2024-04-26T12:30:33.613464+0000","last_fullsized":"2024-04-26T12:30:33.613464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614330+0000","last_change":"2024-04-26T12:30:32.159189+0000","last_active":"2024-04-26T12:30:33.614330+0000","last_peered":"2024-04-26T12:30:33.614330+0000","last_clean":"2024-04-26T12:30:33.614330+0000","last_became_active":"2024-04-26T12:30:32.158897+0000","last_became_peered":"2024-04-26T12:30:32.158897+0000","last_unstale":"2024-04-26T12:30:33.614330+0000","last_undegraded":"2024-04-26T12:30:33.614330+0000","last_fullsized":"2024-04-26T12:30:33.614330+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613885+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:30:33.613885+0000","last_peered":"2024-04-26T12:30:33.613885+0000","last_clean":"2024-04-26T12:30:33.613885+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:30:33.613885+0000","last_undegraded":"2024-04-26T12:30:33.613885+0000","last_fullsized":"2024-04-26T12:30:33.613885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640992+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:30:34.640992+0000","last_peered":"2024-04-26T12:30:34.640992+0000","last_clean":"2024-04-26T12:30:34.640992+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:30:34.640992+0000","last_undegraded":"2024-04-26T12:30:34.640992+0000","last_fullsized":"2024-04-26T12:30:34.640992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640809+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:30:34.640809+0000","last_peered":"2024-04-26T12:30:34.640809+0000","last_clean":"2024-04-26T12:30:34.640809+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:30:34.640809+0000","last_undegraded":"2024-04-26T12:30:34.640809+0000","last_fullsized":"2024-04-26T12:30:34.640809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614019+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:30:33.614019+0000","last_peered":"2024-04-26T12:30:33.614019+0000","last_clean":"2024-04-26T12:30:33.614019+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:30:33.614019+0000","last_undegraded":"2024-04-26T12:30:33.614019+0000","last_fullsized":"2024-04-26T12:30:33.614019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613501+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:30:33.613501+0000","last_peered":"2024-04-26T12:30:33.613501+0000","last_clean":"2024-04-26T12:30:33.613501+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:30:33.613501+0000","last_undegraded":"2024-04-26T12:30:33.613501+0000","last_fullsized":"2024-04-26T12:30:33.613501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614525+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:30:33.614525+0000","last_peered":"2024-04-26T12:30:33.614525+0000","last_clean":"2024-04-26T12:30:33.614525+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:30:33.614525+0000","last_undegraded":"2024-04-26T12:30:33.614525+0000","last_fullsized":"2024-04-26T12:30:33.614525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612940+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:30:33.612940+0000","last_peered":"2024-04-26T12:30:33.612940+0000","last_clean":"2024-04-26T12:30:33.612940+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:30:33.612940+0000","last_undegraded":"2024-04-26T12:30:33.612940+0000","last_fullsized":"2024-04-26T12:30:33.612940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614223+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:30:33.614223+0000","last_peered":"2024-04-26T12:30:33.614223+0000","last_clean":"2024-04-26T12:30:33.614223+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:30:33.614223+0000","last_undegraded":"2024-04-26T12:30:33.614223+0000","last_fullsized":"2024-04-26T12:30:33.614223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612992+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:30:33.612992+0000","last_peered":"2024-04-26T12:30:33.612992+0000","last_clean":"2024-04-26T12:30:33.612992+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:30:33.612992+0000","last_undegraded":"2024-04-26T12:30:33.612992+0000","last_fullsized":"2024-04-26T12:30:33.612992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641275+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:30:34.641275+0000","last_peered":"2024-04-26T12:30:34.641275+0000","last_clean":"2024-04-26T12:30:34.641275+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:30:34.641275+0000","last_undegraded":"2024-04-26T12:30:34.641275+0000","last_fullsized":"2024-04-26T12:30:34.641275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600450+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:30:32.600450+0000","last_peered":"2024-04-26T12:30:32.600450+0000","last_clean":"2024-04-26T12:30:32.600450+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:30:32.600450+0000","last_undegraded":"2024-04-26T12:30:32.600450+0000","last_fullsized":"2024-04-26T12:30:32.600450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614436+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:30:33.614436+0000","last_peered":"2024-04-26T12:30:33.614436+0000","last_clean":"2024-04-26T12:30:33.614436+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:30:33.614436+0000","last_undegraded":"2024-04-26T12:30:33.614436+0000","last_fullsized":"2024-04-26T12:30:33.614436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613294+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:30:33.613294+0000","last_peered":"2024-04-26T12:30:33.613294+0000","last_clean":"2024-04-26T12:30:33.613294+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:30:33.613294+0000","last_undegraded":"2024-04-26T12:30:33.613294+0000","last_fullsized":"2024-04-26T12:30:33.613294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607913+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:30:32.607913+0000","last_peered":"2024-04-26T12:30:32.607913+0000","last_clean":"2024-04-26T12:30:32.607913+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:30:32.607913+0000","last_undegraded":"2024-04-26T12:30:32.607913+0000","last_fullsized":"2024-04-26T12:30:32.607913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613849+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:30:33.613849+0000","last_peered":"2024-04-26T12:30:33.613849+0000","last_clean":"2024-04-26T12:30:33.613849+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:30:33.613849+0000","last_undegraded":"2024-04-26T12:30:33.613849+0000","last_fullsized":"2024-04-26T12:30:33.613849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641033+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:30:34.641033+0000","last_peered":"2024-04-26T12:30:34.641033+0000","last_clean":"2024-04-26T12:30:34.641033+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:30:34.641033+0000","last_undegraded":"2024-04-26T12:30:34.641033+0000","last_fullsized":"2024-04-26T12:30:34.641033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.599399+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:30:32.599399+0000","last_peered":"2024-04-26T12:30:32.599399+0000","last_clean":"2024-04-26T12:30:32.599399+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:30:32.599399+0000","last_undegraded":"2024-04-26T12:30:32.599399+0000","last_fullsized":"2024-04-26T12:30:32.599399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612917+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:30:33.612917+0000","last_peered":"2024-04-26T12:30:33.612917+0000","last_clean":"2024-04-26T12:30:33.612917+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:30:33.612917+0000","last_undegraded":"2024-04-26T12:30:33.612917+0000","last_fullsized":"2024-04-26T12:30:33.612917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641472+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:30:34.641472+0000","last_peered":"2024-04-26T12:30:34.641472+0000","last_clean":"2024-04-26T12:30:34.641472+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:30:34.641472+0000","last_undegraded":"2024-04-26T12:30:34.641472+0000","last_fullsized":"2024-04-26T12:30:34.641472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.610211+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:30:32.610211+0000","last_peered":"2024-04-26T12:30:32.610211+0000","last_clean":"2024-04-26T12:30:32.610211+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:30:32.610211+0000","last_undegraded":"2024-04-26T12:30:32.610211+0000","last_fullsized":"2024-04-26T12:30:32.610211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607337+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:30:32.607337+0000","last_peered":"2024-04-26T12:30:32.607337+0000","last_clean":"2024-04-26T12:30:32.607337+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:30:32.607337+0000","last_undegraded":"2024-04-26T12:30:32.607337+0000","last_fullsized":"2024-04-26T12:30:32.607337+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640452+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:30:34.640452+0000","last_peered":"2024-04-26T12:30:34.640452+0000","last_clean":"2024-04-26T12:30:34.640452+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:30:34.640452+0000","last_undegraded":"2024-04-26T12:30:34.640452+0000","last_fullsized":"2024-04-26T12:30:34.640452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614485+0000","last_change":"2024-04-26T12:30:32.620556+0000","last_active":"2024-04-26T12:30:33.614485+0000","last_peered":"2024-04-26T12:30:33.614485+0000","last_clean":"2024-04-26T12:30:33.614485+0000","last_became_active":"2024-04-26T12:30:32.620148+0000","last_became_peered":"2024-04-26T12:30:32.620148+0000","last_unstale":"2024-04-26T12:30:33.614485+0000","last_undegraded":"2024-04-26T12:30:33.614485+0000","last_fullsized":"2024-04-26T12:30:33.614485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607350+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:30:32.607350+0000","last_peered":"2024-04-26T12:30:32.607350+0000","last_clean":"2024-04-26T12:30:32.607350+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:30:32.607350+0000","last_undegraded":"2024-04-26T12:30:32.607350+0000","last_fullsized":"2024-04-26T12:30:32.607350+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640248+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:30:34.640248+0000","last_peered":"2024-04-26T12:30:34.640248+0000","last_clean":"2024-04-26T12:30:34.640248+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:30:34.640248+0000","last_undegraded":"2024-04-26T12:30:34.640248+0000","last_fullsized":"2024-04-26T12:30:34.640248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614007+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:30:33.614007+0000","last_peered":"2024-04-26T12:30:33.614007+0000","last_clean":"2024-04-26T12:30:33.614007+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:30:33.614007+0000","last_undegraded":"2024-04-26T12:30:33.614007+0000","last_fullsized":"2024-04-26T12:30:33.614007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.605563+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:30:32.605563+0000","last_peered":"2024-04-26T12:30:32.605563+0000","last_clean":"2024-04-26T12:30:32.605563+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:30:32.605563+0000","last_undegraded":"2024-04-26T12:30:32.605563+0000","last_fullsized":"2024-04-26T12:30:32.605563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640832+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:30:34.640832+0000","last_peered":"2024-04-26T12:30:34.640832+0000","last_clean":"2024-04-26T12:30:34.640832+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:30:34.640832+0000","last_undegraded":"2024-04-26T12:30:34.640832+0000","last_fullsized":"2024-04-26T12:30:34.640832+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613291+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:30:33.613291+0000","last_peered":"2024-04-26T12:30:33.613291+0000","last_clean":"2024-04-26T12:30:33.613291+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:30:33.613291+0000","last_undegraded":"2024-04-26T12:30:33.613291+0000","last_fullsized":"2024-04-26T12:30:33.613291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641247+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:30:34.641247+0000","last_peered":"2024-04-26T12:30:34.641247+0000","last_clean":"2024-04-26T12:30:34.641247+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:30:34.641247+0000","last_undegraded":"2024-04-26T12:30:34.641247+0000","last_fullsized":"2024-04-26T12:30:34.641247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600817+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:30:32.600817+0000","last_peered":"2024-04-26T12:30:32.600817+0000","last_clean":"2024-04-26T12:30:32.600817+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:30:32.600817+0000","last_undegraded":"2024-04-26T12:30:32.600817+0000","last_fullsized":"2024-04-26T12:30:32.600817+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640370+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:30:34.640370+0000","last_peered":"2024-04-26T12:30:34.640370+0000","last_clean":"2024-04-26T12:30:34.640370+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:30:34.640370+0000","last_undegraded":"2024-04-26T12:30:34.640370+0000","last_fullsized":"2024-04-26T12:30:34.640370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.608611+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:30:32.608611+0000","last_peered":"2024-04-26T12:30:32.608611+0000","last_clean":"2024-04-26T12:30:32.608611+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:30:32.608611+0000","last_undegraded":"2024-04-26T12:30:32.608611+0000","last_fullsized":"2024-04-26T12:30:32.608611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.995826+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:30:34.995826+0000","last_peered":"2024-04-26T12:30:34.995826+0000","last_clean":"2024-04-26T12:30:34.995826+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:30:34.995826+0000","last_undegraded":"2024-04-26T12:30:34.995826+0000","last_fullsized":"2024-04-26T12:30:34.995826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613310+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:30:33.613310+0000","last_peered":"2024-04-26T12:30:33.613310+0000","last_clean":"2024-04-26T12:30:33.613310+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:30:33.613310+0000","last_undegraded":"2024-04-26T12:30:33.613310+0000","last_fullsized":"2024-04-26T12:30:33.613310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613412+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:30:33.613412+0000","last_peered":"2024-04-26T12:30:33.613412+0000","last_clean":"2024-04-26T12:30:33.613412+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:30:33.613412+0000","last_undegraded":"2024-04-26T12:30:33.613412+0000","last_fullsized":"2024-04-26T12:30:33.613412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613632+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:30:33.613632+0000","last_peered":"2024-04-26T12:30:33.613632+0000","last_clean":"2024-04-26T12:30:33.613632+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:30:33.613632+0000","last_undegraded":"2024-04-26T12:30:33.613632+0000","last_fullsized":"2024-04-26T12:30:33.613632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614172+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:30:33.614172+0000","last_peered":"2024-04-26T12:30:33.614172+0000","last_clean":"2024-04-26T12:30:33.614172+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:30:33.614172+0000","last_undegraded":"2024-04-26T12:30:33.614172+0000","last_fullsized":"2024-04-26T12:30:33.614172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613790+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:30:33.613790+0000","last_peered":"2024-04-26T12:30:33.613790+0000","last_clean":"2024-04-26T12:30:33.613790+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:30:33.613790+0000","last_undegraded":"2024-04-26T12:30:33.613790+0000","last_fullsized":"2024-04-26T12:30:33.613790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613843+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:30:33.613843+0000","last_peered":"2024-04-26T12:30:33.613843+0000","last_clean":"2024-04-26T12:30:33.613843+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:30:33.613843+0000","last_undegraded":"2024-04-26T12:30:33.613843+0000","last_fullsized":"2024-04-26T12:30:33.613843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612884+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:30:33.612884+0000","last_peered":"2024-04-26T12:30:33.612884+0000","last_clean":"2024-04-26T12:30:33.612884+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:30:33.612884+0000","last_undegraded":"2024-04-26T12:30:33.612884+0000","last_fullsized":"2024-04-26T12:30:33.612884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641370+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:30:34.641370+0000","last_peered":"2024-04-26T12:30:34.641370+0000","last_clean":"2024-04-26T12:30:34.641370+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:30:34.641370+0000","last_undegraded":"2024-04-26T12:30:34.641370+0000","last_fullsized":"2024-04-26T12:30:34.641370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613737+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:30:33.613737+0000","last_peered":"2024-04-26T12:30:33.613737+0000","last_clean":"2024-04-26T12:30:33.613737+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:30:33.613737+0000","last_undegraded":"2024-04-26T12:30:33.613737+0000","last_fullsized":"2024-04-26T12:30:33.613737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613593+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:30:33.613593+0000","last_peered":"2024-04-26T12:30:33.613593+0000","last_clean":"2024-04-26T12:30:33.613593+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:30:33.613593+0000","last_undegraded":"2024-04-26T12:30:33.613593+0000","last_fullsized":"2024-04-26T12:30:33.613593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640266+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:30:34.640266+0000","last_peered":"2024-04-26T12:30:34.640266+0000","last_clean":"2024-04-26T12:30:34.640266+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:30:34.640266+0000","last_undegraded":"2024-04-26T12:30:34.640266+0000","last_fullsized":"2024-04-26T12:30:34.640266+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613341+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:30:33.613341+0000","last_peered":"2024-04-26T12:30:33.613341+0000","last_clean":"2024-04-26T12:30:33.613341+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:30:33.613341+0000","last_undegraded":"2024-04-26T12:30:33.613341+0000","last_fullsized":"2024-04-26T12:30:33.613341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640934+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:30:34.640934+0000","last_peered":"2024-04-26T12:30:34.640934+0000","last_clean":"2024-04-26T12:30:34.640934+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:30:34.640934+0000","last_undegraded":"2024-04-26T12:30:34.640934+0000","last_fullsized":"2024-04-26T12:30:34.640934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613671+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:30:33.613671+0000","last_peered":"2024-04-26T12:30:33.613671+0000","last_clean":"2024-04-26T12:30:33.613671+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:30:33.613671+0000","last_undegraded":"2024-04-26T12:30:33.613671+0000","last_fullsized":"2024-04-26T12:30:33.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":638777,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":135168,"data_stored":45552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":638161,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:54.575 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:54.590 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T12:30:54.608 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:54.608+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:30:54.646 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:30:54.652 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T12:30:54.656 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:30:54.708 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:54.708+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:54.783 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:30:54.783 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:30:54.783 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:30:54.784 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:30:54.784 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:30:54.793 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:30:54.837 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:54.836+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:54.911 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:54.909+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:54.925 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:30:54.925 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:30:54.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:30:54.926 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:30:54.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.926 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.926 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:30:54.926 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.320500825, 2024-04-26T12:30:54.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:30:54.926 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:54.926 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.927 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:54.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:54.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:30:54.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:30:54.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:30:54.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:30:54.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.320440587, 2024-04-26T12:30:54.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:54.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.320407267, 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:54.939 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:30:54.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:30:54.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.320377476000001, 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:30:54.945 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:54.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:30:54.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:30:54.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:30:54.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:54.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:30:54.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:30:54.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:54.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:30:54.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.953 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.953 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:30:54.953 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.320364162000001, 2024-04-26T12:30:54.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:30:54.953 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:54.953 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.954 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:54.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:54.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:30:54.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:30:54.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:54.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:30:54.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:30:54.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:54.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:30:54.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:30:54.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:30:54.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:30:54.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:54.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:30:54.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:30:54.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:54.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:30:54.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:30:54.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:54.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:30:54.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:30:54.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:54.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:30:54.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:30:54.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:30:54.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:30:54.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:30:54.965 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.966 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.320347186999999, 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:54.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:54.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:30:54.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:54.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:30:54.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:30:54.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:54.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:30:54.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:30:54.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:30:54.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:30:54.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:54.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:30:54.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:30:54.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:54.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:30:54.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:30:54.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:54.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:30:54.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:30:54.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:54.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:30:54.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:30:54.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:54.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:30:54.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:30:54.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:54.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:30:54.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:30:54.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:54.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:30:54.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:30:54.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.979 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:54.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.980 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.980 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:30:54.980 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.320280097000001, 2024-04-26T12:30:54.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:30:54.980 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:54.981 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:54.981 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:54.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:54.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:30:54.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:54.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:30:54.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:54.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:54.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:30:54.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:30:54.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:30:54.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:30:54.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.989 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:54.990 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.320249716999999, 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:54.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:54.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:54.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:54.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:30:54.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:54.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:30:54.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:30:54.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:54.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:30:54.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:30:54.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:54.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:30:54.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:30:54.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:54.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.000 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.001 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.320226979000001, 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:30:55.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:30:55.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:30:55.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:30:55.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:30:55.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:30:55.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:30:55.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:30:55.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:30:55.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:30:55.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:30:55.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.010 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.316020891000001, 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.310651107999998, 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.017 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.310470397, 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:30:55.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:30:55.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.021 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.310443552999999, 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:30:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:30:55.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:30:55.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:30:55.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.310403927999999, 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:30:55.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.310330328999999, 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.029 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:30:55.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:30:55.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:30:55.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.308870667000001, 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:30:55.033 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:30:55.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:30:55.037 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.308586411, 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:30:55.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.304053737, 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.303924687999999, 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.045 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:30:55.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:30:55.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.014579359999999, 2024-04-26T12:30:55.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:55.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:55.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:30:55.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:55.054 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:30:55.057 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:30:55.057 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:55.055+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:55.059 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:55.061 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:30:55.061 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-26T12:30:54.973641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81640,"kb_used_data":556,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033880,"statfs":{"total":289910292480,"available":289826693120,"internally_reserved":0,"allocated":569344,"data_stored":1322490,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001318"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613749+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:30:33.613749+0000","last_peered":"2024-04-26T12:30:33.613749+0000","last_clean":"2024-04-26T12:30:33.613749+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:30:33.613749+0000","last_undegraded":"2024-04-26T12:30:33.613749+0000","last_fullsized":"2024-04-26T12:30:33.613749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613688+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:30:33.613688+0000","last_peered":"2024-04-26T12:30:33.613688+0000","last_clean":"2024-04-26T12:30:33.613688+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:30:33.613688+0000","last_undegraded":"2024-04-26T12:30:33.613688+0000","last_fullsized":"2024-04-26T12:30:33.613688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614359+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:30:33.614359+0000","last_peered":"2024-04-26T12:30:33.614359+0000","last_clean":"2024-04-26T12:30:33.614359+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:30:33.614359+0000","last_undegraded":"2024-04-26T12:30:33.614359+0000","last_fullsized":"2024-04-26T12:30:33.614359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614425+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:30:33.614425+0000","last_peered":"2024-04-26T12:30:33.614425+0000","last_clean":"2024-04-26T12:30:33.614425+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:30:33.614425+0000","last_undegraded":"2024-04-26T12:30:33.614425+0000","last_fullsized":"2024-04-26T12:30:33.614425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613283+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:30:33.613283+0000","last_peered":"2024-04-26T12:30:33.613283+0000","last_clean":"2024-04-26T12:30:33.613283+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:30:33.613283+0000","last_undegraded":"2024-04-26T12:30:33.613283+0000","last_fullsized":"2024-04-26T12:30:33.613283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613479+0000","last_change":"2024-04-26T12:30:32.614596+0000","last_active":"2024-04-26T12:30:33.613479+0000","last_peered":"2024-04-26T12:30:33.613479+0000","last_clean":"2024-04-26T12:30:33.613479+0000","last_became_active":"2024-04-26T12:30:32.613418+0000","last_became_peered":"2024-04-26T12:30:32.613418+0000","last_unstale":"2024-04-26T12:30:33.613479+0000","last_undegraded":"2024-04-26T12:30:33.613479+0000","last_fullsized":"2024-04-26T12:30:33.613479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:32.926352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613744+0000","last_change":"2024-04-26T12:30:32.614280+0000","last_active":"2024-04-26T12:30:33.613744+0000","last_peered":"2024-04-26T12:30:33.613744+0000","last_clean":"2024-04-26T12:30:33.613744+0000","last_became_active":"2024-04-26T12:30:32.613382+0000","last_became_peered":"2024-04-26T12:30:32.613382+0000","last_unstale":"2024-04-26T12:30:33.613744+0000","last_undegraded":"2024-04-26T12:30:33.613744+0000","last_fullsized":"2024-04-26T12:30:33.613744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613306+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:30:33.613306+0000","last_peered":"2024-04-26T12:30:33.613306+0000","last_clean":"2024-04-26T12:30:33.613306+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:30:33.613306+0000","last_undegraded":"2024-04-26T12:30:33.613306+0000","last_fullsized":"2024-04-26T12:30:33.613306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641132+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:30:34.641132+0000","last_peered":"2024-04-26T12:30:34.641132+0000","last_clean":"2024-04-26T12:30:34.641132+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:30:34.641132+0000","last_undegraded":"2024-04-26T12:30:34.641132+0000","last_fullsized":"2024-04-26T12:30:34.641132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613769+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:30:33.613769+0000","last_peered":"2024-04-26T12:30:33.613769+0000","last_clean":"2024-04-26T12:30:33.613769+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:30:33.613769+0000","last_undegraded":"2024-04-26T12:30:33.613769+0000","last_fullsized":"2024-04-26T12:30:33.613769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614206+0000","last_change":"2024-04-26T12:30:32.616474+0000","last_active":"2024-04-26T12:30:33.614206+0000","last_peered":"2024-04-26T12:30:33.614206+0000","last_clean":"2024-04-26T12:30:33.614206+0000","last_became_active":"2024-04-26T12:30:32.615780+0000","last_became_peered":"2024-04-26T12:30:32.615780+0000","last_unstale":"2024-04-26T12:30:33.614206+0000","last_undegraded":"2024-04-26T12:30:33.614206+0000","last_fullsized":"2024-04-26T12:30:33.614206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:32.298182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613314+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:30:33.613314+0000","last_peered":"2024-04-26T12:30:33.613314+0000","last_clean":"2024-04-26T12:30:33.613314+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:30:33.613314+0000","last_undegraded":"2024-04-26T12:30:33.613314+0000","last_fullsized":"2024-04-26T12:30:33.613314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613096+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:30:33.613096+0000","last_peered":"2024-04-26T12:30:33.613096+0000","last_clean":"2024-04-26T12:30:33.613096+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:30:33.613096+0000","last_undegraded":"2024-04-26T12:30:33.613096+0000","last_fullsized":"2024-04-26T12:30:33.613096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613926+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:30:33.613926+0000","last_peered":"2024-04-26T12:30:33.613926+0000","last_clean":"2024-04-26T12:30:33.613926+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:30:33.613926+0000","last_undegraded":"2024-04-26T12:30:33.613926+0000","last_fullsized":"2024-04-26T12:30:33.613926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613728+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:30:33.613728+0000","last_peered":"2024-04-26T12:30:33.613728+0000","last_clean":"2024-04-26T12:30:33.613728+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:30:33.613728+0000","last_undegraded":"2024-04-26T12:30:33.613728+0000","last_fullsized":"2024-04-26T12:30:33.613728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613416+0000","last_change":"2024-04-26T12:30:32.619340+0000","last_active":"2024-04-26T12:30:33.613416+0000","last_peered":"2024-04-26T12:30:33.613416+0000","last_clean":"2024-04-26T12:30:33.613416+0000","last_became_active":"2024-04-26T12:30:32.616781+0000","last_became_peered":"2024-04-26T12:30:32.616781+0000","last_unstale":"2024-04-26T12:30:33.613416+0000","last_undegraded":"2024-04-26T12:30:33.613416+0000","last_fullsized":"2024-04-26T12:30:33.613416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:30.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641153+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:30:34.641153+0000","last_peered":"2024-04-26T12:30:34.641153+0000","last_clean":"2024-04-26T12:30:34.641153+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:30:34.641153+0000","last_undegraded":"2024-04-26T12:30:34.641153+0000","last_fullsized":"2024-04-26T12:30:34.641153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614070+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:30:33.614070+0000","last_peered":"2024-04-26T12:30:33.614070+0000","last_clean":"2024-04-26T12:30:33.614070+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:30:33.614070+0000","last_undegraded":"2024-04-26T12:30:33.614070+0000","last_fullsized":"2024-04-26T12:30:33.614070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641094+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:30:34.641094+0000","last_peered":"2024-04-26T12:30:34.641094+0000","last_clean":"2024-04-26T12:30:34.641094+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:30:34.641094+0000","last_undegraded":"2024-04-26T12:30:34.641094+0000","last_fullsized":"2024-04-26T12:30:34.641094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614333+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:30:33.614333+0000","last_peered":"2024-04-26T12:30:33.614333+0000","last_clean":"2024-04-26T12:30:33.614333+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:30:33.614333+0000","last_undegraded":"2024-04-26T12:30:33.614333+0000","last_fullsized":"2024-04-26T12:30:33.614333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613733+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:30:33.613733+0000","last_peered":"2024-04-26T12:30:33.613733+0000","last_clean":"2024-04-26T12:30:33.613733+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:30:33.613733+0000","last_undegraded":"2024-04-26T12:30:33.613733+0000","last_fullsized":"2024-04-26T12:30:33.613733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613025+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:30:33.613025+0000","last_peered":"2024-04-26T12:30:33.613025+0000","last_clean":"2024-04-26T12:30:33.613025+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:30:33.613025+0000","last_undegraded":"2024-04-26T12:30:33.613025+0000","last_fullsized":"2024-04-26T12:30:33.613025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640404+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:30:34.640404+0000","last_peered":"2024-04-26T12:30:34.640404+0000","last_clean":"2024-04-26T12:30:34.640404+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:30:34.640404+0000","last_undegraded":"2024-04-26T12:30:34.640404+0000","last_fullsized":"2024-04-26T12:30:34.640404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613088+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:30:33.613088+0000","last_peered":"2024-04-26T12:30:33.613088+0000","last_clean":"2024-04-26T12:30:33.613088+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:30:33.613088+0000","last_undegraded":"2024-04-26T12:30:33.613088+0000","last_fullsized":"2024-04-26T12:30:33.613088+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613910+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:30:33.613910+0000","last_peered":"2024-04-26T12:30:33.613910+0000","last_clean":"2024-04-26T12:30:33.613910+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:30:33.613910+0000","last_undegraded":"2024-04-26T12:30:33.613910+0000","last_fullsized":"2024-04-26T12:30:33.613910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641161+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:30:34.641161+0000","last_peered":"2024-04-26T12:30:34.641161+0000","last_clean":"2024-04-26T12:30:34.641161+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:30:34.641161+0000","last_undegraded":"2024-04-26T12:30:34.641161+0000","last_fullsized":"2024-04-26T12:30:34.641161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614220+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:30:33.614220+0000","last_peered":"2024-04-26T12:30:33.614220+0000","last_clean":"2024-04-26T12:30:33.614220+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:30:33.614220+0000","last_undegraded":"2024-04-26T12:30:33.614220+0000","last_fullsized":"2024-04-26T12:30:33.614220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613168+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:30:33.613168+0000","last_peered":"2024-04-26T12:30:33.613168+0000","last_clean":"2024-04-26T12:30:33.613168+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:33.613168+0000","last_undegraded":"2024-04-26T12:30:33.613168+0000","last_fullsized":"2024-04-26T12:30:33.613168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613699+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:30:33.613699+0000","last_peered":"2024-04-26T12:30:33.613699+0000","last_clean":"2024-04-26T12:30:33.613699+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:30:33.613699+0000","last_undegraded":"2024-04-26T12:30:33.613699+0000","last_fullsized":"2024-04-26T12:30:33.613699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640503+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:30:34.640503+0000","last_peered":"2024-04-26T12:30:34.640503+0000","last_clean":"2024-04-26T12:30:34.640503+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:30:34.640503+0000","last_undegraded":"2024-04-26T12:30:34.640503+0000","last_fullsized":"2024-04-26T12:30:34.640503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640234+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:30:34.640234+0000","last_peered":"2024-04-26T12:30:34.640234+0000","last_clean":"2024-04-26T12:30:34.640234+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:30:34.640234+0000","last_undegraded":"2024-04-26T12:30:34.640234+0000","last_fullsized":"2024-04-26T12:30:34.640234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614142+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:30:33.614142+0000","last_peered":"2024-04-26T12:30:33.614142+0000","last_clean":"2024-04-26T12:30:33.614142+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:30:33.614142+0000","last_undegraded":"2024-04-26T12:30:33.614142+0000","last_fullsized":"2024-04-26T12:30:33.614142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641363+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:30:34.641363+0000","last_peered":"2024-04-26T12:30:34.641363+0000","last_clean":"2024-04-26T12:30:34.641363+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:30:34.641363+0000","last_undegraded":"2024-04-26T12:30:34.641363+0000","last_fullsized":"2024-04-26T12:30:34.641363+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640252+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:30:34.640252+0000","last_peered":"2024-04-26T12:30:34.640252+0000","last_clean":"2024-04-26T12:30:34.640252+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:30:34.640252+0000","last_undegraded":"2024-04-26T12:30:34.640252+0000","last_fullsized":"2024-04-26T12:30:34.640252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614092+0000","last_change":"2024-04-26T12:30:32.163546+0000","last_active":"2024-04-26T12:30:33.614092+0000","last_peered":"2024-04-26T12:30:33.614092+0000","last_clean":"2024-04-26T12:30:33.614092+0000","last_became_active":"2024-04-26T12:30:32.163231+0000","last_became_peered":"2024-04-26T12:30:32.163231+0000","last_unstale":"2024-04-26T12:30:33.614092+0000","last_undegraded":"2024-04-26T12:30:33.614092+0000","last_fullsized":"2024-04-26T12:30:33.614092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640548+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:30:34.640548+0000","last_peered":"2024-04-26T12:30:34.640548+0000","last_clean":"2024-04-26T12:30:34.640548+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:30:34.640548+0000","last_undegraded":"2024-04-26T12:30:34.640548+0000","last_fullsized":"2024-04-26T12:30:34.640548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640519+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:30:34.640519+0000","last_peered":"2024-04-26T12:30:34.640519+0000","last_clean":"2024-04-26T12:30:34.640519+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:30:34.640519+0000","last_undegraded":"2024-04-26T12:30:34.640519+0000","last_fullsized":"2024-04-26T12:30:34.640519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614299+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:30:33.614299+0000","last_peered":"2024-04-26T12:30:33.614299+0000","last_clean":"2024-04-26T12:30:33.614299+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:30:33.614299+0000","last_undegraded":"2024-04-26T12:30:33.614299+0000","last_fullsized":"2024-04-26T12:30:33.614299+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614095+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:30:33.614095+0000","last_peered":"2024-04-26T12:30:33.614095+0000","last_clean":"2024-04-26T12:30:33.614095+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:30:33.614095+0000","last_undegraded":"2024-04-26T12:30:33.614095+0000","last_fullsized":"2024-04-26T12:30:33.614095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613977+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:30:33.613977+0000","last_peered":"2024-04-26T12:30:33.613977+0000","last_clean":"2024-04-26T12:30:33.613977+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:30:33.613977+0000","last_undegraded":"2024-04-26T12:30:33.613977+0000","last_fullsized":"2024-04-26T12:30:33.613977+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613519+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:30:33.613519+0000","last_peered":"2024-04-26T12:30:33.613519+0000","last_clean":"2024-04-26T12:30:33.613519+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:30:33.613519+0000","last_undegraded":"2024-04-26T12:30:33.613519+0000","last_fullsized":"2024-04-26T12:30:33.613519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640659+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:30:34.640659+0000","last_peered":"2024-04-26T12:30:34.640659+0000","last_clean":"2024-04-26T12:30:34.640659+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:30:34.640659+0000","last_undegraded":"2024-04-26T12:30:34.640659+0000","last_fullsized":"2024-04-26T12:30:34.640659+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613920+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:30:33.613920+0000","last_peered":"2024-04-26T12:30:33.613920+0000","last_clean":"2024-04-26T12:30:33.613920+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:30:33.613920+0000","last_undegraded":"2024-04-26T12:30:33.613920+0000","last_fullsized":"2024-04-26T12:30:33.613920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613180+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:30:33.613180+0000","last_peered":"2024-04-26T12:30:33.613180+0000","last_clean":"2024-04-26T12:30:33.613180+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:30:33.613180+0000","last_undegraded":"2024-04-26T12:30:33.613180+0000","last_fullsized":"2024-04-26T12:30:33.613180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641338+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:30:34.641338+0000","last_peered":"2024-04-26T12:30:34.641338+0000","last_clean":"2024-04-26T12:30:34.641338+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:30:34.641338+0000","last_undegraded":"2024-04-26T12:30:34.641338+0000","last_fullsized":"2024-04-26T12:30:34.641338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613748+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:30:33.613748+0000","last_peered":"2024-04-26T12:30:33.613748+0000","last_clean":"2024-04-26T12:30:33.613748+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:30:33.613748+0000","last_undegraded":"2024-04-26T12:30:33.613748+0000","last_fullsized":"2024-04-26T12:30:33.613748+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641478+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:30:34.641478+0000","last_peered":"2024-04-26T12:30:34.641478+0000","last_clean":"2024-04-26T12:30:34.641478+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:30:34.641478+0000","last_undegraded":"2024-04-26T12:30:34.641478+0000","last_fullsized":"2024-04-26T12:30:34.641478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614300+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:30:33.614300+0000","last_peered":"2024-04-26T12:30:33.614300+0000","last_clean":"2024-04-26T12:30:33.614300+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:30:33.614300+0000","last_undegraded":"2024-04-26T12:30:33.614300+0000","last_fullsized":"2024-04-26T12:30:33.614300+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613214+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:30:33.613214+0000","last_peered":"2024-04-26T12:30:33.613214+0000","last_clean":"2024-04-26T12:30:33.613214+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:30:33.613214+0000","last_undegraded":"2024-04-26T12:30:33.613214+0000","last_fullsized":"2024-04-26T12:30:33.613214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613841+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:30:33.613841+0000","last_peered":"2024-04-26T12:30:33.613841+0000","last_clean":"2024-04-26T12:30:33.613841+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:30:33.613841+0000","last_undegraded":"2024-04-26T12:30:33.613841+0000","last_fullsized":"2024-04-26T12:30:33.613841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613464+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:30:33.613464+0000","last_peered":"2024-04-26T12:30:33.613464+0000","last_clean":"2024-04-26T12:30:33.613464+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:30:33.613464+0000","last_undegraded":"2024-04-26T12:30:33.613464+0000","last_fullsized":"2024-04-26T12:30:33.613464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614330+0000","last_change":"2024-04-26T12:30:32.159189+0000","last_active":"2024-04-26T12:30:33.614330+0000","last_peered":"2024-04-26T12:30:33.614330+0000","last_clean":"2024-04-26T12:30:33.614330+0000","last_became_active":"2024-04-26T12:30:32.158897+0000","last_became_peered":"2024-04-26T12:30:32.158897+0000","last_unstale":"2024-04-26T12:30:33.614330+0000","last_undegraded":"2024-04-26T12:30:33.614330+0000","last_fullsized":"2024-04-26T12:30:33.614330+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613885+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:30:33.613885+0000","last_peered":"2024-04-26T12:30:33.613885+0000","last_clean":"2024-04-26T12:30:33.613885+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:30:33.613885+0000","last_undegraded":"2024-04-26T12:30:33.613885+0000","last_fullsized":"2024-04-26T12:30:33.613885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640992+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:30:34.640992+0000","last_peered":"2024-04-26T12:30:34.640992+0000","last_clean":"2024-04-26T12:30:34.640992+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:30:34.640992+0000","last_undegraded":"2024-04-26T12:30:34.640992+0000","last_fullsized":"2024-04-26T12:30:34.640992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640809+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:30:34.640809+0000","last_peered":"2024-04-26T12:30:34.640809+0000","last_clean":"2024-04-26T12:30:34.640809+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:30:34.640809+0000","last_undegraded":"2024-04-26T12:30:34.640809+0000","last_fullsized":"2024-04-26T12:30:34.640809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614019+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:30:33.614019+0000","last_peered":"2024-04-26T12:30:33.614019+0000","last_clean":"2024-04-26T12:30:33.614019+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:30:33.614019+0000","last_undegraded":"2024-04-26T12:30:33.614019+0000","last_fullsized":"2024-04-26T12:30:33.614019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613501+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:30:33.613501+0000","last_peered":"2024-04-26T12:30:33.613501+0000","last_clean":"2024-04-26T12:30:33.613501+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:30:33.613501+0000","last_undegraded":"2024-04-26T12:30:33.613501+0000","last_fullsized":"2024-04-26T12:30:33.613501+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614525+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:30:33.614525+0000","last_peered":"2024-04-26T12:30:33.614525+0000","last_clean":"2024-04-26T12:30:33.614525+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:30:33.614525+0000","last_undegraded":"2024-04-26T12:30:33.614525+0000","last_fullsized":"2024-04-26T12:30:33.614525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612940+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:30:33.612940+0000","last_peered":"2024-04-26T12:30:33.612940+0000","last_clean":"2024-04-26T12:30:33.612940+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:30:33.612940+0000","last_undegraded":"2024-04-26T12:30:33.612940+0000","last_fullsized":"2024-04-26T12:30:33.612940+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614223+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:30:33.614223+0000","last_peered":"2024-04-26T12:30:33.614223+0000","last_clean":"2024-04-26T12:30:33.614223+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:30:33.614223+0000","last_undegraded":"2024-04-26T12:30:33.614223+0000","last_fullsized":"2024-04-26T12:30:33.614223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612992+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:30:33.612992+0000","last_peered":"2024-04-26T12:30:33.612992+0000","last_clean":"2024-04-26T12:30:33.612992+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:30:33.612992+0000","last_undegraded":"2024-04-26T12:30:33.612992+0000","last_fullsized":"2024-04-26T12:30:33.612992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641275+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:30:34.641275+0000","last_peered":"2024-04-26T12:30:34.641275+0000","last_clean":"2024-04-26T12:30:34.641275+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:30:34.641275+0000","last_undegraded":"2024-04-26T12:30:34.641275+0000","last_fullsized":"2024-04-26T12:30:34.641275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600450+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:30:32.600450+0000","last_peered":"2024-04-26T12:30:32.600450+0000","last_clean":"2024-04-26T12:30:32.600450+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:30:32.600450+0000","last_undegraded":"2024-04-26T12:30:32.600450+0000","last_fullsized":"2024-04-26T12:30:32.600450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614436+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:30:33.614436+0000","last_peered":"2024-04-26T12:30:33.614436+0000","last_clean":"2024-04-26T12:30:33.614436+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:30:33.614436+0000","last_undegraded":"2024-04-26T12:30:33.614436+0000","last_fullsized":"2024-04-26T12:30:33.614436+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613294+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:30:33.613294+0000","last_peered":"2024-04-26T12:30:33.613294+0000","last_clean":"2024-04-26T12:30:33.613294+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:30:33.613294+0000","last_undegraded":"2024-04-26T12:30:33.613294+0000","last_fullsized":"2024-04-26T12:30:33.613294+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607913+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:30:32.607913+0000","last_peered":"2024-04-26T12:30:32.607913+0000","last_clean":"2024-04-26T12:30:32.607913+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:30:32.607913+0000","last_undegraded":"2024-04-26T12:30:32.607913+0000","last_fullsized":"2024-04-26T12:30:32.607913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613849+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:30:33.613849+0000","last_peered":"2024-04-26T12:30:33.613849+0000","last_clean":"2024-04-26T12:30:33.613849+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:30:33.613849+0000","last_undegraded":"2024-04-26T12:30:33.613849+0000","last_fullsized":"2024-04-26T12:30:33.613849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641033+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:30:34.641033+0000","last_peered":"2024-04-26T12:30:34.641033+0000","last_clean":"2024-04-26T12:30:34.641033+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:30:34.641033+0000","last_undegraded":"2024-04-26T12:30:34.641033+0000","last_fullsized":"2024-04-26T12:30:34.641033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.599399+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:30:32.599399+0000","last_peered":"2024-04-26T12:30:32.599399+0000","last_clean":"2024-04-26T12:30:32.599399+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:30:32.599399+0000","last_undegraded":"2024-04-26T12:30:32.599399+0000","last_fullsized":"2024-04-26T12:30:32.599399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612917+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:30:33.612917+0000","last_peered":"2024-04-26T12:30:33.612917+0000","last_clean":"2024-04-26T12:30:33.612917+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:30:33.612917+0000","last_undegraded":"2024-04-26T12:30:33.612917+0000","last_fullsized":"2024-04-26T12:30:33.612917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641472+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:30:34.641472+0000","last_peered":"2024-04-26T12:30:34.641472+0000","last_clean":"2024-04-26T12:30:34.641472+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:30:34.641472+0000","last_undegraded":"2024-04-26T12:30:34.641472+0000","last_fullsized":"2024-04-26T12:30:34.641472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.610211+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:30:32.610211+0000","last_peered":"2024-04-26T12:30:32.610211+0000","last_clean":"2024-04-26T12:30:32.610211+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:30:32.610211+0000","last_undegraded":"2024-04-26T12:30:32.610211+0000","last_fullsized":"2024-04-26T12:30:32.610211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607337+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:30:32.607337+0000","last_peered":"2024-04-26T12:30:32.607337+0000","last_clean":"2024-04-26T12:30:32.607337+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:30:32.607337+0000","last_undegraded":"2024-04-26T12:30:32.607337+0000","last_fullsized":"2024-04-26T12:30:32.607337+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640452+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:30:34.640452+0000","last_peered":"2024-04-26T12:30:34.640452+0000","last_clean":"2024-04-26T12:30:34.640452+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:30:34.640452+0000","last_undegraded":"2024-04-26T12:30:34.640452+0000","last_fullsized":"2024-04-26T12:30:34.640452+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614485+0000","last_change":"2024-04-26T12:30:32.620556+0000","last_active":"2024-04-26T12:30:33.614485+0000","last_peered":"2024-04-26T12:30:33.614485+0000","last_clean":"2024-04-26T12:30:33.614485+0000","last_became_active":"2024-04-26T12:30:32.620148+0000","last_became_peered":"2024-04-26T12:30:32.620148+0000","last_unstale":"2024-04-26T12:30:33.614485+0000","last_undegraded":"2024-04-26T12:30:33.614485+0000","last_fullsized":"2024-04-26T12:30:33.614485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.607350+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:30:32.607350+0000","last_peered":"2024-04-26T12:30:32.607350+0000","last_clean":"2024-04-26T12:30:32.607350+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:30:32.607350+0000","last_undegraded":"2024-04-26T12:30:32.607350+0000","last_fullsized":"2024-04-26T12:30:32.607350+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640248+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:30:34.640248+0000","last_peered":"2024-04-26T12:30:34.640248+0000","last_clean":"2024-04-26T12:30:34.640248+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:30:34.640248+0000","last_undegraded":"2024-04-26T12:30:34.640248+0000","last_fullsized":"2024-04-26T12:30:34.640248+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614007+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:30:33.614007+0000","last_peered":"2024-04-26T12:30:33.614007+0000","last_clean":"2024-04-26T12:30:33.614007+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:30:33.614007+0000","last_undegraded":"2024-04-26T12:30:33.614007+0000","last_fullsized":"2024-04-26T12:30:33.614007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.605563+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:30:32.605563+0000","last_peered":"2024-04-26T12:30:32.605563+0000","last_clean":"2024-04-26T12:30:32.605563+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:30:32.605563+0000","last_undegraded":"2024-04-26T12:30:32.605563+0000","last_fullsized":"2024-04-26T12:30:32.605563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640832+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:30:34.640832+0000","last_peered":"2024-04-26T12:30:34.640832+0000","last_clean":"2024-04-26T12:30:34.640832+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:30:34.640832+0000","last_undegraded":"2024-04-26T12:30:34.640832+0000","last_fullsized":"2024-04-26T12:30:34.640832+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613291+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:30:33.613291+0000","last_peered":"2024-04-26T12:30:33.613291+0000","last_clean":"2024-04-26T12:30:33.613291+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:30:33.613291+0000","last_undegraded":"2024-04-26T12:30:33.613291+0000","last_fullsized":"2024-04-26T12:30:33.613291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641247+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:30:34.641247+0000","last_peered":"2024-04-26T12:30:34.641247+0000","last_clean":"2024-04-26T12:30:34.641247+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:30:34.641247+0000","last_undegraded":"2024-04-26T12:30:34.641247+0000","last_fullsized":"2024-04-26T12:30:34.641247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.600817+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:30:32.600817+0000","last_peered":"2024-04-26T12:30:32.600817+0000","last_clean":"2024-04-26T12:30:32.600817+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:30:32.600817+0000","last_undegraded":"2024-04-26T12:30:32.600817+0000","last_fullsized":"2024-04-26T12:30:32.600817+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640370+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:30:34.640370+0000","last_peered":"2024-04-26T12:30:34.640370+0000","last_clean":"2024-04-26T12:30:34.640370+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:30:34.640370+0000","last_undegraded":"2024-04-26T12:30:34.640370+0000","last_fullsized":"2024-04-26T12:30:34.640370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T12:30:32.608611+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:30:32.608611+0000","last_peered":"2024-04-26T12:30:32.608611+0000","last_clean":"2024-04-26T12:30:32.608611+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:30:32.608611+0000","last_undegraded":"2024-04-26T12:30:32.608611+0000","last_fullsized":"2024-04-26T12:30:32.608611+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.995826+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:30:34.995826+0000","last_peered":"2024-04-26T12:30:34.995826+0000","last_clean":"2024-04-26T12:30:34.995826+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:30:34.995826+0000","last_undegraded":"2024-04-26T12:30:34.995826+0000","last_fullsized":"2024-04-26T12:30:34.995826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613310+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:30:33.613310+0000","last_peered":"2024-04-26T12:30:33.613310+0000","last_clean":"2024-04-26T12:30:33.613310+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:30:33.613310+0000","last_undegraded":"2024-04-26T12:30:33.613310+0000","last_fullsized":"2024-04-26T12:30:33.613310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613412+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:30:33.613412+0000","last_peered":"2024-04-26T12:30:33.613412+0000","last_clean":"2024-04-26T12:30:33.613412+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:30:33.613412+0000","last_undegraded":"2024-04-26T12:30:33.613412+0000","last_fullsized":"2024-04-26T12:30:33.613412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613632+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:30:33.613632+0000","last_peered":"2024-04-26T12:30:33.613632+0000","last_clean":"2024-04-26T12:30:33.613632+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:30:33.613632+0000","last_undegraded":"2024-04-26T12:30:33.613632+0000","last_fullsized":"2024-04-26T12:30:33.613632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.614172+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:30:33.614172+0000","last_peered":"2024-04-26T12:30:33.614172+0000","last_clean":"2024-04-26T12:30:33.614172+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:30:33.614172+0000","last_undegraded":"2024-04-26T12:30:33.614172+0000","last_fullsized":"2024-04-26T12:30:33.614172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613790+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:30:33.613790+0000","last_peered":"2024-04-26T12:30:33.613790+0000","last_clean":"2024-04-26T12:30:33.613790+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:30:33.613790+0000","last_undegraded":"2024-04-26T12:30:33.613790+0000","last_fullsized":"2024-04-26T12:30:33.613790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613843+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:30:33.613843+0000","last_peered":"2024-04-26T12:30:33.613843+0000","last_clean":"2024-04-26T12:30:33.613843+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:30:33.613843+0000","last_undegraded":"2024-04-26T12:30:33.613843+0000","last_fullsized":"2024-04-26T12:30:33.613843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613643+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:30:33.613643+0000","last_peered":"2024-04-26T12:30:33.613643+0000","last_clean":"2024-04-26T12:30:33.613643+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:30:33.613643+0000","last_undegraded":"2024-04-26T12:30:33.613643+0000","last_fullsized":"2024-04-26T12:30:33.613643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641440+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:30:34.641440+0000","last_peered":"2024-04-26T12:30:34.641440+0000","last_clean":"2024-04-26T12:30:34.641440+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:30:34.641440+0000","last_undegraded":"2024-04-26T12:30:34.641440+0000","last_fullsized":"2024-04-26T12:30:34.641440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.612884+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:30:33.612884+0000","last_peered":"2024-04-26T12:30:33.612884+0000","last_clean":"2024-04-26T12:30:33.612884+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:30:33.612884+0000","last_undegraded":"2024-04-26T12:30:33.612884+0000","last_fullsized":"2024-04-26T12:30:33.612884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.641370+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:30:34.641370+0000","last_peered":"2024-04-26T12:30:34.641370+0000","last_clean":"2024-04-26T12:30:34.641370+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:30:34.641370+0000","last_undegraded":"2024-04-26T12:30:34.641370+0000","last_fullsized":"2024-04-26T12:30:34.641370+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613737+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:30:33.613737+0000","last_peered":"2024-04-26T12:30:33.613737+0000","last_clean":"2024-04-26T12:30:33.613737+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:30:33.613737+0000","last_undegraded":"2024-04-26T12:30:33.613737+0000","last_fullsized":"2024-04-26T12:30:33.613737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613593+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:30:33.613593+0000","last_peered":"2024-04-26T12:30:33.613593+0000","last_clean":"2024-04-26T12:30:33.613593+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:30:33.613593+0000","last_undegraded":"2024-04-26T12:30:33.613593+0000","last_fullsized":"2024-04-26T12:30:33.613593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640266+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:30:34.640266+0000","last_peered":"2024-04-26T12:30:34.640266+0000","last_clean":"2024-04-26T12:30:34.640266+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:30:34.640266+0000","last_undegraded":"2024-04-26T12:30:34.640266+0000","last_fullsized":"2024-04-26T12:30:34.640266+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613341+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:30:33.613341+0000","last_peered":"2024-04-26T12:30:33.613341+0000","last_clean":"2024-04-26T12:30:33.613341+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:30:33.613341+0000","last_undegraded":"2024-04-26T12:30:33.613341+0000","last_fullsized":"2024-04-26T12:30:33.613341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:34.640934+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:30:34.640934+0000","last_peered":"2024-04-26T12:30:34.640934+0000","last_clean":"2024-04-26T12:30:34.640934+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:30:34.640934+0000","last_undegraded":"2024-04-26T12:30:34.640934+0000","last_fullsized":"2024-04-26T12:30:34.640934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:30:33.613671+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:30:33.613671+0000","last_peered":"2024-04-26T12:30:33.613671+0000","last_clean":"2024-04-26T12:30:33.613671+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:30:33.613671+0000","last_undegraded":"2024-04-26T12:30:33.613671+0000","last_fullsized":"2024-04-26T12:30:33.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":638777,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":135168,"data_stored":45552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":638161,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:55.065 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:30:55.065 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:30:55.065 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T12:30:55.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:30:55.120 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:30:55.156 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:55.156+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:55.200 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:30:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:30:55.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:30:55.201 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:30:55.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:30:55.256 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:55.256+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:55.339 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:30:55.339 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:30:55.339 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:30:55.339 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:30:55.340 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:30:55.349 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:30:55.392 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:55.391+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:55.439 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:30:55.439 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 19, 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "64cc8c72-72d6-4335-8e3d-3304aaa6cad9", 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2024-04-26T12:30:16.108777+0000", 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2024-04-26T12:30:55.093622+0000", 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2024-04-26T12:30:24.744360+0000", 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2024-04-26T12:30:17.865270+0000", 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5806080, 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "nodeep-scrub", 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "noscrub", 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2024-04-26T12:30:55.440 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 4, 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 3, 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2024-04-26T12:30:55.441 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:25.029168+0000", 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:30:55.442 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:30:55.443 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "11", 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:30:55.444 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:30:55.445 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:30:55.446 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:30:55.447 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 2, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "rbd", 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:25.763407+0000", 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:30:55.448 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 8, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 8, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 8, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 8, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 8, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.449 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "11", 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:30:55.450 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.451 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "options": {}, 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd": {} 2024-04-26T12:30:55.452 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 3, 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:30:55.453 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:30.379996+0000", 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:30:55.454 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "14", 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:30:55.455 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:30:55.456 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:30:55.457 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2024-04-26T12:30:55.458 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:30:55.459 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 4, 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:31.544710+0000", 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:30:55.460 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:30:55.461 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "15", 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:30:55.462 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:30:55.463 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2024-04-26T12:30:55.464 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.1299999952316284, 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.1299999952316284, 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 1, 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 1, 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 1 2024-04-26T12:30:55.465 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "25a1a54a-7d63-4c77-a385-f8147232ba3f", 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 8, 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 13, 2024-04-26T12:30:55.466 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6800", 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6801", 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.467 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6802", 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6803", 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.468 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6806", 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6807", 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.469 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6804", 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6805", 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.98:6801/40381", 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.98:6803/40381", 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.98:6807/40381", 2024-04-26T12:30:55.470 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.98:6805/40381", 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc", 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2024-04-26T12:30:55.471 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 8, 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 13, 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6800", 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6801", 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:30:55.472 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6802", 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6803", 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.473 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6806", 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6807", 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.474 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6804", 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6805", 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.475 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.116:6801/40366", 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.116:6803/40366", 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.116:6807/40366", 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.116:6805/40366", 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "0ddc67e1-ee46-4691-bc16-6366296d9929", 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2024-04-26T12:30:55.476 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 8, 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 13, 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6800", 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.477 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6801", 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6802", 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.478 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6803", 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6806", 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6807", 2024-04-26T12:30:55.479 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6804", 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6805", 2024-04-26T12:30:55.480 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.133:6801/40554", 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.133:6803/40554", 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40554", 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40554", 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:30:55.481 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2024-04-26T12:30:22.897372+0000", 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.482 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2024-04-26T12:30:22.974464+0000", 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2024-04-26T12:30:55.483 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2024-04-26T12:30:22.873008+0000", 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2024-04-26T12:30:55.484 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2024-04-26T12:30:55.485 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2024-04-26T12:30:55.486 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2024-04-26T12:30:55.486 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:30:55.486 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:30:55.486 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2024-04-26T12:30:55.486 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:30:55.486 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-26T12:30:55.488 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:55.487+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:55.489 INFO:tasks.thrashosds.thrasher:j is {'epoch': 19, 'fsid': '64cc8c72-72d6-4335-8e3d-3304aaa6cad9', 'created': '2024-04-26T12:30:16.108777+0000', 'modified': '2024-04-26T12:30:55.093622+0000', 'last_up_change': '2024-04-26T12:30:24.744360+0000', 'last_in_change': '2024-04-26T12:30:17.865270+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:30:25.029168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:30:25.763407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:30:30.379996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:30:31.544710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '25a1a54a-7d63-4c77-a385-f8147232ba3f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 40381}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 40381}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 40381}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 40381}]}, 'public_addr': '172.21.15.98:6801/40381', 'cluster_addr': '172.21.15.98:6803/40381', 'heartbeat_back_addr': '172.21.15.98:6807/40381', 'heartbeat_front_addr': '172.21.15.98:6805/40381', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 40366}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 40366}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 40366}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 40366}]}, 'public_addr': '172.21.15.116:6801/40366', 'cluster_addr': '172.21.15.116:6803/40366', 'heartbeat_back_addr': '172.21.15.116:6807/40366', 'heartbeat_front_addr': '172.21.15.116:6805/40366', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ddc67e1-ee46-4691-bc16-6366296d9929', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6800', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6801', 'nonce': 40554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6802', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6803', 'nonce': 40554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6806', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6807', 'nonce': 40554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6804', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6805', 'nonce': 40554}]}, 'public_addr': '172.21.15.133:6801/40554', 'cluster_addr': '172.21.15.133:6803/40554', 'heartbeat_back_addr': '172.21.15.133:6807/40554', 'heartbeat_front_addr': '172.21.15.133:6805/40554', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:30:22.897372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:30:22.974464+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:30:22.873008+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:30:55.489 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.587036953999998, 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.490 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:30:55.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:30:55.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.873799093999999, 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:30:55.494 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:30:55.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:30:55.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:30:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.873741032000002, 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:30:55.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:30:55.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:30:55.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.873712479000002, 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:30:55.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:30:55.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.873693004, 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.512 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:30:55.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:30:55.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:30:55.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.87367296, 2024-04-26T12:30:55.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:30:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:30:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:30:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:30:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.873649662999998, 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:30:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:30:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.873629221000002, 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:30:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:30:55.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:30:55.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:30:55.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.873608675, 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.873576680999999, 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:30:55.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:30:55.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:30:55.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.872169705000001, 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:30:55.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.871516026999998, 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:30:55.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:30:55.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.871293971, 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.552 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:30:55.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:30:55.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.866840754000002, 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:30:55.556 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:30:55.560 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.861412438999999, 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:30:55.564 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.861152068999999, 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:30:55.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:30:55.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.861118673, 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:30:55.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:30:55.573 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.860913671999999, 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:30:55.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.855287495999999, 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:30:55.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:30:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.854908086000002, 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:55.582 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:30:55.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:30:55.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:30:55.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:55.586 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:30:55.587 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:30:55.588 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:55.588+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:55.689 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:55.688+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:55.728 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:30:55.728 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:30:55.729 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:30:55.729 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:30:55.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:30:55.790 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:55.789+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:55.866 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:30:55.866 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:30:55.866 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:30:55.866 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:30:55.866 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:30:55.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:30:55.891 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:55.891+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:55.992 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:55.992+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:56.004 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 28.713317627999999, 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:30:56.005 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.010 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.400061467, 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:30:56.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:30:56.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:30:56.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.400019788000002, 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.016 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:30:56.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399991009000001, 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.027 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399961360999999, 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:30:56.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:30:56.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:30:56.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.033 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399922546999999, 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:30:56.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:30:56.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399893759000001, 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.044 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399866618000001, 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:30:56.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:30:56.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.050 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399824897999999, 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:30:56.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399781781000002, 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.056 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:30:56.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399763095000001, 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.062 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399740225999999, 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:30:56.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:30:56.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:30:56.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.073 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399709344000001, 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:30:56.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:30:56.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:30:56.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:56.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399691872999998, 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:30:56.079 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:30:56.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.084 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399669138, 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:30:56.090 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399639596, 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399614153999998, 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:56.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399584988000001, 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:30:56.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.107 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399571063, 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:30:56.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:56.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.113 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.399553728000001, 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:56.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:30:56.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:30:56.118 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.118 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.118 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.118 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:56.118 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:56.118 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:30:56.118 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:30:56.120 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:56.119+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:56.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:30:56.221 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:56.220+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:56.261 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:30:56.261 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:30:56.261 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:30:56.261 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:30:56.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:30:56.288 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:30:56.309 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:30:56.321 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:56.321+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:56.330 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:30:56.331 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:30:56.331 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:30:56.331 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:30:56.399 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:56.399 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:56.409 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:30:56.422 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:56.421+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:56.522 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:56.521+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:56.536 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:56.536 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:56.547 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:30:56.624 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:56.623+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:56.688 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:56.688 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:56.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:30:56.724 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:56.724+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:56.825 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:56.825 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:56.825 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:56.825+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:56.835 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:30:56.926 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:56.926+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:56.961 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:56.962 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:56.971 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:30:57.027 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:57.026+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:57.109 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:57.110 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:57.120 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:30:57.128 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:57.127+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:57.134 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:30:57.229 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:57.228+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:57.250 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:57.251 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:57.261 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:30:57.346 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:57.345+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:57.430 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:57.430 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:57.430 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:57.429+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:57.440 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:30:57.531 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:57.530+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:57.575 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:57.576 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:57.586 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:30:57.632 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:57.631+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:57.712 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:57.713 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:57.722 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:30:57.766 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:57.765+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:57.833 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:57.832+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:57.850 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:57.850 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:57.860 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:30:57.934 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:57.933+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:58.000 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:58.000 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:58.010 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:30:58.035 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:58.035+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:58.136 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:58.135+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:58.151 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:30:58.179 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:58.179 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:58.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:30:58.237 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:58.236+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:58.315 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:58.315 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:58.325 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:30:58.345 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:30:58.369 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:58.368+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:58.438 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:58.437+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:58.457 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:30:58.457 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:30:58.467 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:30:58.511 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:30:58.532 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:30:58.551 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:58.550+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:58.554 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:30:58.554 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:30:58.554 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:30:58.554 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:30:58.635 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:30:58.635 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:30:58.635 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:30:58.636 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:30:58.636 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:30:58.640 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:58.639+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:58.646 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:30:58.741 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:58.740+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:58.816 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:30:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:30:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:30:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:30:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:30:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:30:58.816 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.524632224000001, 2024-04-26T12:30:58.817 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:30:58.817 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.817 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.817 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:30:58.817 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:30:58.817 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:30:58.817 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:30:58.817 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.817 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.818 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:30:58.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:30:58.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211376062999999, 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:30:58.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:30:58.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:30:58.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211334384000001, 2024-04-26T12:30:58.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.829 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:30:58.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:30:58.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:30:58.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:30:58.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211305605, 2024-04-26T12:30:58.834 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.835 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:30:58.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211275957000002, 2024-04-26T12:30:58.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.842 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.846 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211237143000002, 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.847 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:30:58.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:30:58.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.852 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211208355, 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:30:58.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:30:58.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:30:58.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:30:58.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:30:58.858 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211181214, 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:30:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:30:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:30:58.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.864 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211139494000001, 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:58.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:30:58.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:30:58.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:30:58.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.870 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211096377000001, 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:30:58.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:30:58.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:30:58.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:30:58.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211077691, 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.882 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211054822000001, 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:58.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:30:58.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:30:58.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:30:58.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:30:58.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.21102394, 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.894 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.211006469000001, 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:58.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:30:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.900 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.210983733999999, 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:30:58.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:58.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.906 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.210954191999999, 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:30:58.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:30:58.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.912 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.210928750000001, 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:30:58.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:30:58.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:30:58.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:30:58.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.210899584, 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.210885658999999, 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:30:58.930 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 26.210868324, 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:30:58.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:30:58.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:30:58.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:30:58.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:30:58.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:30:58.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:30:58.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:30:58.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:30:58.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:30:58.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:30:58.935 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.936 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.936 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.936 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:30:58.936 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:30:58.936 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:30:58.938 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:58.937+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:58.939 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:30:59.038 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:59.037+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:59.082 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:30:59.082 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:30:59.082 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:30:59.082 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:30:59.092 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:30:59.139 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:59.138+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:59.219 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:30:59.219 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:30:59.220 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:30:59.220 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:30:59.220 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:30:59.229 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:30:59.241 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:59.241+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:59.341 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:59.341+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:59.401 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.797478845000001, 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:30:59.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:30:59.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:30:59.407 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.797418607000001, 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:30:59.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:59.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.797385287000001, 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:30:59.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:30:59.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:30:59.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:30:59.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.797355496000002, 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.797342182000001, 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.423 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.428 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.797325207, 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:30:59.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:30:59.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:30:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.797258116999998, 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.437 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.797227737, 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:30:59.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:30:59.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.797204999000002, 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:30:59.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:30:59.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.792998911000002, 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.787629127999999, 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:30:59.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:30:59.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.787448417, 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.456 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.787421573, 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:30:59.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.787381948, 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:30:59.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.787308349, 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.468 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.785848687000001, 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:30:59.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:30:59.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.785564431000001, 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.781031757000001, 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.476 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:30:59.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:30:59.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.780902707999999, 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:30:59.480 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:30:59.484 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 22.49155738, 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:30:59.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:30:59.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.489 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:30:59.490 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:30:59.490 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:30:59.491 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:30:59.492 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:59.491+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:59.592 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:59.591+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:59.632 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:30:59.632 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:30:59.632 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:30:59.632 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:30:59.642 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:30:59.726 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:30:59.725+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:30:59.793 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:30:59.793+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:30:59.810 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:30:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:30:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:30:59.810 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:30:59.810 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:30:59.819 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:30:59.894 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:30:59.894+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:30:59.989 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:30:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:30:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:30:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:30:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 33.097478264000003, 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.384240404, 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:30:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:30:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:30:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:30:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.384182341999999, 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.384153788999999, 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.384134314000001, 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.384114270000001, 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.384090972999999, 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.384070530999999, 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.384049985000001, 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.384017991, 2024-04-26T12:31:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.382611014999998, 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:00.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:00.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.381957336999999, 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:00.049 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.381735281000001, 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:00.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:00.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:00.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.377282063999999, 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:00.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:00.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.371853749, 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:00.061 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:00.065 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.371593379, 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:00.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:00.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:00.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.371559983000001, 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:00.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:00.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:00.073 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.371354982, 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.365728806, 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:00.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 27.365349395999999, 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:00.082 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:00.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:00.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:00.086 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:00.088 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:00.088 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:00.087+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:00.165 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:31:00.188 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:00.187+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:00.228 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:00.229 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:00.239 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:00.289 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:00.289+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:00.390 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:00.390+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:00.406 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:00.406 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:00.406 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:00.406 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:00.406 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:00.416 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:00.491 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:00.491 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:00.491 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T12:31:00.491 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:31:00.492 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:31:00.492 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T12:31:00.494 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:00.491+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:00.546 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:00.546 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:00.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 33.255104283000001, 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:00.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.552 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941848122, 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:00.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:00.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:00.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:00.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941806443000001, 2024-04-26T12:31:00.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.564 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941777664, 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:00.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941748015999998, 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:00.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:00.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941709201999998, 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:00.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:00.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:00.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:00.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.583 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941680414, 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:00.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941653273, 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:00.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941611553000001, 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:00.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:00.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:00.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:00.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:00.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:00.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:00.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:00.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:00.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:00.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:00.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:00.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:00.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:00.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.603 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.603 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.603 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941568436000001, 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:00.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.94154975, 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:00.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.614 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941526881000001, 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:00.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:00.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941495999000001, 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:00.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.626 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941478528000001, 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941455792999999, 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941426250999999, 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941400809000001, 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:00.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941371643, 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:00.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:00.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.655 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941357717999999, 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:00.661 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.941340383, 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:00.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:00.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:00.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:00.666 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.666 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.666 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.666 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:00.666 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:00.666 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:00.666 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:00.668 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:00.667+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:00.669 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:31:00.669 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:00.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:00.768 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:00.767+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:00.798 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:00.798 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:00.798 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:00.808 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:00.835 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:00.856 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:00.868 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:00.868+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:00.877 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:00.879 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:00.936 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:00.936 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:00.946 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:00.991 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:00.990+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:01.071 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:01.069+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:01.073 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:01.073 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:01.084 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:01.172 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:01.171+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:01.186 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:31:01.226 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:01.226 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:01.236 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:01.277 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:01.276+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:01.373 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:01.372+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:01.404 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:01.404 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:01.414 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:01.474 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:01.474+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:01.541 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:01.541 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:01.551 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:01.575 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:01.574+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:01.676 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:01.675+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:01.686 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:01.687 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:01.698 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:01.776 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:01.776+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:01.866 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:01.867 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:01.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:01.877 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:01.877+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:01.978 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:01.978+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:02.004 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:02.004 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:02.014 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:02.079 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:02.078+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:02.155 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:02.156 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:02.166 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:02.209 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:02.208+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:02.281 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:02.280+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:02.294 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:02.294 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:02.304 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:02.382 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:02.380+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:02.471 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:02.472 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:02.481 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:02.482 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:02.481+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:02.583 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:02.582+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:02.621 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:02.621 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:02.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:02.683 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:02.683+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:02.758 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:02.758 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:02.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:02.783 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:02.782+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:02.884 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:02.883+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:02.891 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:02.895 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:02.895 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:02.905 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:02.985 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:02.984+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:03.045 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:03.046 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:03.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:03.062 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:03.083 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:03.100 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:03.099+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:03.103 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:03.104 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:03.105 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:03.105 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:03.184 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:03.185 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:03.185 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:03.185 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:03.185 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:03.187 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:03.187+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:03.195 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:03.201 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:31:03.288 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:03.286+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:03.365 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.074214570999999, 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760958410000001, 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760916731000002, 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760887952000001, 2024-04-26T12:31:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760858303999999, 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760819489999999, 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760790702000001, 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760763561000001, 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760721840999999, 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760678724000002, 2024-04-26T12:31:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760660038000001, 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760637168999999, 2024-04-26T12:31:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760606287000002, 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:03.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.444 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760588815999999, 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:03.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760566081, 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.450 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:03.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:03.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760536539, 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:03.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760511096999998, 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:03.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:03.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:03.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:03.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:03.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:03.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760481931000001, 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:03.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:03.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:03.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:03.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:03.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:03.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:03.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760468006, 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:03.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:03.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:03.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:03.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:03.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:03.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:03.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:03.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:03.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:03.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:03.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:03.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 30.760450671000001, 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:03.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:03.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:03.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:03.489 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:03.490 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:03.491 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:03.491+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:03.492 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:03.592 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:03.591+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:03.630 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:03.631 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:03.631 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:03.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:03.693 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:03.692+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:03.767 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:03.767 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:03.768 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:03.768 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:03.768 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:03.777 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:03.821 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:03.820+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:03.895 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:03.894+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:03.906 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:03.906 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:03.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:03.906 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.302287477, 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.302227239, 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.916 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.302193919, 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:03.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:03.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:03.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:03.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.302164128000001, 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.926 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.302150814000001, 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:03.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.302133839, 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:03.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:03.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:03.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.302066749000002, 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:03.937 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:03.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:03.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.302036369, 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.941 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:03.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.302013631000001, 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:03.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:03.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.297807543000001, 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:03.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.292437759999999, 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.956 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.292257049, 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:03.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.960 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.292230204999999, 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:03.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.29219058, 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:03.965 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:03.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.968 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.292116980999999, 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:03.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.290657319000001, 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:03.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.290373063000001, 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.285840389000001, 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:03.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:03.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:03.984 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.285711339999999, 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:03.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.996366011999999, 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:03.989 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:03.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:03.994 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:03.996 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:03.996 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:03.995+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:04.097 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:04.096+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:04.136 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:04.136 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:04.137 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:04.137 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:04.148 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:04.198 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:04.197+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:04.205 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:31:04.275 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:04.275 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:04.285 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:04.326 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:04.325+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:04.399 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:04.399+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:04.454 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:04.454 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:04.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:04.454 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:04.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.454 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:04.454 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:04.454 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 37.562380885000003, 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:04.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.458 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.849143025, 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:04.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:04.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:04.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:04.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.849084962999999, 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:04.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:04.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:04.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.849056409999999, 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:04.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:04.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.849036935000001, 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:04.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.849016891000002, 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.483 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:04.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:04.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.848993594, 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.489 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:04.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:04.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:04.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.848973151999999, 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:04.495 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:04.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:04.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.501 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.848952606000001, 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.848920612000001, 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:04.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.510 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.847513635999999, 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:04.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:04.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.846859958, 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:04.515 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:04.518 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.846637902000001, 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:04.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.842184684999999, 2024-04-26T12:31:04.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:04.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:04.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.83675637, 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:04.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:04.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.836496, 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.836462604000001, 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:04.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:04.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.836257603, 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:04.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:04.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.830631427, 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:04.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 31.830252016999999, 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:04.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:04.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:04.554 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:04.556 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:04.556 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:04.555+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:04.656 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:04.655+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:04.698 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:04.698 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:04.698 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:04.698 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:04.708 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:04.757 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:04.756+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:04.836 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:04.837 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:04.837 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:04.837 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:04.837 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:04.847 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:04.892 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:04.891+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:04.959 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:04.959+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:04.977 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:04.977 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:04.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.686144693999999, 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:04.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:04.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372888533000001, 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372846854000002, 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:04.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.995 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372818074999998, 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:04.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:04.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:04.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:04.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:05.001 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372788427000003, 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:05.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:05.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.007 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372749613000003, 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:05.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372720825000002, 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:05.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.019 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372693683999998, 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:05.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:05.025 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372651963999999, 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:05.031 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372608847000002, 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:05.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:05.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:05.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372590160999998, 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.043 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372567291999999, 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:05.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:05.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372536410000002, 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:05.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:05.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:05.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372518939000003, 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:05.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372496204000001, 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.062 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:05.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372466662000001, 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.068 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:05.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:05.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372441219999999, 2024-04-26T12:31:05.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:05.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:05.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:05.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372412054000002, 2024-04-26T12:31:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:05.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:05.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:05.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.086 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372398128999997, 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:05.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:05.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:05.092 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.372380794000001, 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:05.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:05.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:05.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:05.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:05.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:05.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.097 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:05.097 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:05.097 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:05.098 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:05.097+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:05.099 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:05.119 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:05.199 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:05.198+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:05.240 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:05.240 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:05.240 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:05.240 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:05.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:05.292 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:05.300 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:05.299+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:05.314 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:05.333 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:05.335 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:05.335 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:05.335 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:05.378 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:05.378 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:05.388 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:05.401 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:05.400+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:05.502 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:05.501+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:05.554 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:05.555 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:05.564 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:05.602 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:05.601+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:05.670 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:05.670 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:05.670 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T12:31:05.670 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.838088 2024-04-26T12:31:05.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.8380880852850121 2024-04-26T12:31:05.703 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:05.702+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:05.705 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:05.705 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:05.715 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:05.804 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:05.803+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:05.845 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:05.845 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:05.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:05.904 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:05.903+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:05.984 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:05.984 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:05.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:06.035 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:06.034+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:06.107 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:06.106+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:06.134 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:06.134 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:06.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:06.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:31:06.230 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:06.228+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:06.233 INFO:teuthology.orchestra.run.smithi038.stderr:set osd.2 primary-affinity to 0.838088 (8549242) 2024-04-26T12:31:06.309 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:06.309+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:06.314 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:06.314 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:06.325 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:06.410 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:06.410+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:06.493 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:06.493 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:06.503 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:06.511 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:06.510+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:06.612 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:06.611+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:06.643 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:06.644 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:06.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:06.713 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:06.712+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:06.781 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:06.781 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:06.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:06.813 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:06.812+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:06.914 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:06.913+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:06.918 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:06.918 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:06.928 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:07.015 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:07.014+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:07.068 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:07.068 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:07.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:07.116 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:07.115+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:07.206 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:07.206 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:07.216 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:07.217 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:07.216+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:07.234 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:31:07.318 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:07.317+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:07.344 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:07.344 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:07.348 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:07.354 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:07.418 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:07.418+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:07.491 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:07.491 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:07.501 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:07.519 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:07.518+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:07.520 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:07.541 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:07.562 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:07.563 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:07.564 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:07.564 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:07.621 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:07.620+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:07.669 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:07.669 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:07.669 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:07.669 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:07.669 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:07.679 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:07.721 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:07.720+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:07.822 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:07.822+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:07.848 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.557393842000003, 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:07.849 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.854 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.244137680999998, 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:07.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:07.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:07.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:07.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.244096001999999, 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.860 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.244067223000002, 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.866 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:07.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:07.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.244037575, 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:07.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243998761, 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.878 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:07.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:07.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:07.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243969972999999, 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:07.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:07.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243942832000002, 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:07.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:07.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243901112000003, 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:07.901 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243857994999999, 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.907 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243839309000002, 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:07.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:07.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:07.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243816440000003, 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:07.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.919 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243785557999999, 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:07.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:07.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:07.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:07.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:07.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243768086999999, 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:07.925 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243745351999998, 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.931 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:07.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:07.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:07.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:07.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243715809999998, 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.937 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.940 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.942 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243690368000003, 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:07.943 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:07.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:07.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.946 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243661201999998, 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.949 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:07.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:07.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:07.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:07.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243647277000001, 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:07.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:07.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:07.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:07.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.243629941999998, 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:07.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:07.965 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:07.965 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:07.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:07.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.965 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:07.965 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:07.965 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:07.967 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:07.967 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:07.965+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:08.067 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:08.066+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:08.108 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:08.108 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:08.108 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:08.108 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:08.119 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:08.167 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:08.166+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:08.268 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:08.267+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:08.287 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:08.288 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:08.288 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:08.298 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:08.368 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:08.367+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:08.466 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.862533921000001, 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:08.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:08.472 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.862473682999997, 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:08.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:08.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:08.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.862440362999997, 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:08.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.862410572000002, 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.483 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.488 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.862397258000001, 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:08.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:08.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:08.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:08.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.862380283, 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:08.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.862313192999999, 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:08.499 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.862282813, 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:08.503 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:08.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:08.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.862260075000002, 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:08.510 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.858053986999998, 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:08.514 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.852684203999999, 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:08.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:08.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:08.518 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.852503493, 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:08.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:08.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:08.522 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.852476649000003, 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:08.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.852437023999997, 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:08.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:08.530 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.852363425, 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:08.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.534 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.850903762999998, 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:08.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.538 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.850619506999998, 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:08.542 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.846086833000001, 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:08.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 35.845957783999999, 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:08.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:08.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.556612456, 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.551 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:08.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:08.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:08.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:08.556 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:08.558 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:08.559 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:08.557+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:08.659 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:08.659+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:08.697 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:08.698 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:08.708 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:08.760 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:08.759+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:08.835 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:08.835 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:08.835 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:08.835 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:08.835 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:08.845 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:08.861 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:08.861+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:08.962 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:08.961+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:08.974 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:08.974 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:08.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:08.975 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:08.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.975 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:08.975 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:08.976 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 42.082109854999999, 2024-04-26T12:31:08.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:08.976 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:08.976 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.976 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:08.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:08.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:08.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:08.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:08.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:08.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:08.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:08.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:08.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:08.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:08.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:08.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:08.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:08.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:08.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:08.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:08.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:08.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:08.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:08.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:08.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:08.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:08.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:08.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:08.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:08.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:08.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:08.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:08.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:08.984 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:08.985 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:08.985 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:08.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.985 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:08.985 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:08.986 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.368871994999999, 2024-04-26T12:31:08.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:08.986 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:08.986 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:08.986 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:08.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:08.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:08.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:08.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:08.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:08.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:08.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:08.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:08.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:08.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:08.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:08.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:08.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:08.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:08.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:08.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:08.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:08.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:08.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:08.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:08.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:08.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:08.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:08.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:08.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:08.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:08.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:08.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:08.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:08.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:08.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:08.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:08.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:08.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:08.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:08.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:08.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:08.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:08.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:08.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:08.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:08.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:08.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:08.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:09.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:09.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:09.000 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.000 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.001 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.001 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.001 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:09.001 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.368813932999998, 2024-04-26T12:31:09.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:09.002 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.002 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.002 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:09.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:09.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:09.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:09.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:09.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:09.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:09.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:09.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:09.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:09.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:09.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:09.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:09.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:09.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:09.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:09.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:09.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:09.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:09.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:09.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:09.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:09.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:09.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:09.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:09.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:09.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:09.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:09.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:09.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.015 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.015 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.016 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:09.016 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.368785379999998, 2024-04-26T12:31:09.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:09.016 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.016 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.016 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:09.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:09.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:09.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:09.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:09.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:09.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:09.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:09.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:09.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:09.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:09.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:09.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:09.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:09.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:09.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:09.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:09.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:09.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:09.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:09.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:09.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:09.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:09.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:09.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:09.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:09.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:09.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:09.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:09.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.030 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.030 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:09.030 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.368765904999997, 2024-04-26T12:31:09.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:09.031 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.031 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.031 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:09.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:09.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:09.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:09.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:09.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.368745861000001, 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.044 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.368722564000002, 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:09.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:09.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.050 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.368702122000002, 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:09.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.056 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.368681576, 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:09.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:09.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.368649582000003, 2024-04-26T12:31:09.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:09.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:09.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.367242605999998, 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.366588927999999, 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.070 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:09.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.366366872, 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:09.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:09.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.361913655000002, 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.078 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:09.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:09.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:09.082 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.356485339999999, 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:09.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.086 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.35622497, 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:09.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:09.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.356191574, 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:09.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:09.095 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.355986573000003, 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:09.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:09.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.350360397000003, 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:09.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:09.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.349980987000002, 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:09.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:09.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:09.108 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:09.110 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:09.110 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:09.109+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:09.210 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:09.210+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:09.251 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:09.251 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:09.251 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:09.251 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:09.252 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:31:09.261 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:09.311 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:09.310+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:09.389 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:09.389 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:09.389 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:09.399 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:09.413 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:09.412+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:09.514 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:09.513+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:09.569 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:09.569 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 42.277741255999999, 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:09.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:09.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.575 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964485095000001, 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:09.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:09.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964443416000002, 2024-04-26T12:31:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964414636999997, 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964384989000003, 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.599 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964346175000003, 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:09.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:09.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:09.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:09.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964317387000001, 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:09.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.611 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964290245999997, 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:09.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:09.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:09.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964248525999999, 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:09.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:09.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964205409000002, 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:09.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:09.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964186722999997, 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:09.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:09.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964163853999999, 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:09.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:09.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.641 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964132972000002, 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:09.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.647 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964115501000002, 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:09.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:09.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964092766, 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.659 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964063224, 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.665 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964037781999998, 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:09.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.671 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.964008616000001, 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:09.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:09.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.963994691000003, 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:09.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 36.963977356000001, 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:09.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:09.688 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:09.688 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:09.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:09.690 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:09.689+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:09.691 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:09.791 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:09.790+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:09.832 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:09.832 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:09.832 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:09.832 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:09.843 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:09.851 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:09.872 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:09.892 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:09.894 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:09.929 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:09.929+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:09.993 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:09.992+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:10.010 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:10.010 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:10.020 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:10.094 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:10.093+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:10.189 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:10.189 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:10.195 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:10.194+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:10.199 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:10.295 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:10.294+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:10.296 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:31:10.340 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:10.340 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:10.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:10.396 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:10.395+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:10.478 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:10.478 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:10.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:10.529 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:10.528+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:10.599 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:10.599+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:10.655 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:10.656 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:10.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:10.699 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:10.699+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:10.800 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:10.800+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:10.805 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:10.805 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:10.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:10.900 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:10.899+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:10.944 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:10.944 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:10.954 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:11.001 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:11.001+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:11.102 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:11.101+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:11.122 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:11.122 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:11.132 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:11.203 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:11.202+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:11.251 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:11.251 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:11.251 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:31:11.252 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:31:11.252 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:31:11.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:31:11.272 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:11.272 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:11.283 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:11.304 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:11.303+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:11.384 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:11.384 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:31:11.385 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:11.405 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:11.404+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:11.410 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:11.411 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:11.421 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:11.506 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:11.506+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:11.549 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:11.550 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:11.560 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:11.607 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:11.606+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:11.688 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:11.688 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:11.698 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:11.707 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:11.707+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:11.808 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:11.809+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:11.865 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:11.865 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:11.876 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:11.907 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:11.910 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:11.910+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:12.003 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:12.003 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:12.010 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:12.009+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:12.013 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:12.078 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:12.099 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:12.111 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:12.110+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:12.120 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:12.121 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:12.122 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:12.153 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:12.154 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:12.154 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:12.154 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:12.165 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:12.249 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:12.248+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:12.312 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:31:12.313 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:12.312+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:12.332 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:12.332 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:12.332 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:12.332 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:12.332 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:12.342 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:12.413 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:12.414+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:12.518 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:12.518 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:12.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:12.518 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.220879109999998, 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:12.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:12.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:12.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907622949, 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:12.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907581270000001, 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:12.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:12.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:12.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:12.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907552490999997, 2024-04-26T12:31:12.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:12.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907522843000002, 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:12.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:12.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907484029000003, 2024-04-26T12:31:12.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:12.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907455241000001, 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:12.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:12.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:12.564 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907428099999997, 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:12.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:12.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.571 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907386379999998, 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:12.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:12.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:12.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:12.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:12.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:12.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:12.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:12.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:12.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:12.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:12.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.579 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907343263000001, 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:12.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.585 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907324576999997, 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:12.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907301707999999, 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:12.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.597 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907270826000001, 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:12.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:12.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907253355000002, 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:12.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:12.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:12.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.90723062, 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:12.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907201078, 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.616 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:12.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:12.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907175635999998, 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:12.622 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:12.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907146470000001, 2024-04-26T12:31:12.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:12.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:12.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.634 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907132545000003, 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:12.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:12.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 39.907115210000001, 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:12.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:12.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:12.645 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:12.647 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:12.514+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:12.647 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:12.646+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:12.647 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:12.747 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:12.746+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:12.788 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:12.788 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:12.788 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:12.789 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:12.799 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:12.848 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:12.848+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:12.949 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:12.948+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:12.966 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:12.967 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:12.967 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:12.977 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:13.051 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:13.050+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.501720343000002, 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:13.106 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:13.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:13.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.501660104999999, 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:13.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:13.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.501626784999999, 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:13.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.501596994000003, 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:13.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:13.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.501583680000003, 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:13.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:13.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:13.133 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.501566705000002, 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:13.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:13.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.138 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.501499615, 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:13.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:13.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.501469235000002, 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:13.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.501446497000003, 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:13.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:13.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.497240409, 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:13.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:13.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.491870626000001, 2024-04-26T12:31:13.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:13.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:13.158 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.491689915000002, 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:13.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:13.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:13.162 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.491663070999998, 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:13.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.491623445999998, 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.491549847000002, 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:13.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.490090185, 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:13.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.489805928999999, 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:13.182 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.485273255000003, 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:13.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.485144206000001, 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:13.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.195798877999998, 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.191 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:13.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:13.196 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:13.198 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:13.196+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:13.198 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:13.299 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:13.298+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:13.320 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:31:13.340 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:13.340 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:13.340 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:13.341 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:13.351 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:13.400 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:13.399+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:13.479 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:13.479 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:13.479 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:13.489 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:13.501 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:13.500+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:13.602 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:13.601+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.726358331999997, 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:13.618 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.013120471999997, 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:13.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:13.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.628 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.013062410000003, 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:13.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:13.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.634 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.013033857000003, 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:13.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:13.640 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.013014382000001, 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:13.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.012994337999999, 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:13.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:13.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.012971041, 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:13.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:13.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.012950599, 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.664 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.012930052999998, 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:13.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:13.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:13.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:13.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.012898059000001, 2024-04-26T12:31:13.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:13.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:13.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.011491083000003, 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:13.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:13.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.010837404999997, 2024-04-26T12:31:13.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.010615348999998, 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:13.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:13.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:13.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.006162132, 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:13.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.000733816999997, 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.690 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:13.694 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.000473446999997, 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:13.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:13.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.000440050999998, 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:13.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 41.000235050000001, 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.703 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:13.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:13.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:13.707 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.994608874000001, 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:13.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:13.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.994229464, 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.715 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:13.716 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:13.716 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:13.717 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:13.718 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:13.716+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:13.818 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:13.817+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:13.859 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:13.859 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:13.859 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:13.859 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:13.870 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:13.919 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:13.918+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:13.998 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:13.998 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:13.998 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:13.998 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:13.998 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:14.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:14.019 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:14.018+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:14.120 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:14.119+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:14.134 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.846690791999997, 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.139 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:14.140 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:14.140 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:14.140 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:14.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.140 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:14.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:14.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533434630999999, 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:14.145 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:14.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:14.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:14.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:14.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533392952, 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:14.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:14.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533364173000002, 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:14.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:14.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533334525000001, 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:14.170 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533295711000001, 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:14.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.176 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533266922999999, 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:14.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.182 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533239782000003, 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:14.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:14.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:14.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.188 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533198061999997, 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:14.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:14.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533154945, 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:14.200 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533136259000003, 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:14.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533113389999997, 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:14.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533082508, 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:14.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.218 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533065037, 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:14.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:14.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:14.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:14.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533042301999998, 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:14.230 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.533012759999998, 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:14.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:14.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.236 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.532987317999996, 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:14.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.532958151999999, 2024-04-26T12:31:14.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:14.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:14.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.532944227000002, 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.248 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:14.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.532926891999999, 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:14.254 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:14.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:14.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:14.258 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:14.259 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:14.260 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:14.259+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:14.260 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:14.304 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:14.327 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:14.348 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:14.361 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:14.360+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:14.400 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:14.401 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:14.412 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:14.461 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:14.461+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:14.539 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:14.539 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:14.549 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:14.563 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:14.562+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:14.663 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:14.662+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:14.677 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:14.677 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:14.687 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:14.764 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:14.763+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:14.822 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:14.822 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:14.832 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:14.876 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:14.875+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:14.959 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:14.959 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:14.965 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:14.964+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:14.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:15.066 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:15.066+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:15.137 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:15.137 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:15.147 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:15.192 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:15.191+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:15.268 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:15.266+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:15.288 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:15.298 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:15.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:31:15.368 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:15.367+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:15.466 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:15.466 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:15.469 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:15.467+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:15.476 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:15.570 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:15.569+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:15.605 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:15.605 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:15.615 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:15.671 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:15.670+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:15.755 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:15.755 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:15.765 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:15.772 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:15.771+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:15.874 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:15.872+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:15.892 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:15.892 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:15.902 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:15.987 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:15.986+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:16.070 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:16.070 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:16.075 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:16.074+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:16.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:16.176 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:16.175+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:16.211 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:16.211 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:16.223 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:16.277 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:16.276+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:16.349 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:31:16.362 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:16.377 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:16.377+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:16.391 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:16.391 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:16.395 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:16.395 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:16.395 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-04-26T12:31:16.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-04-26T12:31:16.401 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:16.478 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:16.477+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:16.528 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:16.528 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:16.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:16.575 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:16.579 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:16.578+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:16.595 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:16.615 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:16.678 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:16.678 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:16.679 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:16.679 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:16.680 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:16.679+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:16.689 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:16.780 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:16.779+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:16.817 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:16.817 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:16.817 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:16.817 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:16.817 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:16.828 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:16.882 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:16.881+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:16.983 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:16.982+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:16.997 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:16.997 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 49.705813908000003, 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:16.998 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:16.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:17.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.003 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392557746999998, 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:17.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.009 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392516067999999, 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:17.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:17.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:17.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392487289000002, 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:17.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:17.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:17.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392457641, 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:17.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392418827, 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.028 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:17.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392390038999999, 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.034 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:17.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:17.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:17.039 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392362898000002, 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:17.045 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392321178000003, 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:17.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392278060999999, 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:17.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:17.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392259375000002, 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.058 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:17.064 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392236506000003, 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:17.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:17.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392205623999999, 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:17.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.076 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392188152999999, 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:17.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:17.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392165417999998, 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.083 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:17.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:17.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392135875999998, 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.089 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:17.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:17.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:17.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392110434000003, 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:17.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:17.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.101 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392081267999998, 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:17.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:17.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.108 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392067343000001, 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:17.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:17.114 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 44.392050007999998, 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:17.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:17.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:17.119 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:17.120 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:17.121 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:17.120+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:17.122 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:17.221 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:17.221+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:17.262 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:17.262 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:17.263 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:17.263 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:17.273 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:17.322 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:17.322+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:17.337 INFO:tasks.ceph.mon.a.smithi038.stderr:2024-04-26T12:31:17.337+0000 7f350f93e700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-04-26T12:31:17.348 INFO:teuthology.orchestra.run.smithi038.stderr:osd set-full-ratio 0.001 2024-04-26T12:31:17.401 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:17.401 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:17.401 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:17.411 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:17.455 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:17.454+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:17.524 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:17.523+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:17.540 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:17.540 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.936527269999999, 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:17.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:17.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.936467032000003, 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.936433712000003, 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.551 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:17.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:17.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:17.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.936403921, 2024-04-26T12:31:17.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:17.561 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.936390607, 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.566 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.936373631999999, 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:17.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:17.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:17.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:17.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.936306541999997, 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.936276161999999, 2024-04-26T12:31:17.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.936253424, 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.582 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.932047335999997, 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.926677552999998, 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:17.586 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.589 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.926496841999999, 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:17.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:17.593 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.926469998000002, 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:17.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:17.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:17.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.926430373000002, 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:17.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:17.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.926356773999998, 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.601 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:17.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:17.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.924897111999996, 2024-04-26T12:31:17.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.924612856000003, 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:17.609 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:17.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:17.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.920080182, 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 44.919951132999998, 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.620 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.630605805000002, 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.625 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.626 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:17.626 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:17.626 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:17.627 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:17.628 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:17.626+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:17.728 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:17.727+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:17.767 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:17.767 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:17.767 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:17.767 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:17.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:17.831 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:17.830+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:17.904 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:17.905 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:17.905 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:17.905 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:17.905 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:17.914 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:17.932 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:17.931+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:18.032 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:18.032+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:18.043 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:18.043 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:18.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:18.043 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:18.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 51.151733782999997, 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:18.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.438495922999998, 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:18.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:18.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:18.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.438437860999997, 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:18.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:18.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:18.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.438409307999997, 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:18.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:18.065 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.438389833000002, 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:18.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.438369788999999, 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:18.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:18.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:18.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.438346492000001, 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:18.083 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.438326050000001, 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:18.089 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.438305503999999, 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:18.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:18.094 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.438273510000002, 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:18.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:18.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.436866534000004, 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.436212855999997, 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:18.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.435990799999999, 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.110 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.431537583000001, 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:18.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:18.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.426109267999998, 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.115 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:18.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:18.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:18.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.425848897999998, 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:18.119 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:18.123 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.425815501999999, 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:18.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.425610501000001, 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:18.131 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.419984325000001, 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:18.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:18.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 45.419604915000001, 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:18.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:18.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:18.140 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:18.142 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:18.142 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:18.141+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:18.242 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:18.242+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:18.281 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:18.282 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:18.282 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:18.282 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:18.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:18.343 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:18.343+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:18.363 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-04-26T12:31:18.363 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-04-26T12:31:18.364 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:31:18.445 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:18.444+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:18.459 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:18.460 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:18.460 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:18.460 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:18.460 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:18.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:18.545 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:18.545+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:18.603 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:18.603 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:18.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 51.309715398999998, 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.604 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:18.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:18.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:18.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996459238, 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:18.609 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996417559000001, 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:18.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:18.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996388779999997, 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:18.621 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:18.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:18.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:18.627 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996359132000002, 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:18.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996320318000002, 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.633 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:18.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996291530000001, 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.639 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:18.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996264388999997, 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.645 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996222668999998, 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:18.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:18.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996179552000001, 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996160865999997, 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:18.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996137996999998, 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:18.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.675 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996107115000001, 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:18.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:18.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.681 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996089644000001, 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996066909, 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:18.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:18.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:18.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:18.693 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996037367, 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:18.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:18.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:18.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:18.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:18.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.996011924999998, 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.699 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.704 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.995982759, 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:18.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:18.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.995968834000003, 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:18.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:18.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:18.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.995951499, 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:18.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:18.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:18.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:18.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:18.720 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:18.721 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:18.721 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:18.723 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:18.723 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:18.722+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:18.823 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:18.823+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:18.864 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:18.864 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:18.874 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:18.882 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:18.903 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:18.924 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:18.923+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:18.924 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:18.925 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:18.926 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:19.001 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:19.002 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:19.012 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:19.056 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:19.055+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:19.125 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:19.124+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:19.139 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:19.140 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:19.150 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:19.227 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:19.226+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:19.288 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:19.289 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:19.299 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:19.327 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:19.326+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:19.353 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:31:19.363 INFO:teuthology.orchestra.run.smithi038.stderr:osd set-full-ratio 0.95 2024-04-26T12:31:19.427 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:19.427 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:19.428 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:19.426+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:19.437 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:19.529 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:19.528+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:19.604 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:19.604 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:19.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:19.631 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:19.630+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:19.732 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:19.731+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:19.755 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:19.755 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:19.766 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:19.833 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:19.832+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:19.894 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:19.894 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:19.904 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:19.934 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:19.934+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:20.038 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:20.034+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:20.071 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:20.071 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:20.081 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:20.135 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:20.135+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:20.223 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:20.223 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:20.233 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:20.236 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:20.236+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:20.337 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:20.336+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:20.360 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:20.360 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:20.370 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:20.438 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:20.437+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:20.500 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:20.500 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:20.511 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:20.556 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:20.555+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:20.640 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:20.639+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:20.650 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:20.650 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:20.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:20.740 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:20.740+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:20.828 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:20.828 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:20.838 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:20.841 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:20.840+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:20.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:20.942 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:20.941+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:20.965 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:20.965 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:20.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:21.043 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:21.042+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:21.109 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:21.115 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:21.115 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:21.127 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:21.130 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:21.143 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:21.142+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:21.149 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:21.151 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:21.151 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:21.151 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:21.244 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:21.243+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:21.255 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:21.255 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:21.256 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:21.256 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:21.256 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:21.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:21.345 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:21.345+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:21.371 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:31:21.396 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 54.104808519000002, 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791552357999997, 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791510678999998, 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791481900000001, 2024-04-26T12:31:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791452251999999, 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791413437999999, 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791384649999998, 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791357509000001, 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.438 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:21.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:21.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:21.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:21.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791315789000002, 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.449 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791272671999998, 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:21.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:21.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791253986000001, 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791231117000002, 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:21.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:21.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.467 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791200234999998, 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:21.473 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791182763999998, 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:21.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:21.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:21.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:21.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:21.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:21.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791160028999997, 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.486 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791130486999997, 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:21.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:21.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:21.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:21.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791105045000002, 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.492 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791075878999997, 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.503 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791061954, 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:21.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:21.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 48.791044618999997, 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:21.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:21.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:21.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:21.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:21.514 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.514 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.514 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.514 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:21.514 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:21.514 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:21.516 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:21.516 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:21.514+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:21.617 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:21.616+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:21.657 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:21.658 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:21.658 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:21.658 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:21.668 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:21.718 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:21.717+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:21.796 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:21.796 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:21.796 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:21.796 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:21.796 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:21.807 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:21.818 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:21.817+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:21.919 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:21.918+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:21.937 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:21.937 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:21.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:21.937 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:21.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.937 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.937 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.33278103, 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:21.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:21.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:21.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:21.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.943 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.332720792000003, 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:21.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:21.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:21.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:21.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:21.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:21.949 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.332687472000003, 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:21.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:21.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.332657681000001, 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.955 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.960 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.332644367, 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:21.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:21.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:21.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.332627391999999, 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:21.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.332560301999997, 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:21.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.332529921999999, 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.978 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.332507184000001, 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:21.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.328301095999997, 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.983 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:21.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.986 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.322931312999998, 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:21.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:21.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:21.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.322750601999999, 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:21.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:21.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:21.994 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.322723758000002, 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:21.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:21.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.322684133000003, 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:21.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:22.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.322610533999999, 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.002 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:22.006 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.321150871999997, 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:22.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:22.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.320866616000004, 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.316333942, 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:22.014 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:22.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:22.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:22.018 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.316204892999998, 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:22.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.026859565000002, 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:22.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:22.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:22.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:22.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:22.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:22.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:22.028 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.028 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:22.028 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.028 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:22.028 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:22.028 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:22.030 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:22.030 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:22.029+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:22.131 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:22.130+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:22.171 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:22.171 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:22.171 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:22.181 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:22.231 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:22.230+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:22.308 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:22.308 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:22.318 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:22.333 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:22.332+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:22.428 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:31:22.434 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:22.433+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:22.488 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 55.597037006000001, 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.489 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:22.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.883799146000001, 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:22.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:22.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:22.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.499 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.883741084, 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.883712531, 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:22.511 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.883693055999998, 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:22.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:22.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.517 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.883673012000003, 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:22.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:22.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:22.523 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.883649714999997, 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:22.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:22.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:22.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.883629272999997, 2024-04-26T12:31:22.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:22.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:22.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:22.535 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.883608727000002, 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:22.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.883576732999998, 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:22.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:22.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:22.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.882169757, 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.881516079000001, 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:22.552 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.881294023000002, 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:22.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:22.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.876840805999997, 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.871412491000001, 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.561 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:22.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.871152121000002, 2024-04-26T12:31:22.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:22.569 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.871118725000002, 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:22.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:22.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.870913723999998, 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:22.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.865287547999998, 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:22.578 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:22.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.582 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 49.864908137999997, 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:22.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:22.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:22.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:22.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:22.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:22.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.587 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:22.587 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:22.587 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:22.588 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:22.589 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:22.588+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:22.689 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:22.688+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:22.729 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:22.729 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:22.729 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:22.729 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:22.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:22.789 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:22.788+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:22.867 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:22.868 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:22.877 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:22.919 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:22.918+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:22.991 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:22.990+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:23.047 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.756280865000001, 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:23.048 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:23.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:23.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:23.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:23.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:23.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:23.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:23.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.443024704000003, 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.055 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:23.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442983024999997, 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442954245999999, 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442924597999998, 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442885783999998, 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442856996000003, 2024-04-26T12:31:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442829854999999, 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442788135000001, 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:23.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442745017999997, 2024-04-26T12:31:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442726331999999, 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442703463000001, 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442672580999997, 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442655109999997, 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442632375000002, 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442602833000002, 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442577391, 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442548225000003, 2024-04-26T12:31:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442534299999998, 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 50.442516965000003, 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:23.187 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:23.188 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:23.190 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:23.188+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:23.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:23.290 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:23.289+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:23.330 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:23.330 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:23.330 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:23.330 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:23.340 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:23.358 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:23.379 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:23.391 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:23.390+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:23.400 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:23.401 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:23.468 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:23.468 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:23.478 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:23.491 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:23.491+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:23.592 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:23.591+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:23.605 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:23.605 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:23.616 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:23.693 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:23.693+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:23.757 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:23.757 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:23.767 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:23.811 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:23.810+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:23.895 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:23.895 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:23.896 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:23.894+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:23.905 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:23.996 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:23.995+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:24.073 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:24.073 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:24.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:24.126 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:24.125+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:24.197 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:24.196+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:24.224 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:24.224 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:24.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:24.319 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:24.318+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:24.380 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:24.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:31:24.399 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:24.398+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:24.402 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:24.402 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:24.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:24.444 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:31:24.501 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:24.500+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:24.580 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:24.580 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:24.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:24.635 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:24.634+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:24.702 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:24.701+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:24.731 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:24.731 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:24.741 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:24.803 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:24.802+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:31:24.862 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:31:24.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:31:24.903 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:24.903+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:24.910 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:24.910 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:24.920 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:25.004 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:25.003+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:25.050 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:25.050 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:25.060 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:25.105 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:25.104+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:25.200 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:25.200 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:25.205 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:25.204+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:25.210 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:25.306 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:25.305+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:25.377 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:25.377 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:25.387 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:25.407 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:25.406+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:25.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:25.508 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:25.507+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:25.555 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:25.555 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:25.566 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:25.585 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:25.608 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:25.609 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:25.608+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:25.629 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:25.630 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:25.630 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:25.630 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:25.708 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:25.708 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:25.708 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:25.708 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:25.709 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:25.708+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:25.718 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:25.810 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:25.809+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:25.886 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:25.886 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:25.886 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:25.886 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:25.887 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:25.897 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:25.897 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:31:25.910 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:25.909+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:25.912 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:31:26.012 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:26.011+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:26.026 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:26.026 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:26.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:26.026 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:26.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.026 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 58.734862407999998, 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421606247, 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:26.032 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:26.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:26.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:26.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421564568000001, 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:26.038 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:26.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421535789000004, 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:26.044 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421506141000002, 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:26.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:26.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421467327000002, 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:26.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:26.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:26.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421438539, 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:26.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:26.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:26.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421411397999996, 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:26.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:26.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:26.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421369677999998, 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:26.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:26.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421326561000001, 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421307874999997, 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.086 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:26.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.091 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421285005999998, 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:26.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421254124000001, 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:26.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:26.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:26.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421236653000001, 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.109 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421213917999999, 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:26.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:26.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:26.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421184375999999, 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:26.121 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421158933999997, 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:26.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:26.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:26.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:26.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421129768, 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:26.127 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421115843000003, 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:26.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:26.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:26.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:26.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:26.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 53.421098508, 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:26.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:26.144 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:26.144 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:26.145 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:26.146 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:26.144+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:26.246 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:26.246+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:26.284 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:26.284 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:26.285 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:26.285 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:26.295 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:26.347 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:26.347+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:26.421 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:26.422 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:26.422 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:26.431 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:26.476 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:26.475+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:26.550 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:26.548+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.956673461000001, 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.561 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:26.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:26.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:26.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:26.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.956613222999998, 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:26.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:26.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:26.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:26.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:26.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.956579902999998, 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:26.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:26.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.579 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.956550112000002, 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:26.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.956536798000002, 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:26.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:26.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:26.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.956519823000001, 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:26.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:26.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:26.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.956452732999999, 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:26.596 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:26.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.956422353000001, 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:26.600 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:26.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:26.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:26.604 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.956399615000002, 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:26.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:26.608 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.952193526999999, 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:26.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.946823744, 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:26.612 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:26.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:26.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.946643033000001, 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:26.616 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:26.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.946616188999997, 2024-04-26T12:31:26.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:26.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:26.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.624 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.946576563999997, 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:26.628 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.946502965000001, 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:26.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:26.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.945043302999999, 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:26.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.944759046999998, 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:26.637 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:26.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:26.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.940226373000002, 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:26.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 53.940097324, 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:26.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:26.649 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 49.650751995999997, 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:26.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:26.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:26.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:26.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.655 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:26.655 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:26.655 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:26.656 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:26.657 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:26.655+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:26.757 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:26.756+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:26.798 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:26.798 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:26.798 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:26.807 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:26.859 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:26.858+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:26.880 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:31:26.916 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:31:26.931 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:31:26.931 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:26.959 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:26.958+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:26.975 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:26.975 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:26.975 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:26.976 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:26.976 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:26.986 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:27.060 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:27.059+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 60.223072764999998, 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.115 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:27.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.509834904999998, 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:27.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.125 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.509776842999997, 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:27.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:27.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:27.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:27.131 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.509748289999997, 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:27.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.509728815000003, 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.138 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:27.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:27.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:27.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.509708771, 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.144 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:27.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.509685474000001, 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.150 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.509665032000001, 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.156 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:27.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.509644485999999, 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:27.162 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:27.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:27.166 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.509612492000002, 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:27.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:27.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:27.171 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.508205515999997, 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:27.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:27.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.507551837999998, 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.507329781999999, 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.179 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:27.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:27.183 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.502876565000001, 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:27.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.187 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.497448249999998, 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:27.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.497187879999998, 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:27.192 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:27.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.497154483999999, 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:27.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.496949483000002, 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.201 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:27.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.491323307000002, 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:27.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:27.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:27.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.212 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 54.490943897000001, 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:27.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:27.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:27.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:27.217 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:27.219 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:27.218+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:27.219 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:27.320 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:27.319+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:27.360 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:31:27.362 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:31:27.362 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:27.362 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:27.362 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:27.362 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:27.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:27.374 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-26T12:31:26.981156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81984,"kb_used_data":924,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033536,"statfs":{"total":289910292480,"available":289826340864,"internally_reserved":0,"allocated":946176,"data_stored":1522348,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.558442"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349201+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:31:19.349201+0000","last_peered":"2024-04-26T12:31:19.349201+0000","last_clean":"2024-04-26T12:31:19.349201+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:31:19.349201+0000","last_undegraded":"2024-04-26T12:31:19.349201+0000","last_fullsized":"2024-04-26T12:31:19.349201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349061+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:31:19.349061+0000","last_peered":"2024-04-26T12:31:19.349061+0000","last_clean":"2024-04-26T12:31:19.349061+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:31:19.349061+0000","last_undegraded":"2024-04-26T12:31:19.349061+0000","last_fullsized":"2024-04-26T12:31:19.349061+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425614+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:31:22.425614+0000","last_peered":"2024-04-26T12:31:22.425614+0000","last_clean":"2024-04-26T12:31:22.425614+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:31:22.425614+0000","last_undegraded":"2024-04-26T12:31:22.425614+0000","last_fullsized":"2024-04-26T12:31:22.425614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425534+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:31:22.425534+0000","last_peered":"2024-04-26T12:31:22.425534+0000","last_clean":"2024-04-26T12:31:22.425534+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:31:22.425534+0000","last_undegraded":"2024-04-26T12:31:22.425534+0000","last_fullsized":"2024-04-26T12:31:22.425534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348769+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:31:19.348769+0000","last_peered":"2024-04-26T12:31:19.348769+0000","last_clean":"2024-04-26T12:31:19.348769+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:31:19.348769+0000","last_undegraded":"2024-04-26T12:31:19.348769+0000","last_fullsized":"2024-04-26T12:31:19.348769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444463+0000","last_change":"2024-04-26T12:31:07.232711+0000","last_active":"2024-04-26T12:31:22.444463+0000","last_peered":"2024-04-26T12:31:22.444463+0000","last_clean":"2024-04-26T12:31:22.444463+0000","last_became_active":"2024-04-26T12:31:07.232528+0000","last_became_peered":"2024-04-26T12:31:07.232528+0000","last_unstale":"2024-04-26T12:31:22.444463+0000","last_undegraded":"2024-04-26T12:31:22.444463+0000","last_fullsized":"2024-04-26T12:31:22.444463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:16.731908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444164+0000","last_change":"2024-04-26T12:31:07.231727+0000","last_active":"2024-04-26T12:31:22.444164+0000","last_peered":"2024-04-26T12:31:22.444164+0000","last_clean":"2024-04-26T12:31:22.444164+0000","last_became_active":"2024-04-26T12:31:07.231554+0000","last_became_peered":"2024-04-26T12:31:07.231554+0000","last_unstale":"2024-04-26T12:31:22.444164+0000","last_undegraded":"2024-04-26T12:31:22.444164+0000","last_fullsized":"2024-04-26T12:31:22.444164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:12.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424602+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:31:22.424602+0000","last_peered":"2024-04-26T12:31:22.424602+0000","last_clean":"2024-04-26T12:31:22.424602+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:31:22.424602+0000","last_undegraded":"2024-04-26T12:31:22.424602+0000","last_fullsized":"2024-04-26T12:31:22.424602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444877+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:31:22.444877+0000","last_peered":"2024-04-26T12:31:22.444877+0000","last_clean":"2024-04-26T12:31:22.444877+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:31:22.444877+0000","last_undegraded":"2024-04-26T12:31:22.444877+0000","last_fullsized":"2024-04-26T12:31:22.444877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349073+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:31:19.349073+0000","last_peered":"2024-04-26T12:31:19.349073+0000","last_clean":"2024-04-26T12:31:19.349073+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:31:19.349073+0000","last_undegraded":"2024-04-26T12:31:19.349073+0000","last_fullsized":"2024-04-26T12:31:19.349073+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444687+0000","last_change":"2024-04-26T12:31:07.232741+0000","last_active":"2024-04-26T12:31:22.444687+0000","last_peered":"2024-04-26T12:31:22.444687+0000","last_clean":"2024-04-26T12:31:22.444687+0000","last_became_active":"2024-04-26T12:31:07.232521+0000","last_became_peered":"2024-04-26T12:31:07.232521+0000","last_unstale":"2024-04-26T12:31:22.444687+0000","last_undegraded":"2024-04-26T12:31:22.444687+0000","last_fullsized":"2024-04-26T12:31:22.444687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.363233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348639+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:31:19.348639+0000","last_peered":"2024-04-26T12:31:19.348639+0000","last_clean":"2024-04-26T12:31:19.348639+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:31:19.348639+0000","last_undegraded":"2024-04-26T12:31:19.348639+0000","last_fullsized":"2024-04-26T12:31:19.348639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348696+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:31:19.348696+0000","last_peered":"2024-04-26T12:31:19.348696+0000","last_clean":"2024-04-26T12:31:19.348696+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:31:19.348696+0000","last_undegraded":"2024-04-26T12:31:19.348696+0000","last_fullsized":"2024-04-26T12:31:19.348696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425166+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:31:22.425166+0000","last_peered":"2024-04-26T12:31:22.425166+0000","last_clean":"2024-04-26T12:31:22.425166+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:31:22.425166+0000","last_undegraded":"2024-04-26T12:31:22.425166+0000","last_fullsized":"2024-04-26T12:31:22.425166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424807+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:31:22.424807+0000","last_peered":"2024-04-26T12:31:22.424807+0000","last_clean":"2024-04-26T12:31:22.424807+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:31:22.424807+0000","last_undegraded":"2024-04-26T12:31:22.424807+0000","last_fullsized":"2024-04-26T12:31:22.424807+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444109+0000","last_change":"2024-04-26T12:31:07.233006+0000","last_active":"2024-04-26T12:31:22.444109+0000","last_peered":"2024-04-26T12:31:22.444109+0000","last_clean":"2024-04-26T12:31:22.444109+0000","last_became_active":"2024-04-26T12:31:07.232842+0000","last_became_peered":"2024-04-26T12:31:07.232842+0000","last_unstale":"2024-04-26T12:31:22.444109+0000","last_undegraded":"2024-04-26T12:31:22.444109+0000","last_fullsized":"2024-04-26T12:31:22.444109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.359074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444878+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:31:22.444878+0000","last_peered":"2024-04-26T12:31:22.444878+0000","last_clean":"2024-04-26T12:31:22.444878+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:31:22.444878+0000","last_undegraded":"2024-04-26T12:31:22.444878+0000","last_fullsized":"2024-04-26T12:31:22.444878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349250+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:31:19.349250+0000","last_peered":"2024-04-26T12:31:19.349250+0000","last_clean":"2024-04-26T12:31:19.349250+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:31:19.349250+0000","last_undegraded":"2024-04-26T12:31:19.349250+0000","last_fullsized":"2024-04-26T12:31:19.349250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444789+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:31:22.444789+0000","last_peered":"2024-04-26T12:31:22.444789+0000","last_clean":"2024-04-26T12:31:22.444789+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:31:22.444789+0000","last_undegraded":"2024-04-26T12:31:22.444789+0000","last_fullsized":"2024-04-26T12:31:22.444789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425484+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:31:22.425484+0000","last_peered":"2024-04-26T12:31:22.425484+0000","last_clean":"2024-04-26T12:31:22.425484+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:31:22.425484+0000","last_undegraded":"2024-04-26T12:31:22.425484+0000","last_fullsized":"2024-04-26T12:31:22.425484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425221+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:31:22.425221+0000","last_peered":"2024-04-26T12:31:22.425221+0000","last_clean":"2024-04-26T12:31:22.425221+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:31:22.425221+0000","last_undegraded":"2024-04-26T12:31:22.425221+0000","last_fullsized":"2024-04-26T12:31:22.425221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348791+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:31:19.348791+0000","last_peered":"2024-04-26T12:31:19.348791+0000","last_clean":"2024-04-26T12:31:19.348791+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:31:19.348791+0000","last_undegraded":"2024-04-26T12:31:19.348791+0000","last_fullsized":"2024-04-26T12:31:19.348791+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444435+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:31:22.444435+0000","last_peered":"2024-04-26T12:31:22.444435+0000","last_clean":"2024-04-26T12:31:22.444435+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:31:22.444435+0000","last_undegraded":"2024-04-26T12:31:22.444435+0000","last_fullsized":"2024-04-26T12:31:22.444435+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348588+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:31:19.348588+0000","last_peered":"2024-04-26T12:31:19.348588+0000","last_clean":"2024-04-26T12:31:19.348588+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:31:19.348588+0000","last_undegraded":"2024-04-26T12:31:19.348588+0000","last_fullsized":"2024-04-26T12:31:19.348588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349281+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:31:19.349281+0000","last_peered":"2024-04-26T12:31:19.349281+0000","last_clean":"2024-04-26T12:31:19.349281+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:31:19.349281+0000","last_undegraded":"2024-04-26T12:31:19.349281+0000","last_fullsized":"2024-04-26T12:31:19.349281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444974+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:31:22.444974+0000","last_peered":"2024-04-26T12:31:22.444974+0000","last_clean":"2024-04-26T12:31:22.444974+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:31:22.444974+0000","last_undegraded":"2024-04-26T12:31:22.444974+0000","last_fullsized":"2024-04-26T12:31:22.444974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425482+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:31:22.425482+0000","last_peered":"2024-04-26T12:31:22.425482+0000","last_clean":"2024-04-26T12:31:22.425482+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:31:22.425482+0000","last_undegraded":"2024-04-26T12:31:22.425482+0000","last_fullsized":"2024-04-26T12:31:22.425482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348877+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:31:19.348877+0000","last_peered":"2024-04-26T12:31:19.348877+0000","last_clean":"2024-04-26T12:31:19.348877+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:19.348877+0000","last_undegraded":"2024-04-26T12:31:19.348877+0000","last_fullsized":"2024-04-26T12:31:19.348877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348989+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:31:19.348989+0000","last_peered":"2024-04-26T12:31:19.348989+0000","last_clean":"2024-04-26T12:31:19.348989+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:31:19.348989+0000","last_undegraded":"2024-04-26T12:31:19.348989+0000","last_fullsized":"2024-04-26T12:31:19.348989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444530+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:31:22.444530+0000","last_peered":"2024-04-26T12:31:22.444530+0000","last_clean":"2024-04-26T12:31:22.444530+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:31:22.444530+0000","last_undegraded":"2024-04-26T12:31:22.444530+0000","last_fullsized":"2024-04-26T12:31:22.444530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445192+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:31:22.445192+0000","last_peered":"2024-04-26T12:31:22.445192+0000","last_clean":"2024-04-26T12:31:22.445192+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:31:22.445192+0000","last_undegraded":"2024-04-26T12:31:22.445192+0000","last_fullsized":"2024-04-26T12:31:22.445192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444239+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:31:22.444239+0000","last_peered":"2024-04-26T12:31:22.444239+0000","last_clean":"2024-04-26T12:31:22.444239+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:31:22.444239+0000","last_undegraded":"2024-04-26T12:31:22.444239+0000","last_fullsized":"2024-04-26T12:31:22.444239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349365+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:31:19.349365+0000","last_peered":"2024-04-26T12:31:19.349365+0000","last_clean":"2024-04-26T12:31:19.349365+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:31:19.349365+0000","last_undegraded":"2024-04-26T12:31:19.349365+0000","last_fullsized":"2024-04-26T12:31:19.349365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445067+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:31:22.445067+0000","last_peered":"2024-04-26T12:31:22.445067+0000","last_clean":"2024-04-26T12:31:22.445067+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:31:22.445067+0000","last_undegraded":"2024-04-26T12:31:22.445067+0000","last_fullsized":"2024-04-26T12:31:22.445067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444255+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:31:22.444255+0000","last_peered":"2024-04-26T12:31:22.444255+0000","last_clean":"2024-04-26T12:31:22.444255+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:31:22.444255+0000","last_undegraded":"2024-04-26T12:31:22.444255+0000","last_fullsized":"2024-04-26T12:31:22.444255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445028+0000","last_change":"2024-04-26T12:31:07.233093+0000","last_active":"2024-04-26T12:31:22.445028+0000","last_peered":"2024-04-26T12:31:22.445028+0000","last_clean":"2024-04-26T12:31:22.445028+0000","last_became_active":"2024-04-26T12:31:07.232858+0000","last_became_peered":"2024-04-26T12:31:07.232858+0000","last_unstale":"2024-04-26T12:31:22.445028+0000","last_undegraded":"2024-04-26T12:31:22.445028+0000","last_fullsized":"2024-04-26T12:31:22.445028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.889139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444542+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:31:22.444542+0000","last_peered":"2024-04-26T12:31:22.444542+0000","last_clean":"2024-04-26T12:31:22.444542+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:31:22.444542+0000","last_undegraded":"2024-04-26T12:31:22.444542+0000","last_fullsized":"2024-04-26T12:31:22.444542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349104+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:31:19.349104+0000","last_peered":"2024-04-26T12:31:19.349104+0000","last_clean":"2024-04-26T12:31:19.349104+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:31:19.349104+0000","last_undegraded":"2024-04-26T12:31:19.349104+0000","last_fullsized":"2024-04-26T12:31:19.349104+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444541+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:31:22.444541+0000","last_peered":"2024-04-26T12:31:22.444541+0000","last_clean":"2024-04-26T12:31:22.444541+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:31:22.444541+0000","last_undegraded":"2024-04-26T12:31:22.444541+0000","last_fullsized":"2024-04-26T12:31:22.444541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425422+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:31:22.425422+0000","last_peered":"2024-04-26T12:31:22.425422+0000","last_clean":"2024-04-26T12:31:22.425422+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:31:22.425422+0000","last_undegraded":"2024-04-26T12:31:22.425422+0000","last_fullsized":"2024-04-26T12:31:22.425422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425516+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:31:22.425516+0000","last_peered":"2024-04-26T12:31:22.425516+0000","last_clean":"2024-04-26T12:31:22.425516+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:31:22.425516+0000","last_undegraded":"2024-04-26T12:31:22.425516+0000","last_fullsized":"2024-04-26T12:31:22.425516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425485+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:31:22.425485+0000","last_peered":"2024-04-26T12:31:22.425485+0000","last_clean":"2024-04-26T12:31:22.425485+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:31:22.425485+0000","last_undegraded":"2024-04-26T12:31:22.425485+0000","last_fullsized":"2024-04-26T12:31:22.425485+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348798+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:31:19.348798+0000","last_peered":"2024-04-26T12:31:19.348798+0000","last_clean":"2024-04-26T12:31:19.348798+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:31:19.348798+0000","last_undegraded":"2024-04-26T12:31:19.348798+0000","last_fullsized":"2024-04-26T12:31:19.348798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444813+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:31:22.444813+0000","last_peered":"2024-04-26T12:31:22.444813+0000","last_clean":"2024-04-26T12:31:22.444813+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:31:22.444813+0000","last_undegraded":"2024-04-26T12:31:22.444813+0000","last_fullsized":"2024-04-26T12:31:22.444813+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349193+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:31:19.349193+0000","last_peered":"2024-04-26T12:31:19.349193+0000","last_clean":"2024-04-26T12:31:19.349193+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:31:19.349193+0000","last_undegraded":"2024-04-26T12:31:19.349193+0000","last_fullsized":"2024-04-26T12:31:19.349193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348613+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:31:19.348613+0000","last_peered":"2024-04-26T12:31:19.348613+0000","last_clean":"2024-04-26T12:31:19.348613+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:31:19.348613+0000","last_undegraded":"2024-04-26T12:31:19.348613+0000","last_fullsized":"2024-04-26T12:31:19.348613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445131+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:31:22.445131+0000","last_peered":"2024-04-26T12:31:22.445131+0000","last_clean":"2024-04-26T12:31:22.445131+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:31:22.445131+0000","last_undegraded":"2024-04-26T12:31:22.445131+0000","last_fullsized":"2024-04-26T12:31:22.445131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424983+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:31:22.424983+0000","last_peered":"2024-04-26T12:31:22.424983+0000","last_clean":"2024-04-26T12:31:22.424983+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:31:22.424983+0000","last_undegraded":"2024-04-26T12:31:22.424983+0000","last_fullsized":"2024-04-26T12:31:22.424983+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445160+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:31:22.445160+0000","last_peered":"2024-04-26T12:31:22.445160+0000","last_clean":"2024-04-26T12:31:22.445160+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:31:22.445160+0000","last_undegraded":"2024-04-26T12:31:22.445160+0000","last_fullsized":"2024-04-26T12:31:22.445160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425771+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:31:22.425771+0000","last_peered":"2024-04-26T12:31:22.425771+0000","last_clean":"2024-04-26T12:31:22.425771+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:31:22.425771+0000","last_undegraded":"2024-04-26T12:31:22.425771+0000","last_fullsized":"2024-04-26T12:31:22.425771+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348734+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:31:19.348734+0000","last_peered":"2024-04-26T12:31:19.348734+0000","last_clean":"2024-04-26T12:31:19.348734+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:31:19.348734+0000","last_undegraded":"2024-04-26T12:31:19.348734+0000","last_fullsized":"2024-04-26T12:31:19.348734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349114+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:31:19.349114+0000","last_peered":"2024-04-26T12:31:19.349114+0000","last_clean":"2024-04-26T12:31:19.349114+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:31:19.349114+0000","last_undegraded":"2024-04-26T12:31:19.349114+0000","last_fullsized":"2024-04-26T12:31:19.349114+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348981+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:31:19.348981+0000","last_peered":"2024-04-26T12:31:19.348981+0000","last_clean":"2024-04-26T12:31:19.348981+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:31:19.348981+0000","last_undegraded":"2024-04-26T12:31:19.348981+0000","last_fullsized":"2024-04-26T12:31:19.348981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348898+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:31:19.348898+0000","last_peered":"2024-04-26T12:31:19.348898+0000","last_clean":"2024-04-26T12:31:19.348898+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:31:19.348898+0000","last_undegraded":"2024-04-26T12:31:19.348898+0000","last_fullsized":"2024-04-26T12:31:19.348898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425050+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:31:22.425050+0000","last_peered":"2024-04-26T12:31:22.425050+0000","last_clean":"2024-04-26T12:31:22.425050+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:31:22.425050+0000","last_undegraded":"2024-04-26T12:31:22.425050+0000","last_fullsized":"2024-04-26T12:31:22.425050+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425207+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:31:22.425207+0000","last_peered":"2024-04-26T12:31:22.425207+0000","last_clean":"2024-04-26T12:31:22.425207+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:31:22.425207+0000","last_undegraded":"2024-04-26T12:31:22.425207+0000","last_fullsized":"2024-04-26T12:31:22.425207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444743+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:31:22.444743+0000","last_peered":"2024-04-26T12:31:22.444743+0000","last_clean":"2024-04-26T12:31:22.444743+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:31:22.444743+0000","last_undegraded":"2024-04-26T12:31:22.444743+0000","last_fullsized":"2024-04-26T12:31:22.444743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444704+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:31:22.444704+0000","last_peered":"2024-04-26T12:31:22.444704+0000","last_clean":"2024-04-26T12:31:22.444704+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:31:22.444704+0000","last_undegraded":"2024-04-26T12:31:22.444704+0000","last_fullsized":"2024-04-26T12:31:22.444704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425230+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:31:22.425230+0000","last_peered":"2024-04-26T12:31:22.425230+0000","last_clean":"2024-04-26T12:31:22.425230+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:31:22.425230+0000","last_undegraded":"2024-04-26T12:31:22.425230+0000","last_fullsized":"2024-04-26T12:31:22.425230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424895+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:31:22.424895+0000","last_peered":"2024-04-26T12:31:22.424895+0000","last_clean":"2024-04-26T12:31:22.424895+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:31:22.424895+0000","last_undegraded":"2024-04-26T12:31:22.424895+0000","last_fullsized":"2024-04-26T12:31:22.424895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425739+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:31:22.425739+0000","last_peered":"2024-04-26T12:31:22.425739+0000","last_clean":"2024-04-26T12:31:22.425739+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:31:22.425739+0000","last_undegraded":"2024-04-26T12:31:22.425739+0000","last_fullsized":"2024-04-26T12:31:22.425739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348500+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:31:19.348500+0000","last_peered":"2024-04-26T12:31:19.348500+0000","last_clean":"2024-04-26T12:31:19.348500+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:31:19.348500+0000","last_undegraded":"2024-04-26T12:31:19.348500+0000","last_fullsized":"2024-04-26T12:31:19.348500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425620+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:31:22.425620+0000","last_peered":"2024-04-26T12:31:22.425620+0000","last_clean":"2024-04-26T12:31:22.425620+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:31:22.425620+0000","last_undegraded":"2024-04-26T12:31:22.425620+0000","last_fullsized":"2024-04-26T12:31:22.425620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348521+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:31:19.348521+0000","last_peered":"2024-04-26T12:31:19.348521+0000","last_clean":"2024-04-26T12:31:19.348521+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:31:19.348521+0000","last_undegraded":"2024-04-26T12:31:19.348521+0000","last_fullsized":"2024-04-26T12:31:19.348521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444975+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:31:22.444975+0000","last_peered":"2024-04-26T12:31:22.444975+0000","last_clean":"2024-04-26T12:31:22.444975+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:31:22.444975+0000","last_undegraded":"2024-04-26T12:31:22.444975+0000","last_fullsized":"2024-04-26T12:31:22.444975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445072+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:31:22.445072+0000","last_peered":"2024-04-26T12:31:22.445072+0000","last_clean":"2024-04-26T12:31:22.445072+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:31:22.445072+0000","last_undegraded":"2024-04-26T12:31:22.445072+0000","last_fullsized":"2024-04-26T12:31:22.445072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425623+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:31:22.425623+0000","last_peered":"2024-04-26T12:31:22.425623+0000","last_clean":"2024-04-26T12:31:22.425623+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:31:22.425623+0000","last_undegraded":"2024-04-26T12:31:22.425623+0000","last_fullsized":"2024-04-26T12:31:22.425623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348889+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:31:19.348889+0000","last_peered":"2024-04-26T12:31:19.348889+0000","last_clean":"2024-04-26T12:31:19.348889+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:31:19.348889+0000","last_undegraded":"2024-04-26T12:31:19.348889+0000","last_fullsized":"2024-04-26T12:31:19.348889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425128+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:31:22.425128+0000","last_peered":"2024-04-26T12:31:22.425128+0000","last_clean":"2024-04-26T12:31:22.425128+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:31:22.425128+0000","last_undegraded":"2024-04-26T12:31:22.425128+0000","last_fullsized":"2024-04-26T12:31:22.425128+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425350+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:31:22.425350+0000","last_peered":"2024-04-26T12:31:22.425350+0000","last_clean":"2024-04-26T12:31:22.425350+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:31:22.425350+0000","last_undegraded":"2024-04-26T12:31:22.425350+0000","last_fullsized":"2024-04-26T12:31:22.425350+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444980+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:31:22.444980+0000","last_peered":"2024-04-26T12:31:22.444980+0000","last_clean":"2024-04-26T12:31:22.444980+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:31:22.444980+0000","last_undegraded":"2024-04-26T12:31:22.444980+0000","last_fullsized":"2024-04-26T12:31:22.444980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444391+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:31:22.444391+0000","last_peered":"2024-04-26T12:31:22.444391+0000","last_clean":"2024-04-26T12:31:22.444391+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:31:22.444391+0000","last_undegraded":"2024-04-26T12:31:22.444391+0000","last_fullsized":"2024-04-26T12:31:22.444391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348513+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:31:19.348513+0000","last_peered":"2024-04-26T12:31:19.348513+0000","last_clean":"2024-04-26T12:31:19.348513+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:31:19.348513+0000","last_undegraded":"2024-04-26T12:31:19.348513+0000","last_fullsized":"2024-04-26T12:31:19.348513+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445123+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:31:22.445123+0000","last_peered":"2024-04-26T12:31:22.445123+0000","last_clean":"2024-04-26T12:31:22.445123+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:31:22.445123+0000","last_undegraded":"2024-04-26T12:31:22.445123+0000","last_fullsized":"2024-04-26T12:31:22.445123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425410+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:31:22.425410+0000","last_peered":"2024-04-26T12:31:22.425410+0000","last_clean":"2024-04-26T12:31:22.425410+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:31:22.425410+0000","last_undegraded":"2024-04-26T12:31:22.425410+0000","last_fullsized":"2024-04-26T12:31:22.425410+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424821+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:31:22.424821+0000","last_peered":"2024-04-26T12:31:22.424821+0000","last_clean":"2024-04-26T12:31:22.424821+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:31:22.424821+0000","last_undegraded":"2024-04-26T12:31:22.424821+0000","last_fullsized":"2024-04-26T12:31:22.424821+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444429+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:31:22.444429+0000","last_peered":"2024-04-26T12:31:22.444429+0000","last_clean":"2024-04-26T12:31:22.444429+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:31:22.444429+0000","last_undegraded":"2024-04-26T12:31:22.444429+0000","last_fullsized":"2024-04-26T12:31:22.444429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348691+0000","last_change":"2024-04-26T12:31:07.233644+0000","last_active":"2024-04-26T12:31:19.348691+0000","last_peered":"2024-04-26T12:31:19.348691+0000","last_clean":"2024-04-26T12:31:19.348691+0000","last_became_active":"2024-04-26T12:31:07.233477+0000","last_became_peered":"2024-04-26T12:31:07.233477+0000","last_unstale":"2024-04-26T12:31:19.348691+0000","last_undegraded":"2024-04-26T12:31:19.348691+0000","last_fullsized":"2024-04-26T12:31:19.348691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:24.149502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424768+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:31:22.424768+0000","last_peered":"2024-04-26T12:31:22.424768+0000","last_clean":"2024-04-26T12:31:22.424768+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:31:22.424768+0000","last_undegraded":"2024-04-26T12:31:22.424768+0000","last_fullsized":"2024-04-26T12:31:22.424768+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444274+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:31:22.444274+0000","last_peered":"2024-04-26T12:31:22.444274+0000","last_clean":"2024-04-26T12:31:22.444274+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:31:22.444274+0000","last_undegraded":"2024-04-26T12:31:22.444274+0000","last_fullsized":"2024-04-26T12:31:22.444274+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349207+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:31:19.349207+0000","last_peered":"2024-04-26T12:31:19.349207+0000","last_clean":"2024-04-26T12:31:19.349207+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:31:19.349207+0000","last_undegraded":"2024-04-26T12:31:19.349207+0000","last_fullsized":"2024-04-26T12:31:19.349207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349088+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:31:19.349088+0000","last_peered":"2024-04-26T12:31:19.349088+0000","last_clean":"2024-04-26T12:31:19.349088+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:31:19.349088+0000","last_undegraded":"2024-04-26T12:31:19.349088+0000","last_fullsized":"2024-04-26T12:31:19.349088+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444894+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:31:22.444894+0000","last_peered":"2024-04-26T12:31:22.444894+0000","last_clean":"2024-04-26T12:31:22.444894+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:31:22.444894+0000","last_undegraded":"2024-04-26T12:31:22.444894+0000","last_fullsized":"2024-04-26T12:31:22.444894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348957+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:31:19.348957+0000","last_peered":"2024-04-26T12:31:19.348957+0000","last_clean":"2024-04-26T12:31:19.348957+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:31:19.348957+0000","last_undegraded":"2024-04-26T12:31:19.348957+0000","last_fullsized":"2024-04-26T12:31:19.348957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444974+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:31:22.444974+0000","last_peered":"2024-04-26T12:31:22.444974+0000","last_clean":"2024-04-26T12:31:22.444974+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:31:22.444974+0000","last_undegraded":"2024-04-26T12:31:22.444974+0000","last_fullsized":"2024-04-26T12:31:22.444974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445051+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:31:22.445051+0000","last_peered":"2024-04-26T12:31:22.445051+0000","last_clean":"2024-04-26T12:31:22.445051+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:31:22.445051+0000","last_undegraded":"2024-04-26T12:31:22.445051+0000","last_fullsized":"2024-04-26T12:31:22.445051+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444364+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:31:22.444364+0000","last_peered":"2024-04-26T12:31:22.444364+0000","last_clean":"2024-04-26T12:31:22.444364+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:31:22.444364+0000","last_undegraded":"2024-04-26T12:31:22.444364+0000","last_fullsized":"2024-04-26T12:31:22.444364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425833+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:31:22.425833+0000","last_peered":"2024-04-26T12:31:22.425833+0000","last_clean":"2024-04-26T12:31:22.425833+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:31:22.425833+0000","last_undegraded":"2024-04-26T12:31:22.425833+0000","last_fullsized":"2024-04-26T12:31:22.425833+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445124+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:31:22.445124+0000","last_peered":"2024-04-26T12:31:22.445124+0000","last_clean":"2024-04-26T12:31:22.445124+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:31:22.445124+0000","last_undegraded":"2024-04-26T12:31:22.445124+0000","last_fullsized":"2024-04-26T12:31:22.445124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348880+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:31:19.348880+0000","last_peered":"2024-04-26T12:31:19.348880+0000","last_clean":"2024-04-26T12:31:19.348880+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:31:19.348880+0000","last_undegraded":"2024-04-26T12:31:19.348880+0000","last_fullsized":"2024-04-26T12:31:19.348880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348942+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:31:19.348942+0000","last_peered":"2024-04-26T12:31:19.348942+0000","last_clean":"2024-04-26T12:31:19.348942+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:31:19.348942+0000","last_undegraded":"2024-04-26T12:31:19.348942+0000","last_fullsized":"2024-04-26T12:31:19.348942+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348892+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:31:19.348892+0000","last_peered":"2024-04-26T12:31:19.348892+0000","last_clean":"2024-04-26T12:31:19.348892+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:31:19.348892+0000","last_undegraded":"2024-04-26T12:31:19.348892+0000","last_fullsized":"2024-04-26T12:31:19.348892+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425354+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:31:22.425354+0000","last_peered":"2024-04-26T12:31:22.425354+0000","last_clean":"2024-04-26T12:31:22.425354+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:31:22.425354+0000","last_undegraded":"2024-04-26T12:31:22.425354+0000","last_fullsized":"2024-04-26T12:31:22.425354+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425304+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:31:22.425304+0000","last_peered":"2024-04-26T12:31:22.425304+0000","last_clean":"2024-04-26T12:31:22.425304+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:31:22.425304+0000","last_undegraded":"2024-04-26T12:31:22.425304+0000","last_fullsized":"2024-04-26T12:31:22.425304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349169+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:31:19.349169+0000","last_peered":"2024-04-26T12:31:19.349169+0000","last_clean":"2024-04-26T12:31:19.349169+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:31:19.349169+0000","last_undegraded":"2024-04-26T12:31:19.349169+0000","last_fullsized":"2024-04-26T12:31:19.349169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424925+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:31:22.424925+0000","last_peered":"2024-04-26T12:31:22.424925+0000","last_clean":"2024-04-26T12:31:22.424925+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:31:22.424925+0000","last_undegraded":"2024-04-26T12:31:22.424925+0000","last_fullsized":"2024-04-26T12:31:22.424925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445209+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:31:22.445209+0000","last_peered":"2024-04-26T12:31:22.445209+0000","last_clean":"2024-04-26T12:31:22.445209+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:22.445209+0000","last_undegraded":"2024-04-26T12:31:22.445209+0000","last_fullsized":"2024-04-26T12:31:22.445209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348451+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:31:19.348451+0000","last_peered":"2024-04-26T12:31:19.348451+0000","last_clean":"2024-04-26T12:31:19.348451+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:31:19.348451+0000","last_undegraded":"2024-04-26T12:31:19.348451+0000","last_fullsized":"2024-04-26T12:31:19.348451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445079+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:31:22.445079+0000","last_peered":"2024-04-26T12:31:22.445079+0000","last_clean":"2024-04-26T12:31:22.445079+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:31:22.445079+0000","last_undegraded":"2024-04-26T12:31:22.445079+0000","last_fullsized":"2024-04-26T12:31:22.445079+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425097+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:31:22.425097+0000","last_peered":"2024-04-26T12:31:22.425097+0000","last_clean":"2024-04-26T12:31:22.425097+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:31:22.425097+0000","last_undegraded":"2024-04-26T12:31:22.425097+0000","last_fullsized":"2024-04-26T12:31:22.425097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425001+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:31:22.425001+0000","last_peered":"2024-04-26T12:31:22.425001+0000","last_clean":"2024-04-26T12:31:22.425001+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:31:22.425001+0000","last_undegraded":"2024-04-26T12:31:22.425001+0000","last_fullsized":"2024-04-26T12:31:22.425001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444296+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:31:22.444296+0000","last_peered":"2024-04-26T12:31:22.444296+0000","last_clean":"2024-04-26T12:31:22.444296+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:31:22.444296+0000","last_undegraded":"2024-04-26T12:31:22.444296+0000","last_fullsized":"2024-04-26T12:31:22.444296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348976+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:31:19.348976+0000","last_peered":"2024-04-26T12:31:19.348976+0000","last_clean":"2024-04-26T12:31:19.348976+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:31:19.348976+0000","last_undegraded":"2024-04-26T12:31:19.348976+0000","last_fullsized":"2024-04-26T12:31:19.348976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444845+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:31:22.444845+0000","last_peered":"2024-04-26T12:31:22.444845+0000","last_clean":"2024-04-26T12:31:22.444845+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:31:22.444845+0000","last_undegraded":"2024-04-26T12:31:22.444845+0000","last_fullsized":"2024-04-26T12:31:22.444845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348958+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:31:19.348958+0000","last_peered":"2024-04-26T12:31:19.348958+0000","last_clean":"2024-04-26T12:31:19.348958+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:31:19.348958+0000","last_undegraded":"2024-04-26T12:31:19.348958+0000","last_fullsized":"2024-04-26T12:31:19.348958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738382,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":707044,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.252}]},{"osd":1,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.311}]}]},{"osd":0,"up_from":8,"seq":34359738382,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":108876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":706428,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.27900000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:27.379 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:27.420 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:27.419+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:27.498 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:27.499 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:27.499 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:27.499 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:27.499 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:27.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:27.521 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:27.520+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:27.623 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:27.622+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:27.643 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:27.678 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:27.678 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:27.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:27.678 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:27.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.678 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:27.678 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:27.678 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 60.386663660000004, 2024-04-26T12:31:27.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:27.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:27.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:27.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073407498999998, 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:27.684 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073365819999999, 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.690 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:27.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073337041000002, 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.696 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:27.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.699 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073307393, 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:27.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:27.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073268579, 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:27.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:27.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:27.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:27.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073239790999999, 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:27.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:27.719 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073212650000002, 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:27.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.725 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073170930000003, 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:27.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.731 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073127812999999, 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:27.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:27.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:27.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073109127000002, 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:27.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:27.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:27.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.743 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073086257999996, 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:27.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:27.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073055375999999, 2024-04-26T12:31:27.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073037905, 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.755 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:27.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:27.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.073015169999998, 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:27.766 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.072985627999998, 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:27.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:27.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.772 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.072960186000003, 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:27.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:27.778 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.072931019999999, 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:27.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.072917095000001, 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:27.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:27.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 55.072899759999999, 2024-04-26T12:31:27.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:27.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:27.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:27.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:27.793 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:27.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:27.795 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:27.794+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:27.811 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:27.821 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:31:27.826 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:31:27.841 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-26T12:31:26.981156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81984,"kb_used_data":924,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033536,"statfs":{"total":289910292480,"available":289826340864,"internally_reserved":0,"allocated":946176,"data_stored":1522348,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.558442"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349201+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:31:19.349201+0000","last_peered":"2024-04-26T12:31:19.349201+0000","last_clean":"2024-04-26T12:31:19.349201+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:31:19.349201+0000","last_undegraded":"2024-04-26T12:31:19.349201+0000","last_fullsized":"2024-04-26T12:31:19.349201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349061+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:31:19.349061+0000","last_peered":"2024-04-26T12:31:19.349061+0000","last_clean":"2024-04-26T12:31:19.349061+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:31:19.349061+0000","last_undegraded":"2024-04-26T12:31:19.349061+0000","last_fullsized":"2024-04-26T12:31:19.349061+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425614+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:31:22.425614+0000","last_peered":"2024-04-26T12:31:22.425614+0000","last_clean":"2024-04-26T12:31:22.425614+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:31:22.425614+0000","last_undegraded":"2024-04-26T12:31:22.425614+0000","last_fullsized":"2024-04-26T12:31:22.425614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425534+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:31:22.425534+0000","last_peered":"2024-04-26T12:31:22.425534+0000","last_clean":"2024-04-26T12:31:22.425534+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:31:22.425534+0000","last_undegraded":"2024-04-26T12:31:22.425534+0000","last_fullsized":"2024-04-26T12:31:22.425534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348769+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:31:19.348769+0000","last_peered":"2024-04-26T12:31:19.348769+0000","last_clean":"2024-04-26T12:31:19.348769+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:31:19.348769+0000","last_undegraded":"2024-04-26T12:31:19.348769+0000","last_fullsized":"2024-04-26T12:31:19.348769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444463+0000","last_change":"2024-04-26T12:31:07.232711+0000","last_active":"2024-04-26T12:31:22.444463+0000","last_peered":"2024-04-26T12:31:22.444463+0000","last_clean":"2024-04-26T12:31:22.444463+0000","last_became_active":"2024-04-26T12:31:07.232528+0000","last_became_peered":"2024-04-26T12:31:07.232528+0000","last_unstale":"2024-04-26T12:31:22.444463+0000","last_undegraded":"2024-04-26T12:31:22.444463+0000","last_fullsized":"2024-04-26T12:31:22.444463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:16.731908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444164+0000","last_change":"2024-04-26T12:31:07.231727+0000","last_active":"2024-04-26T12:31:22.444164+0000","last_peered":"2024-04-26T12:31:22.444164+0000","last_clean":"2024-04-26T12:31:22.444164+0000","last_became_active":"2024-04-26T12:31:07.231554+0000","last_became_peered":"2024-04-26T12:31:07.231554+0000","last_unstale":"2024-04-26T12:31:22.444164+0000","last_undegraded":"2024-04-26T12:31:22.444164+0000","last_fullsized":"2024-04-26T12:31:22.444164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:12.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424602+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:31:22.424602+0000","last_peered":"2024-04-26T12:31:22.424602+0000","last_clean":"2024-04-26T12:31:22.424602+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:31:22.424602+0000","last_undegraded":"2024-04-26T12:31:22.424602+0000","last_fullsized":"2024-04-26T12:31:22.424602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444877+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:31:22.444877+0000","last_peered":"2024-04-26T12:31:22.444877+0000","last_clean":"2024-04-26T12:31:22.444877+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:31:22.444877+0000","last_undegraded":"2024-04-26T12:31:22.444877+0000","last_fullsized":"2024-04-26T12:31:22.444877+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349073+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:31:19.349073+0000","last_peered":"2024-04-26T12:31:19.349073+0000","last_clean":"2024-04-26T12:31:19.349073+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:31:19.349073+0000","last_undegraded":"2024-04-26T12:31:19.349073+0000","last_fullsized":"2024-04-26T12:31:19.349073+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444687+0000","last_change":"2024-04-26T12:31:07.232741+0000","last_active":"2024-04-26T12:31:22.444687+0000","last_peered":"2024-04-26T12:31:22.444687+0000","last_clean":"2024-04-26T12:31:22.444687+0000","last_became_active":"2024-04-26T12:31:07.232521+0000","last_became_peered":"2024-04-26T12:31:07.232521+0000","last_unstale":"2024-04-26T12:31:22.444687+0000","last_undegraded":"2024-04-26T12:31:22.444687+0000","last_fullsized":"2024-04-26T12:31:22.444687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.363233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348639+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:31:19.348639+0000","last_peered":"2024-04-26T12:31:19.348639+0000","last_clean":"2024-04-26T12:31:19.348639+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:31:19.348639+0000","last_undegraded":"2024-04-26T12:31:19.348639+0000","last_fullsized":"2024-04-26T12:31:19.348639+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348696+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:31:19.348696+0000","last_peered":"2024-04-26T12:31:19.348696+0000","last_clean":"2024-04-26T12:31:19.348696+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:31:19.348696+0000","last_undegraded":"2024-04-26T12:31:19.348696+0000","last_fullsized":"2024-04-26T12:31:19.348696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425166+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:31:22.425166+0000","last_peered":"2024-04-26T12:31:22.425166+0000","last_clean":"2024-04-26T12:31:22.425166+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:31:22.425166+0000","last_undegraded":"2024-04-26T12:31:22.425166+0000","last_fullsized":"2024-04-26T12:31:22.425166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424807+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:31:22.424807+0000","last_peered":"2024-04-26T12:31:22.424807+0000","last_clean":"2024-04-26T12:31:22.424807+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:31:22.424807+0000","last_undegraded":"2024-04-26T12:31:22.424807+0000","last_fullsized":"2024-04-26T12:31:22.424807+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444109+0000","last_change":"2024-04-26T12:31:07.233006+0000","last_active":"2024-04-26T12:31:22.444109+0000","last_peered":"2024-04-26T12:31:22.444109+0000","last_clean":"2024-04-26T12:31:22.444109+0000","last_became_active":"2024-04-26T12:31:07.232842+0000","last_became_peered":"2024-04-26T12:31:07.232842+0000","last_unstale":"2024-04-26T12:31:22.444109+0000","last_undegraded":"2024-04-26T12:31:22.444109+0000","last_fullsized":"2024-04-26T12:31:22.444109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.359074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444878+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:31:22.444878+0000","last_peered":"2024-04-26T12:31:22.444878+0000","last_clean":"2024-04-26T12:31:22.444878+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:31:22.444878+0000","last_undegraded":"2024-04-26T12:31:22.444878+0000","last_fullsized":"2024-04-26T12:31:22.444878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349250+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:31:19.349250+0000","last_peered":"2024-04-26T12:31:19.349250+0000","last_clean":"2024-04-26T12:31:19.349250+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:31:19.349250+0000","last_undegraded":"2024-04-26T12:31:19.349250+0000","last_fullsized":"2024-04-26T12:31:19.349250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444789+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:31:22.444789+0000","last_peered":"2024-04-26T12:31:22.444789+0000","last_clean":"2024-04-26T12:31:22.444789+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:31:22.444789+0000","last_undegraded":"2024-04-26T12:31:22.444789+0000","last_fullsized":"2024-04-26T12:31:22.444789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425484+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:31:22.425484+0000","last_peered":"2024-04-26T12:31:22.425484+0000","last_clean":"2024-04-26T12:31:22.425484+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:31:22.425484+0000","last_undegraded":"2024-04-26T12:31:22.425484+0000","last_fullsized":"2024-04-26T12:31:22.425484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425221+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:31:22.425221+0000","last_peered":"2024-04-26T12:31:22.425221+0000","last_clean":"2024-04-26T12:31:22.425221+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:31:22.425221+0000","last_undegraded":"2024-04-26T12:31:22.425221+0000","last_fullsized":"2024-04-26T12:31:22.425221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348791+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:31:19.348791+0000","last_peered":"2024-04-26T12:31:19.348791+0000","last_clean":"2024-04-26T12:31:19.348791+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:31:19.348791+0000","last_undegraded":"2024-04-26T12:31:19.348791+0000","last_fullsized":"2024-04-26T12:31:19.348791+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444435+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:31:22.444435+0000","last_peered":"2024-04-26T12:31:22.444435+0000","last_clean":"2024-04-26T12:31:22.444435+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:31:22.444435+0000","last_undegraded":"2024-04-26T12:31:22.444435+0000","last_fullsized":"2024-04-26T12:31:22.444435+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348588+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:31:19.348588+0000","last_peered":"2024-04-26T12:31:19.348588+0000","last_clean":"2024-04-26T12:31:19.348588+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:31:19.348588+0000","last_undegraded":"2024-04-26T12:31:19.348588+0000","last_fullsized":"2024-04-26T12:31:19.348588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349281+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:31:19.349281+0000","last_peered":"2024-04-26T12:31:19.349281+0000","last_clean":"2024-04-26T12:31:19.349281+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:31:19.349281+0000","last_undegraded":"2024-04-26T12:31:19.349281+0000","last_fullsized":"2024-04-26T12:31:19.349281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444974+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:31:22.444974+0000","last_peered":"2024-04-26T12:31:22.444974+0000","last_clean":"2024-04-26T12:31:22.444974+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:31:22.444974+0000","last_undegraded":"2024-04-26T12:31:22.444974+0000","last_fullsized":"2024-04-26T12:31:22.444974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425482+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:31:22.425482+0000","last_peered":"2024-04-26T12:31:22.425482+0000","last_clean":"2024-04-26T12:31:22.425482+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:31:22.425482+0000","last_undegraded":"2024-04-26T12:31:22.425482+0000","last_fullsized":"2024-04-26T12:31:22.425482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348877+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:31:19.348877+0000","last_peered":"2024-04-26T12:31:19.348877+0000","last_clean":"2024-04-26T12:31:19.348877+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:19.348877+0000","last_undegraded":"2024-04-26T12:31:19.348877+0000","last_fullsized":"2024-04-26T12:31:19.348877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348989+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:31:19.348989+0000","last_peered":"2024-04-26T12:31:19.348989+0000","last_clean":"2024-04-26T12:31:19.348989+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:31:19.348989+0000","last_undegraded":"2024-04-26T12:31:19.348989+0000","last_fullsized":"2024-04-26T12:31:19.348989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444530+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:31:22.444530+0000","last_peered":"2024-04-26T12:31:22.444530+0000","last_clean":"2024-04-26T12:31:22.444530+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:31:22.444530+0000","last_undegraded":"2024-04-26T12:31:22.444530+0000","last_fullsized":"2024-04-26T12:31:22.444530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445192+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:31:22.445192+0000","last_peered":"2024-04-26T12:31:22.445192+0000","last_clean":"2024-04-26T12:31:22.445192+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:31:22.445192+0000","last_undegraded":"2024-04-26T12:31:22.445192+0000","last_fullsized":"2024-04-26T12:31:22.445192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444239+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:31:22.444239+0000","last_peered":"2024-04-26T12:31:22.444239+0000","last_clean":"2024-04-26T12:31:22.444239+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:31:22.444239+0000","last_undegraded":"2024-04-26T12:31:22.444239+0000","last_fullsized":"2024-04-26T12:31:22.444239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349365+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:31:19.349365+0000","last_peered":"2024-04-26T12:31:19.349365+0000","last_clean":"2024-04-26T12:31:19.349365+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:31:19.349365+0000","last_undegraded":"2024-04-26T12:31:19.349365+0000","last_fullsized":"2024-04-26T12:31:19.349365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445067+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:31:22.445067+0000","last_peered":"2024-04-26T12:31:22.445067+0000","last_clean":"2024-04-26T12:31:22.445067+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:31:22.445067+0000","last_undegraded":"2024-04-26T12:31:22.445067+0000","last_fullsized":"2024-04-26T12:31:22.445067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444255+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:31:22.444255+0000","last_peered":"2024-04-26T12:31:22.444255+0000","last_clean":"2024-04-26T12:31:22.444255+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:31:22.444255+0000","last_undegraded":"2024-04-26T12:31:22.444255+0000","last_fullsized":"2024-04-26T12:31:22.444255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445028+0000","last_change":"2024-04-26T12:31:07.233093+0000","last_active":"2024-04-26T12:31:22.445028+0000","last_peered":"2024-04-26T12:31:22.445028+0000","last_clean":"2024-04-26T12:31:22.445028+0000","last_became_active":"2024-04-26T12:31:07.232858+0000","last_became_peered":"2024-04-26T12:31:07.232858+0000","last_unstale":"2024-04-26T12:31:22.445028+0000","last_undegraded":"2024-04-26T12:31:22.445028+0000","last_fullsized":"2024-04-26T12:31:22.445028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.889139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444542+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:31:22.444542+0000","last_peered":"2024-04-26T12:31:22.444542+0000","last_clean":"2024-04-26T12:31:22.444542+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:31:22.444542+0000","last_undegraded":"2024-04-26T12:31:22.444542+0000","last_fullsized":"2024-04-26T12:31:22.444542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349104+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:31:19.349104+0000","last_peered":"2024-04-26T12:31:19.349104+0000","last_clean":"2024-04-26T12:31:19.349104+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:31:19.349104+0000","last_undegraded":"2024-04-26T12:31:19.349104+0000","last_fullsized":"2024-04-26T12:31:19.349104+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444541+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:31:22.444541+0000","last_peered":"2024-04-26T12:31:22.444541+0000","last_clean":"2024-04-26T12:31:22.444541+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:31:22.444541+0000","last_undegraded":"2024-04-26T12:31:22.444541+0000","last_fullsized":"2024-04-26T12:31:22.444541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425422+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:31:22.425422+0000","last_peered":"2024-04-26T12:31:22.425422+0000","last_clean":"2024-04-26T12:31:22.425422+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:31:22.425422+0000","last_undegraded":"2024-04-26T12:31:22.425422+0000","last_fullsized":"2024-04-26T12:31:22.425422+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425516+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:31:22.425516+0000","last_peered":"2024-04-26T12:31:22.425516+0000","last_clean":"2024-04-26T12:31:22.425516+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:31:22.425516+0000","last_undegraded":"2024-04-26T12:31:22.425516+0000","last_fullsized":"2024-04-26T12:31:22.425516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425485+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:31:22.425485+0000","last_peered":"2024-04-26T12:31:22.425485+0000","last_clean":"2024-04-26T12:31:22.425485+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:31:22.425485+0000","last_undegraded":"2024-04-26T12:31:22.425485+0000","last_fullsized":"2024-04-26T12:31:22.425485+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348798+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:31:19.348798+0000","last_peered":"2024-04-26T12:31:19.348798+0000","last_clean":"2024-04-26T12:31:19.348798+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:31:19.348798+0000","last_undegraded":"2024-04-26T12:31:19.348798+0000","last_fullsized":"2024-04-26T12:31:19.348798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444813+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:31:22.444813+0000","last_peered":"2024-04-26T12:31:22.444813+0000","last_clean":"2024-04-26T12:31:22.444813+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:31:22.444813+0000","last_undegraded":"2024-04-26T12:31:22.444813+0000","last_fullsized":"2024-04-26T12:31:22.444813+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349193+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:31:19.349193+0000","last_peered":"2024-04-26T12:31:19.349193+0000","last_clean":"2024-04-26T12:31:19.349193+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:31:19.349193+0000","last_undegraded":"2024-04-26T12:31:19.349193+0000","last_fullsized":"2024-04-26T12:31:19.349193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348613+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:31:19.348613+0000","last_peered":"2024-04-26T12:31:19.348613+0000","last_clean":"2024-04-26T12:31:19.348613+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:31:19.348613+0000","last_undegraded":"2024-04-26T12:31:19.348613+0000","last_fullsized":"2024-04-26T12:31:19.348613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445131+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:31:22.445131+0000","last_peered":"2024-04-26T12:31:22.445131+0000","last_clean":"2024-04-26T12:31:22.445131+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:31:22.445131+0000","last_undegraded":"2024-04-26T12:31:22.445131+0000","last_fullsized":"2024-04-26T12:31:22.445131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424983+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:31:22.424983+0000","last_peered":"2024-04-26T12:31:22.424983+0000","last_clean":"2024-04-26T12:31:22.424983+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:31:22.424983+0000","last_undegraded":"2024-04-26T12:31:22.424983+0000","last_fullsized":"2024-04-26T12:31:22.424983+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445160+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:31:22.445160+0000","last_peered":"2024-04-26T12:31:22.445160+0000","last_clean":"2024-04-26T12:31:22.445160+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:31:22.445160+0000","last_undegraded":"2024-04-26T12:31:22.445160+0000","last_fullsized":"2024-04-26T12:31:22.445160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425771+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:31:22.425771+0000","last_peered":"2024-04-26T12:31:22.425771+0000","last_clean":"2024-04-26T12:31:22.425771+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:31:22.425771+0000","last_undegraded":"2024-04-26T12:31:22.425771+0000","last_fullsized":"2024-04-26T12:31:22.425771+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348734+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:31:19.348734+0000","last_peered":"2024-04-26T12:31:19.348734+0000","last_clean":"2024-04-26T12:31:19.348734+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:31:19.348734+0000","last_undegraded":"2024-04-26T12:31:19.348734+0000","last_fullsized":"2024-04-26T12:31:19.348734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349114+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:31:19.349114+0000","last_peered":"2024-04-26T12:31:19.349114+0000","last_clean":"2024-04-26T12:31:19.349114+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:31:19.349114+0000","last_undegraded":"2024-04-26T12:31:19.349114+0000","last_fullsized":"2024-04-26T12:31:19.349114+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348981+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:31:19.348981+0000","last_peered":"2024-04-26T12:31:19.348981+0000","last_clean":"2024-04-26T12:31:19.348981+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:31:19.348981+0000","last_undegraded":"2024-04-26T12:31:19.348981+0000","last_fullsized":"2024-04-26T12:31:19.348981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348898+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:31:19.348898+0000","last_peered":"2024-04-26T12:31:19.348898+0000","last_clean":"2024-04-26T12:31:19.348898+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:31:19.348898+0000","last_undegraded":"2024-04-26T12:31:19.348898+0000","last_fullsized":"2024-04-26T12:31:19.348898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425050+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:31:22.425050+0000","last_peered":"2024-04-26T12:31:22.425050+0000","last_clean":"2024-04-26T12:31:22.425050+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:31:22.425050+0000","last_undegraded":"2024-04-26T12:31:22.425050+0000","last_fullsized":"2024-04-26T12:31:22.425050+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425207+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:31:22.425207+0000","last_peered":"2024-04-26T12:31:22.425207+0000","last_clean":"2024-04-26T12:31:22.425207+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:31:22.425207+0000","last_undegraded":"2024-04-26T12:31:22.425207+0000","last_fullsized":"2024-04-26T12:31:22.425207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444743+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:31:22.444743+0000","last_peered":"2024-04-26T12:31:22.444743+0000","last_clean":"2024-04-26T12:31:22.444743+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:31:22.444743+0000","last_undegraded":"2024-04-26T12:31:22.444743+0000","last_fullsized":"2024-04-26T12:31:22.444743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444704+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:31:22.444704+0000","last_peered":"2024-04-26T12:31:22.444704+0000","last_clean":"2024-04-26T12:31:22.444704+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:31:22.444704+0000","last_undegraded":"2024-04-26T12:31:22.444704+0000","last_fullsized":"2024-04-26T12:31:22.444704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425230+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:31:22.425230+0000","last_peered":"2024-04-26T12:31:22.425230+0000","last_clean":"2024-04-26T12:31:22.425230+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:31:22.425230+0000","last_undegraded":"2024-04-26T12:31:22.425230+0000","last_fullsized":"2024-04-26T12:31:22.425230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424895+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:31:22.424895+0000","last_peered":"2024-04-26T12:31:22.424895+0000","last_clean":"2024-04-26T12:31:22.424895+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:31:22.424895+0000","last_undegraded":"2024-04-26T12:31:22.424895+0000","last_fullsized":"2024-04-26T12:31:22.424895+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425739+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:31:22.425739+0000","last_peered":"2024-04-26T12:31:22.425739+0000","last_clean":"2024-04-26T12:31:22.425739+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:31:22.425739+0000","last_undegraded":"2024-04-26T12:31:22.425739+0000","last_fullsized":"2024-04-26T12:31:22.425739+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348500+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:31:19.348500+0000","last_peered":"2024-04-26T12:31:19.348500+0000","last_clean":"2024-04-26T12:31:19.348500+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:31:19.348500+0000","last_undegraded":"2024-04-26T12:31:19.348500+0000","last_fullsized":"2024-04-26T12:31:19.348500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425620+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:31:22.425620+0000","last_peered":"2024-04-26T12:31:22.425620+0000","last_clean":"2024-04-26T12:31:22.425620+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:31:22.425620+0000","last_undegraded":"2024-04-26T12:31:22.425620+0000","last_fullsized":"2024-04-26T12:31:22.425620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348521+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:31:19.348521+0000","last_peered":"2024-04-26T12:31:19.348521+0000","last_clean":"2024-04-26T12:31:19.348521+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:31:19.348521+0000","last_undegraded":"2024-04-26T12:31:19.348521+0000","last_fullsized":"2024-04-26T12:31:19.348521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444975+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:31:22.444975+0000","last_peered":"2024-04-26T12:31:22.444975+0000","last_clean":"2024-04-26T12:31:22.444975+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:31:22.444975+0000","last_undegraded":"2024-04-26T12:31:22.444975+0000","last_fullsized":"2024-04-26T12:31:22.444975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445072+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:31:22.445072+0000","last_peered":"2024-04-26T12:31:22.445072+0000","last_clean":"2024-04-26T12:31:22.445072+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:31:22.445072+0000","last_undegraded":"2024-04-26T12:31:22.445072+0000","last_fullsized":"2024-04-26T12:31:22.445072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425623+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:31:22.425623+0000","last_peered":"2024-04-26T12:31:22.425623+0000","last_clean":"2024-04-26T12:31:22.425623+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:31:22.425623+0000","last_undegraded":"2024-04-26T12:31:22.425623+0000","last_fullsized":"2024-04-26T12:31:22.425623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348889+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:31:19.348889+0000","last_peered":"2024-04-26T12:31:19.348889+0000","last_clean":"2024-04-26T12:31:19.348889+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:31:19.348889+0000","last_undegraded":"2024-04-26T12:31:19.348889+0000","last_fullsized":"2024-04-26T12:31:19.348889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425128+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:31:22.425128+0000","last_peered":"2024-04-26T12:31:22.425128+0000","last_clean":"2024-04-26T12:31:22.425128+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:31:22.425128+0000","last_undegraded":"2024-04-26T12:31:22.425128+0000","last_fullsized":"2024-04-26T12:31:22.425128+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425350+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:31:22.425350+0000","last_peered":"2024-04-26T12:31:22.425350+0000","last_clean":"2024-04-26T12:31:22.425350+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:31:22.425350+0000","last_undegraded":"2024-04-26T12:31:22.425350+0000","last_fullsized":"2024-04-26T12:31:22.425350+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444980+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:31:22.444980+0000","last_peered":"2024-04-26T12:31:22.444980+0000","last_clean":"2024-04-26T12:31:22.444980+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:31:22.444980+0000","last_undegraded":"2024-04-26T12:31:22.444980+0000","last_fullsized":"2024-04-26T12:31:22.444980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444391+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:31:22.444391+0000","last_peered":"2024-04-26T12:31:22.444391+0000","last_clean":"2024-04-26T12:31:22.444391+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:31:22.444391+0000","last_undegraded":"2024-04-26T12:31:22.444391+0000","last_fullsized":"2024-04-26T12:31:22.444391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348513+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:31:19.348513+0000","last_peered":"2024-04-26T12:31:19.348513+0000","last_clean":"2024-04-26T12:31:19.348513+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:31:19.348513+0000","last_undegraded":"2024-04-26T12:31:19.348513+0000","last_fullsized":"2024-04-26T12:31:19.348513+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445123+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:31:22.445123+0000","last_peered":"2024-04-26T12:31:22.445123+0000","last_clean":"2024-04-26T12:31:22.445123+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:31:22.445123+0000","last_undegraded":"2024-04-26T12:31:22.445123+0000","last_fullsized":"2024-04-26T12:31:22.445123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425410+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:31:22.425410+0000","last_peered":"2024-04-26T12:31:22.425410+0000","last_clean":"2024-04-26T12:31:22.425410+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:31:22.425410+0000","last_undegraded":"2024-04-26T12:31:22.425410+0000","last_fullsized":"2024-04-26T12:31:22.425410+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424821+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:31:22.424821+0000","last_peered":"2024-04-26T12:31:22.424821+0000","last_clean":"2024-04-26T12:31:22.424821+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:31:22.424821+0000","last_undegraded":"2024-04-26T12:31:22.424821+0000","last_fullsized":"2024-04-26T12:31:22.424821+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444429+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:31:22.444429+0000","last_peered":"2024-04-26T12:31:22.444429+0000","last_clean":"2024-04-26T12:31:22.444429+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:31:22.444429+0000","last_undegraded":"2024-04-26T12:31:22.444429+0000","last_fullsized":"2024-04-26T12:31:22.444429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348691+0000","last_change":"2024-04-26T12:31:07.233644+0000","last_active":"2024-04-26T12:31:19.348691+0000","last_peered":"2024-04-26T12:31:19.348691+0000","last_clean":"2024-04-26T12:31:19.348691+0000","last_became_active":"2024-04-26T12:31:07.233477+0000","last_became_peered":"2024-04-26T12:31:07.233477+0000","last_unstale":"2024-04-26T12:31:19.348691+0000","last_undegraded":"2024-04-26T12:31:19.348691+0000","last_fullsized":"2024-04-26T12:31:19.348691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:24.149502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424768+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:31:22.424768+0000","last_peered":"2024-04-26T12:31:22.424768+0000","last_clean":"2024-04-26T12:31:22.424768+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:31:22.424768+0000","last_undegraded":"2024-04-26T12:31:22.424768+0000","last_fullsized":"2024-04-26T12:31:22.424768+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444274+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:31:22.444274+0000","last_peered":"2024-04-26T12:31:22.444274+0000","last_clean":"2024-04-26T12:31:22.444274+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:31:22.444274+0000","last_undegraded":"2024-04-26T12:31:22.444274+0000","last_fullsized":"2024-04-26T12:31:22.444274+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349207+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:31:19.349207+0000","last_peered":"2024-04-26T12:31:19.349207+0000","last_clean":"2024-04-26T12:31:19.349207+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:31:19.349207+0000","last_undegraded":"2024-04-26T12:31:19.349207+0000","last_fullsized":"2024-04-26T12:31:19.349207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349088+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:31:19.349088+0000","last_peered":"2024-04-26T12:31:19.349088+0000","last_clean":"2024-04-26T12:31:19.349088+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:31:19.349088+0000","last_undegraded":"2024-04-26T12:31:19.349088+0000","last_fullsized":"2024-04-26T12:31:19.349088+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444894+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:31:22.444894+0000","last_peered":"2024-04-26T12:31:22.444894+0000","last_clean":"2024-04-26T12:31:22.444894+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:31:22.444894+0000","last_undegraded":"2024-04-26T12:31:22.444894+0000","last_fullsized":"2024-04-26T12:31:22.444894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348957+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:31:19.348957+0000","last_peered":"2024-04-26T12:31:19.348957+0000","last_clean":"2024-04-26T12:31:19.348957+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:31:19.348957+0000","last_undegraded":"2024-04-26T12:31:19.348957+0000","last_fullsized":"2024-04-26T12:31:19.348957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444974+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:31:22.444974+0000","last_peered":"2024-04-26T12:31:22.444974+0000","last_clean":"2024-04-26T12:31:22.444974+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:31:22.444974+0000","last_undegraded":"2024-04-26T12:31:22.444974+0000","last_fullsized":"2024-04-26T12:31:22.444974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445051+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:31:22.445051+0000","last_peered":"2024-04-26T12:31:22.445051+0000","last_clean":"2024-04-26T12:31:22.445051+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:31:22.445051+0000","last_undegraded":"2024-04-26T12:31:22.445051+0000","last_fullsized":"2024-04-26T12:31:22.445051+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444364+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:31:22.444364+0000","last_peered":"2024-04-26T12:31:22.444364+0000","last_clean":"2024-04-26T12:31:22.444364+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:31:22.444364+0000","last_undegraded":"2024-04-26T12:31:22.444364+0000","last_fullsized":"2024-04-26T12:31:22.444364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425833+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:31:22.425833+0000","last_peered":"2024-04-26T12:31:22.425833+0000","last_clean":"2024-04-26T12:31:22.425833+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:31:22.425833+0000","last_undegraded":"2024-04-26T12:31:22.425833+0000","last_fullsized":"2024-04-26T12:31:22.425833+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445124+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:31:22.445124+0000","last_peered":"2024-04-26T12:31:22.445124+0000","last_clean":"2024-04-26T12:31:22.445124+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:31:22.445124+0000","last_undegraded":"2024-04-26T12:31:22.445124+0000","last_fullsized":"2024-04-26T12:31:22.445124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348880+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:31:19.348880+0000","last_peered":"2024-04-26T12:31:19.348880+0000","last_clean":"2024-04-26T12:31:19.348880+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:31:19.348880+0000","last_undegraded":"2024-04-26T12:31:19.348880+0000","last_fullsized":"2024-04-26T12:31:19.348880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348942+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:31:19.348942+0000","last_peered":"2024-04-26T12:31:19.348942+0000","last_clean":"2024-04-26T12:31:19.348942+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:31:19.348942+0000","last_undegraded":"2024-04-26T12:31:19.348942+0000","last_fullsized":"2024-04-26T12:31:19.348942+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348892+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:31:19.348892+0000","last_peered":"2024-04-26T12:31:19.348892+0000","last_clean":"2024-04-26T12:31:19.348892+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:31:19.348892+0000","last_undegraded":"2024-04-26T12:31:19.348892+0000","last_fullsized":"2024-04-26T12:31:19.348892+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425354+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:31:22.425354+0000","last_peered":"2024-04-26T12:31:22.425354+0000","last_clean":"2024-04-26T12:31:22.425354+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:31:22.425354+0000","last_undegraded":"2024-04-26T12:31:22.425354+0000","last_fullsized":"2024-04-26T12:31:22.425354+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425304+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:31:22.425304+0000","last_peered":"2024-04-26T12:31:22.425304+0000","last_clean":"2024-04-26T12:31:22.425304+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:31:22.425304+0000","last_undegraded":"2024-04-26T12:31:22.425304+0000","last_fullsized":"2024-04-26T12:31:22.425304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.349169+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:31:19.349169+0000","last_peered":"2024-04-26T12:31:19.349169+0000","last_clean":"2024-04-26T12:31:19.349169+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:31:19.349169+0000","last_undegraded":"2024-04-26T12:31:19.349169+0000","last_fullsized":"2024-04-26T12:31:19.349169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.424925+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:31:22.424925+0000","last_peered":"2024-04-26T12:31:22.424925+0000","last_clean":"2024-04-26T12:31:22.424925+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:31:22.424925+0000","last_undegraded":"2024-04-26T12:31:22.424925+0000","last_fullsized":"2024-04-26T12:31:22.424925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445209+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:31:22.445209+0000","last_peered":"2024-04-26T12:31:22.445209+0000","last_clean":"2024-04-26T12:31:22.445209+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:22.445209+0000","last_undegraded":"2024-04-26T12:31:22.445209+0000","last_fullsized":"2024-04-26T12:31:22.445209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348451+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:31:19.348451+0000","last_peered":"2024-04-26T12:31:19.348451+0000","last_clean":"2024-04-26T12:31:19.348451+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:31:19.348451+0000","last_undegraded":"2024-04-26T12:31:19.348451+0000","last_fullsized":"2024-04-26T12:31:19.348451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.445079+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:31:22.445079+0000","last_peered":"2024-04-26T12:31:22.445079+0000","last_clean":"2024-04-26T12:31:22.445079+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:31:22.445079+0000","last_undegraded":"2024-04-26T12:31:22.445079+0000","last_fullsized":"2024-04-26T12:31:22.445079+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425097+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:31:22.425097+0000","last_peered":"2024-04-26T12:31:22.425097+0000","last_clean":"2024-04-26T12:31:22.425097+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:31:22.425097+0000","last_undegraded":"2024-04-26T12:31:22.425097+0000","last_fullsized":"2024-04-26T12:31:22.425097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.425001+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:31:22.425001+0000","last_peered":"2024-04-26T12:31:22.425001+0000","last_clean":"2024-04-26T12:31:22.425001+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:31:22.425001+0000","last_undegraded":"2024-04-26T12:31:22.425001+0000","last_fullsized":"2024-04-26T12:31:22.425001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444296+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:31:22.444296+0000","last_peered":"2024-04-26T12:31:22.444296+0000","last_clean":"2024-04-26T12:31:22.444296+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:31:22.444296+0000","last_undegraded":"2024-04-26T12:31:22.444296+0000","last_fullsized":"2024-04-26T12:31:22.444296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348976+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:31:19.348976+0000","last_peered":"2024-04-26T12:31:19.348976+0000","last_clean":"2024-04-26T12:31:19.348976+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:31:19.348976+0000","last_undegraded":"2024-04-26T12:31:19.348976+0000","last_fullsized":"2024-04-26T12:31:19.348976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.444845+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:31:22.444845+0000","last_peered":"2024-04-26T12:31:22.444845+0000","last_clean":"2024-04-26T12:31:22.444845+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:31:22.444845+0000","last_undegraded":"2024-04-26T12:31:22.444845+0000","last_fullsized":"2024-04-26T12:31:22.444845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:31:19.348958+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:31:19.348958+0000","last_peered":"2024-04-26T12:31:19.348958+0000","last_clean":"2024-04-26T12:31:19.348958+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:31:19.348958+0000","last_undegraded":"2024-04-26T12:31:19.348958+0000","last_fullsized":"2024-04-26T12:31:19.348958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738382,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":707044,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.252}]},{"osd":1,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.311}]}]},{"osd":0,"up_from":8,"seq":34359738382,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":108876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738383,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":706428,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.27900000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:27.845 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:31:27.845 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:27.845 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:31:27.845 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:31:27.845 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:31:27.846 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:31:27.846 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:27.864 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:27.866 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:27.866 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:27.866 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:27.895 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:27.894+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:27.935 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:27.935 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:27.935 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:31:27.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:27.986 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:27.986 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "" 2024-04-26T12:31:27.986 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:27.996 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:27.995+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:28.072 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:28.073 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:28.083 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:28.124 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:28.123+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:28.198 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:28.197+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:28.251 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:28.251 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:28.261 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:28.305 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:28.304+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:28.389 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:28.390 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:28.399 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:28.398+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:28.400 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:28.500 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:28.499+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:28.571 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:28.571 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:28.578 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:28.601 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:28.600+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:28.702 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:28.701+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:28.745 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:28.745 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:28.755 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:28.802 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:28.801+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:28.896 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:28.896 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:28.903 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:28.902+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:28.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:29.004 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:29.004+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:29.077 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:29.077 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:29.087 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:29.132 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:29.131+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:29.206 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:29.206+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:29.214 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:29.214 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:29.224 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:29.307 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:29.306+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:29.365 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:29.365 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:29.375 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:29.417 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:29.416+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:29.509 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:29.508+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:29.543 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:29.543 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:29.553 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:29.610 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:29.609+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:29.681 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:29.681 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:29.691 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:29.711 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:29.710+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:29.811 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:29.811+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:29.832 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:29.832 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:29.842 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:29.880 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:29.912 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:29.911+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:29.949 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:31:29.971 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:29.971 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:29.981 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:30.013 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:30.012+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:30.081 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:30.108 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:30.108 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:30.113 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:30.113 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:30.112+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:30.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:30.150 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:30.152 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:30.152 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:30.152 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:30.215 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:30.214+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:30.256 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:30.256 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:30.256 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:30.256 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:30.266 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:30.315 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:30.315+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:30.394 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:30.394 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:30.394 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:30.394 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:30.394 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:30.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:30.449 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:30.448+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:30.517 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:30.516+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:30.535 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.243823304000003, 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:30.536 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:30.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:30.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930567142999998, 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:30.543 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:30.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:30.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.550 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930525463999999, 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:30.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930496685000001, 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:30.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:30.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930467037, 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:30.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930428223, 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:30.573 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:30.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:30.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:30.580 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930399434999998, 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:30.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:30.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930372294000001, 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:30.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:30.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:30.594 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930330574000003, 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:30.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:30.601 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930287456999999, 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:30.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:30.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930268771000001, 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:30.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:30.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.616 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930245902000003, 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:30.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930215019999999, 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:30.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:30.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:30.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.630 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930197548999999, 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:30.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:30.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:30.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930174813999997, 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:30.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:30.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930145271999997, 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:30.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:30.651 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930119830000002, 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.652 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930090663999998, 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930076739, 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 57.930059403999998, 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:30.680 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:30.682 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:30.680+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:30.682 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:30.782 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:30.782+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:30.823 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:30.823 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:30.823 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:30.833 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:30.883 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:30.882+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:30.960 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:31:30.961 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:30.961 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:30.961 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:30.961 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:30.961 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:30.971 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:30.983 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:30.983+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:31.084 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:31.084+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:31.099 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.495395328999997, 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:31.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:31.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:31.105 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.495335091000001, 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:31.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.495301771000001, 2024-04-26T12:31:31.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:31.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:31.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:31.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:31.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:31.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.117 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.495271979999998, 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:31.118 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:31.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:31.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:31.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:31.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:31.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.495258665999998, 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.125 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:31.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:31.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.495241690999997, 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:31.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:31.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:31.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.495174601000002, 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.136 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:31.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.495144220999997, 2024-04-26T12:31:31.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:31.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:31.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.495121482999998, 2024-04-26T12:31:31.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:31.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.490915395000002, 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.150 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.485545612000003, 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:31.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:31.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.485364900999997, 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:31.158 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:31.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.485338057, 2024-04-26T12:31:31.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:31.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:31.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.166 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.485298432, 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:31.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.485224832999997, 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.483765171000002, 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:31.174 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.483480915000001, 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.178 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:31.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.181 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.478948240999998, 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:31.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.478819192000003, 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:31.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.189473864, 2024-04-26T12:31:31.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:31.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:31.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:31.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:31.195 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:31.197 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:31.197 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:31.195+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:31.297 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:31.297+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:31.331 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:31.331 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:31.331 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:31.331 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:31.341 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:31.399 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:31.398+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:31.468 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:31.468 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:31.469 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:31.469 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:31.479 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:31.500 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:31.499+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:31.601 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:31.600+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:31.607 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:31.607 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 64.715708379999995, 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.611 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.002470520000003, 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:31.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:31.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:31.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.617 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.002412458000002, 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:31.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:31.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:31.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.002383905000002, 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:31.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:31.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.00236443, 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:31.629 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:31.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:31.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:31.634 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.002344385999997, 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:31.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:31.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.640 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.002321088999999, 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:31.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:31.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:31.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:31.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.002300646999998, 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:31.646 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:31.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:31.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.002280100999997, 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:31.652 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:31.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:31.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:31.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.656 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.002248107, 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:31.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:31.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:31.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:31.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.000841131000001, 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 59.000187453000002, 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:31.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.999965396999997, 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:31.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:31.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.672 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.995512179999999, 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.990083865000003, 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.989823495000003, 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.989790098999997, 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:31.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:31.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.989585097999999, 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:31.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:31.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:31.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.983958921999999, 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.693 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:31.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:31.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:31.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 58.983579511999999, 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:31.697 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:31.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:31.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:31.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:31.701 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:31.703 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:31.703 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:31.702+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:31.804 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:31.803+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:31.844 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:31.844 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:31.844 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:31.844 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:31.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:31.904 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:31.904+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:31.982 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:31.982 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:31.982 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:31.982 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:31.982 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:31.992 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:32.033 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:32.032+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:32.106 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:32.106+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:32.162 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:32.162 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:32.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:32.162 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 64.870792831000003, 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:32.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:32.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:32.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557536669999998, 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.168 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:32.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:32.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:32.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.173 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557494990999999, 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:32.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:32.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:32.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:32.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:32.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.179 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557466212000001, 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:32.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:32.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:32.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:32.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:32.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557436564, 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.185 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.190 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.55739775, 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:32.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:32.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557368961999998, 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:32.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:32.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557341821000001, 2024-04-26T12:31:32.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:32.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:32.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:32.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.208 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557300101000003, 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:32.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:32.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.214 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557256983999999, 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:32.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:32.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557238298000001, 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:32.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557215429000003, 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.227 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:32.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:32.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:32.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.233 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557184546999999, 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:32.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:32.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:32.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:32.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:32.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557167075999999, 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:32.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:32.245 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557144340999997, 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:32.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:32.251 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557114798999997, 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:32.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:32.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.257 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557089357000002, 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:32.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:32.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:32.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:32.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557060190999998, 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:32.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:32.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557046266, 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:32.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:32.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:32.275 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 59.557028930999998, 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:32.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:32.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:32.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.280 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.280 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.280 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:32.280 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:32.280 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:32.280 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:32.282 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:32.281+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:32.282 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:32.382 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:32.382+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:32.423 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:32.423 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:32.423 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:32.424 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:32.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:32.451 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:32.472 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:32.483 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:32.483+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:32.493 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:32.494 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:32.494 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:32.495 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:32.563 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:32.563 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:32.573 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:32.584 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:32.584+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:32.685 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:32.685+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:32.700 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:32.700 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:32.710 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:32.786 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:32.785+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:32.848 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:32.848 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:32.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:32.887 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:32.886+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:32.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:31:32.984 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:32.985 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:32.987 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:32.986+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:32.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:32.996 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:32.997 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:32.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:33.088 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:33.087+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:33.122 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:33.122 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:33.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:33.190 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:33.189+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:33.273 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:33.273 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:33.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:33.290 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:33.290+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:33.392 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:33.391+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:33.433 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:31:33.435 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:31:33.446 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-26T12:31:32.982290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82092,"kb_used_data":1020,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033428,"statfs":{"total":289910292480,"available":289826230272,"internally_reserved":0,"allocated":1044480,"data_stored":1573108,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.072555"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929526+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:31:25.929526+0000","last_peered":"2024-04-26T12:31:25.929526+0000","last_clean":"2024-04-26T12:31:25.929526+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:31:25.929526+0000","last_undegraded":"2024-04-26T12:31:25.929526+0000","last_fullsized":"2024-04-26T12:31:25.929526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929462+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:31:25.929462+0000","last_peered":"2024-04-26T12:31:25.929462+0000","last_clean":"2024-04-26T12:31:25.929462+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:31:25.929462+0000","last_undegraded":"2024-04-26T12:31:25.929462+0000","last_fullsized":"2024-04-26T12:31:25.929462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912708+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:31:26.912708+0000","last_peered":"2024-04-26T12:31:26.912708+0000","last_clean":"2024-04-26T12:31:26.912708+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:31:26.912708+0000","last_undegraded":"2024-04-26T12:31:26.912708+0000","last_fullsized":"2024-04-26T12:31:26.912708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912643+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:31:26.912643+0000","last_peered":"2024-04-26T12:31:26.912643+0000","last_clean":"2024-04-26T12:31:26.912643+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:31:26.912643+0000","last_undegraded":"2024-04-26T12:31:26.912643+0000","last_fullsized":"2024-04-26T12:31:26.912643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.928977+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:31:25.928977+0000","last_peered":"2024-04-26T12:31:25.928977+0000","last_clean":"2024-04-26T12:31:25.928977+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:31:25.928977+0000","last_undegraded":"2024-04-26T12:31:25.928977+0000","last_fullsized":"2024-04-26T12:31:25.928977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911236+0000","last_change":"2024-04-26T12:31:07.232711+0000","last_active":"2024-04-26T12:31:26.911236+0000","last_peered":"2024-04-26T12:31:26.911236+0000","last_clean":"2024-04-26T12:31:26.911236+0000","last_became_active":"2024-04-26T12:31:07.232528+0000","last_became_peered":"2024-04-26T12:31:07.232528+0000","last_unstale":"2024-04-26T12:31:26.911236+0000","last_undegraded":"2024-04-26T12:31:26.911236+0000","last_fullsized":"2024-04-26T12:31:26.911236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:16.731908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911057+0000","last_change":"2024-04-26T12:31:07.231727+0000","last_active":"2024-04-26T12:31:26.911057+0000","last_peered":"2024-04-26T12:31:26.911057+0000","last_clean":"2024-04-26T12:31:26.911057+0000","last_became_active":"2024-04-26T12:31:07.231554+0000","last_became_peered":"2024-04-26T12:31:07.231554+0000","last_unstale":"2024-04-26T12:31:26.911057+0000","last_undegraded":"2024-04-26T12:31:26.911057+0000","last_fullsized":"2024-04-26T12:31:26.911057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:12.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911809+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:31:26.911809+0000","last_peered":"2024-04-26T12:31:26.911809+0000","last_clean":"2024-04-26T12:31:26.911809+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:31:26.911809+0000","last_undegraded":"2024-04-26T12:31:26.911809+0000","last_fullsized":"2024-04-26T12:31:26.911809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911812+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:31:26.911812+0000","last_peered":"2024-04-26T12:31:26.911812+0000","last_clean":"2024-04-26T12:31:26.911812+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:31:26.911812+0000","last_undegraded":"2024-04-26T12:31:26.911812+0000","last_fullsized":"2024-04-26T12:31:26.911812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929513+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:31:25.929513+0000","last_peered":"2024-04-26T12:31:25.929513+0000","last_clean":"2024-04-26T12:31:25.929513+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:31:25.929513+0000","last_undegraded":"2024-04-26T12:31:25.929513+0000","last_fullsized":"2024-04-26T12:31:25.929513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911513+0000","last_change":"2024-04-26T12:31:07.232741+0000","last_active":"2024-04-26T12:31:26.911513+0000","last_peered":"2024-04-26T12:31:26.911513+0000","last_clean":"2024-04-26T12:31:26.911513+0000","last_became_active":"2024-04-26T12:31:07.232521+0000","last_became_peered":"2024-04-26T12:31:07.232521+0000","last_unstale":"2024-04-26T12:31:26.911513+0000","last_undegraded":"2024-04-26T12:31:26.911513+0000","last_fullsized":"2024-04-26T12:31:26.911513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.363233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.928885+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:31:25.928885+0000","last_peered":"2024-04-26T12:31:25.928885+0000","last_clean":"2024-04-26T12:31:25.928885+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:31:25.928885+0000","last_undegraded":"2024-04-26T12:31:25.928885+0000","last_fullsized":"2024-04-26T12:31:25.928885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.928845+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:31:25.928845+0000","last_peered":"2024-04-26T12:31:25.928845+0000","last_clean":"2024-04-26T12:31:25.928845+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:31:25.928845+0000","last_undegraded":"2024-04-26T12:31:25.928845+0000","last_fullsized":"2024-04-26T12:31:25.928845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912510+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:31:26.912510+0000","last_peered":"2024-04-26T12:31:26.912510+0000","last_clean":"2024-04-26T12:31:26.912510+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:31:26.912510+0000","last_undegraded":"2024-04-26T12:31:26.912510+0000","last_fullsized":"2024-04-26T12:31:26.912510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912016+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:31:26.912016+0000","last_peered":"2024-04-26T12:31:26.912016+0000","last_clean":"2024-04-26T12:31:26.912016+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:31:26.912016+0000","last_undegraded":"2024-04-26T12:31:26.912016+0000","last_fullsized":"2024-04-26T12:31:26.912016+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911004+0000","last_change":"2024-04-26T12:31:07.233006+0000","last_active":"2024-04-26T12:31:26.911004+0000","last_peered":"2024-04-26T12:31:26.911004+0000","last_clean":"2024-04-26T12:31:26.911004+0000","last_became_active":"2024-04-26T12:31:07.232842+0000","last_became_peered":"2024-04-26T12:31:07.232842+0000","last_unstale":"2024-04-26T12:31:26.911004+0000","last_undegraded":"2024-04-26T12:31:26.911004+0000","last_fullsized":"2024-04-26T12:31:26.911004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.359074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911852+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:31:26.911852+0000","last_peered":"2024-04-26T12:31:26.911852+0000","last_clean":"2024-04-26T12:31:26.911852+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:31:26.911852+0000","last_undegraded":"2024-04-26T12:31:26.911852+0000","last_fullsized":"2024-04-26T12:31:26.911852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929802+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:31:25.929802+0000","last_peered":"2024-04-26T12:31:25.929802+0000","last_clean":"2024-04-26T12:31:25.929802+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:31:25.929802+0000","last_undegraded":"2024-04-26T12:31:25.929802+0000","last_fullsized":"2024-04-26T12:31:25.929802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911684+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:31:26.911684+0000","last_peered":"2024-04-26T12:31:26.911684+0000","last_clean":"2024-04-26T12:31:26.911684+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:31:26.911684+0000","last_undegraded":"2024-04-26T12:31:26.911684+0000","last_fullsized":"2024-04-26T12:31:26.911684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912636+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:31:26.912636+0000","last_peered":"2024-04-26T12:31:26.912636+0000","last_clean":"2024-04-26T12:31:26.912636+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:31:26.912636+0000","last_undegraded":"2024-04-26T12:31:26.912636+0000","last_fullsized":"2024-04-26T12:31:26.912636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912352+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:31:26.912352+0000","last_peered":"2024-04-26T12:31:26.912352+0000","last_clean":"2024-04-26T12:31:26.912352+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:31:26.912352+0000","last_undegraded":"2024-04-26T12:31:26.912352+0000","last_fullsized":"2024-04-26T12:31:26.912352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.928734+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:31:25.928734+0000","last_peered":"2024-04-26T12:31:25.928734+0000","last_clean":"2024-04-26T12:31:25.928734+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:31:25.928734+0000","last_undegraded":"2024-04-26T12:31:25.928734+0000","last_fullsized":"2024-04-26T12:31:25.928734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911317+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:31:26.911317+0000","last_peered":"2024-04-26T12:31:26.911317+0000","last_clean":"2024-04-26T12:31:26.911317+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:31:26.911317+0000","last_undegraded":"2024-04-26T12:31:26.911317+0000","last_fullsized":"2024-04-26T12:31:26.911317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.928933+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:31:25.928933+0000","last_peered":"2024-04-26T12:31:25.928933+0000","last_clean":"2024-04-26T12:31:25.928933+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:31:25.928933+0000","last_undegraded":"2024-04-26T12:31:25.928933+0000","last_fullsized":"2024-04-26T12:31:25.928933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929636+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:31:25.929636+0000","last_peered":"2024-04-26T12:31:25.929636+0000","last_clean":"2024-04-26T12:31:25.929636+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:31:25.929636+0000","last_undegraded":"2024-04-26T12:31:25.929636+0000","last_fullsized":"2024-04-26T12:31:25.929636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911802+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:31:26.911802+0000","last_peered":"2024-04-26T12:31:26.911802+0000","last_clean":"2024-04-26T12:31:26.911802+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:31:26.911802+0000","last_undegraded":"2024-04-26T12:31:26.911802+0000","last_fullsized":"2024-04-26T12:31:26.911802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912614+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:31:26.912614+0000","last_peered":"2024-04-26T12:31:26.912614+0000","last_clean":"2024-04-26T12:31:26.912614+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:31:26.912614+0000","last_undegraded":"2024-04-26T12:31:26.912614+0000","last_fullsized":"2024-04-26T12:31:26.912614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929069+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:31:25.929069+0000","last_peered":"2024-04-26T12:31:25.929069+0000","last_clean":"2024-04-26T12:31:25.929069+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:25.929069+0000","last_undegraded":"2024-04-26T12:31:25.929069+0000","last_fullsized":"2024-04-26T12:31:25.929069+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929425+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:31:25.929425+0000","last_peered":"2024-04-26T12:31:25.929425+0000","last_clean":"2024-04-26T12:31:25.929425+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:31:25.929425+0000","last_undegraded":"2024-04-26T12:31:25.929425+0000","last_fullsized":"2024-04-26T12:31:25.929425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911359+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:31:26.911359+0000","last_peered":"2024-04-26T12:31:26.911359+0000","last_clean":"2024-04-26T12:31:26.911359+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:31:26.911359+0000","last_undegraded":"2024-04-26T12:31:26.911359+0000","last_fullsized":"2024-04-26T12:31:26.911359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911964+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:31:26.911964+0000","last_peered":"2024-04-26T12:31:26.911964+0000","last_clean":"2024-04-26T12:31:26.911964+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:31:26.911964+0000","last_undegraded":"2024-04-26T12:31:26.911964+0000","last_fullsized":"2024-04-26T12:31:26.911964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911149+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:31:26.911149+0000","last_peered":"2024-04-26T12:31:26.911149+0000","last_clean":"2024-04-26T12:31:26.911149+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:31:26.911149+0000","last_undegraded":"2024-04-26T12:31:26.911149+0000","last_fullsized":"2024-04-26T12:31:26.911149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929842+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:31:25.929842+0000","last_peered":"2024-04-26T12:31:25.929842+0000","last_clean":"2024-04-26T12:31:25.929842+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:31:25.929842+0000","last_undegraded":"2024-04-26T12:31:25.929842+0000","last_fullsized":"2024-04-26T12:31:25.929842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911982+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:31:26.911982+0000","last_peered":"2024-04-26T12:31:26.911982+0000","last_clean":"2024-04-26T12:31:26.911982+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:31:26.911982+0000","last_undegraded":"2024-04-26T12:31:26.911982+0000","last_fullsized":"2024-04-26T12:31:26.911982+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911160+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:31:26.911160+0000","last_peered":"2024-04-26T12:31:26.911160+0000","last_clean":"2024-04-26T12:31:26.911160+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:31:26.911160+0000","last_undegraded":"2024-04-26T12:31:26.911160+0000","last_fullsized":"2024-04-26T12:31:26.911160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911815+0000","last_change":"2024-04-26T12:31:07.233093+0000","last_active":"2024-04-26T12:31:26.911815+0000","last_peered":"2024-04-26T12:31:26.911815+0000","last_clean":"2024-04-26T12:31:26.911815+0000","last_became_active":"2024-04-26T12:31:07.232858+0000","last_became_peered":"2024-04-26T12:31:07.232858+0000","last_unstale":"2024-04-26T12:31:26.911815+0000","last_undegraded":"2024-04-26T12:31:26.911815+0000","last_fullsized":"2024-04-26T12:31:26.911815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.889139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911404+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:31:26.911404+0000","last_peered":"2024-04-26T12:31:26.911404+0000","last_clean":"2024-04-26T12:31:26.911404+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:31:26.911404+0000","last_undegraded":"2024-04-26T12:31:26.911404+0000","last_fullsized":"2024-04-26T12:31:26.911404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929565+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:31:25.929565+0000","last_peered":"2024-04-26T12:31:25.929565+0000","last_clean":"2024-04-26T12:31:25.929565+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:31:25.929565+0000","last_undegraded":"2024-04-26T12:31:25.929565+0000","last_fullsized":"2024-04-26T12:31:25.929565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911415+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:31:26.911415+0000","last_peered":"2024-04-26T12:31:26.911415+0000","last_clean":"2024-04-26T12:31:26.911415+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:31:26.911415+0000","last_undegraded":"2024-04-26T12:31:26.911415+0000","last_fullsized":"2024-04-26T12:31:26.911415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912517+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:31:26.912517+0000","last_peered":"2024-04-26T12:31:26.912517+0000","last_clean":"2024-04-26T12:31:26.912517+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:31:26.912517+0000","last_undegraded":"2024-04-26T12:31:26.912517+0000","last_fullsized":"2024-04-26T12:31:26.912517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912635+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:31:26.912635+0000","last_peered":"2024-04-26T12:31:26.912635+0000","last_clean":"2024-04-26T12:31:26.912635+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:31:26.912635+0000","last_undegraded":"2024-04-26T12:31:26.912635+0000","last_fullsized":"2024-04-26T12:31:26.912635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912580+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:31:26.912580+0000","last_peered":"2024-04-26T12:31:26.912580+0000","last_clean":"2024-04-26T12:31:26.912580+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:31:26.912580+0000","last_undegraded":"2024-04-26T12:31:26.912580+0000","last_fullsized":"2024-04-26T12:31:26.912580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929126+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:31:25.929126+0000","last_peered":"2024-04-26T12:31:25.929126+0000","last_clean":"2024-04-26T12:31:25.929126+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:31:25.929126+0000","last_undegraded":"2024-04-26T12:31:25.929126+0000","last_fullsized":"2024-04-26T12:31:25.929126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911529+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:31:26.911529+0000","last_peered":"2024-04-26T12:31:26.911529+0000","last_clean":"2024-04-26T12:31:26.911529+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:31:26.911529+0000","last_undegraded":"2024-04-26T12:31:26.911529+0000","last_fullsized":"2024-04-26T12:31:26.911529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929678+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:31:25.929678+0000","last_peered":"2024-04-26T12:31:25.929678+0000","last_clean":"2024-04-26T12:31:25.929678+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:31:25.929678+0000","last_undegraded":"2024-04-26T12:31:25.929678+0000","last_fullsized":"2024-04-26T12:31:25.929678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929126+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:31:25.929126+0000","last_peered":"2024-04-26T12:31:25.929126+0000","last_clean":"2024-04-26T12:31:25.929126+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:31:25.929126+0000","last_undegraded":"2024-04-26T12:31:25.929126+0000","last_fullsized":"2024-04-26T12:31:25.929126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911880+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:31:26.911880+0000","last_peered":"2024-04-26T12:31:26.911880+0000","last_clean":"2024-04-26T12:31:26.911880+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:31:26.911880+0000","last_undegraded":"2024-04-26T12:31:26.911880+0000","last_fullsized":"2024-04-26T12:31:26.911880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912093+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:31:26.912093+0000","last_peered":"2024-04-26T12:31:26.912093+0000","last_clean":"2024-04-26T12:31:26.912093+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:31:26.912093+0000","last_undegraded":"2024-04-26T12:31:26.912093+0000","last_fullsized":"2024-04-26T12:31:26.912093+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912032+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:31:26.912032+0000","last_peered":"2024-04-26T12:31:26.912032+0000","last_clean":"2024-04-26T12:31:26.912032+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:31:26.912032+0000","last_undegraded":"2024-04-26T12:31:26.912032+0000","last_fullsized":"2024-04-26T12:31:26.912032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912840+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:31:26.912840+0000","last_peered":"2024-04-26T12:31:26.912840+0000","last_clean":"2024-04-26T12:31:26.912840+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:31:26.912840+0000","last_undegraded":"2024-04-26T12:31:26.912840+0000","last_fullsized":"2024-04-26T12:31:26.912840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929286+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:31:25.929286+0000","last_peered":"2024-04-26T12:31:25.929286+0000","last_clean":"2024-04-26T12:31:25.929286+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:31:25.929286+0000","last_undegraded":"2024-04-26T12:31:25.929286+0000","last_fullsized":"2024-04-26T12:31:25.929286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929604+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:31:25.929604+0000","last_peered":"2024-04-26T12:31:25.929604+0000","last_clean":"2024-04-26T12:31:25.929604+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:31:25.929604+0000","last_undegraded":"2024-04-26T12:31:25.929604+0000","last_fullsized":"2024-04-26T12:31:25.929604+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929359+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:31:25.929359+0000","last_peered":"2024-04-26T12:31:25.929359+0000","last_clean":"2024-04-26T12:31:25.929359+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:31:25.929359+0000","last_undegraded":"2024-04-26T12:31:25.929359+0000","last_fullsized":"2024-04-26T12:31:25.929359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929345+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:31:25.929345+0000","last_peered":"2024-04-26T12:31:25.929345+0000","last_clean":"2024-04-26T12:31:25.929345+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:31:25.929345+0000","last_undegraded":"2024-04-26T12:31:25.929345+0000","last_fullsized":"2024-04-26T12:31:25.929345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912312+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:31:26.912312+0000","last_peered":"2024-04-26T12:31:26.912312+0000","last_clean":"2024-04-26T12:31:26.912312+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:31:26.912312+0000","last_undegraded":"2024-04-26T12:31:26.912312+0000","last_fullsized":"2024-04-26T12:31:26.912312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912277+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:31:26.912277+0000","last_peered":"2024-04-26T12:31:26.912277+0000","last_clean":"2024-04-26T12:31:26.912277+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:31:26.912277+0000","last_undegraded":"2024-04-26T12:31:26.912277+0000","last_fullsized":"2024-04-26T12:31:26.912277+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911646+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:31:26.911646+0000","last_peered":"2024-04-26T12:31:26.911646+0000","last_clean":"2024-04-26T12:31:26.911646+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:31:26.911646+0000","last_undegraded":"2024-04-26T12:31:26.911646+0000","last_fullsized":"2024-04-26T12:31:26.911646+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911598+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:31:26.911598+0000","last_peered":"2024-04-26T12:31:26.911598+0000","last_clean":"2024-04-26T12:31:26.911598+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:31:26.911598+0000","last_undegraded":"2024-04-26T12:31:26.911598+0000","last_fullsized":"2024-04-26T12:31:26.911598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912392+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:31:26.912392+0000","last_peered":"2024-04-26T12:31:26.912392+0000","last_clean":"2024-04-26T12:31:26.912392+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:31:26.912392+0000","last_undegraded":"2024-04-26T12:31:26.912392+0000","last_fullsized":"2024-04-26T12:31:26.912392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912192+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:31:26.912192+0000","last_peered":"2024-04-26T12:31:26.912192+0000","last_clean":"2024-04-26T12:31:26.912192+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:31:26.912192+0000","last_undegraded":"2024-04-26T12:31:26.912192+0000","last_fullsized":"2024-04-26T12:31:26.912192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912856+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:31:26.912856+0000","last_peered":"2024-04-26T12:31:26.912856+0000","last_clean":"2024-04-26T12:31:26.912856+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:31:26.912856+0000","last_undegraded":"2024-04-26T12:31:26.912856+0000","last_fullsized":"2024-04-26T12:31:26.912856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929201+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:31:25.929201+0000","last_peered":"2024-04-26T12:31:25.929201+0000","last_clean":"2024-04-26T12:31:25.929201+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:31:25.929201+0000","last_undegraded":"2024-04-26T12:31:25.929201+0000","last_fullsized":"2024-04-26T12:31:25.929201+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912845+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:31:26.912845+0000","last_peered":"2024-04-26T12:31:26.912845+0000","last_clean":"2024-04-26T12:31:26.912845+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:31:26.912845+0000","last_undegraded":"2024-04-26T12:31:26.912845+0000","last_fullsized":"2024-04-26T12:31:26.912845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.928810+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:31:25.928810+0000","last_peered":"2024-04-26T12:31:25.928810+0000","last_clean":"2024-04-26T12:31:25.928810+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:31:25.928810+0000","last_undegraded":"2024-04-26T12:31:25.928810+0000","last_fullsized":"2024-04-26T12:31:25.928810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911935+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:31:26.911935+0000","last_peered":"2024-04-26T12:31:26.911935+0000","last_clean":"2024-04-26T12:31:26.911935+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:31:26.911935+0000","last_undegraded":"2024-04-26T12:31:26.911935+0000","last_fullsized":"2024-04-26T12:31:26.911935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911826+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:31:26.911826+0000","last_peered":"2024-04-26T12:31:26.911826+0000","last_clean":"2024-04-26T12:31:26.911826+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:31:26.911826+0000","last_undegraded":"2024-04-26T12:31:26.911826+0000","last_fullsized":"2024-04-26T12:31:26.911826+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912741+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:31:26.912741+0000","last_peered":"2024-04-26T12:31:26.912741+0000","last_clean":"2024-04-26T12:31:26.912741+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:31:26.912741+0000","last_undegraded":"2024-04-26T12:31:26.912741+0000","last_fullsized":"2024-04-26T12:31:26.912741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929236+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:31:25.929236+0000","last_peered":"2024-04-26T12:31:25.929236+0000","last_clean":"2024-04-26T12:31:25.929236+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:31:25.929236+0000","last_undegraded":"2024-04-26T12:31:25.929236+0000","last_fullsized":"2024-04-26T12:31:25.929236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912388+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:31:26.912388+0000","last_peered":"2024-04-26T12:31:26.912388+0000","last_clean":"2024-04-26T12:31:26.912388+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:31:26.912388+0000","last_undegraded":"2024-04-26T12:31:26.912388+0000","last_fullsized":"2024-04-26T12:31:26.912388+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912471+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:31:26.912471+0000","last_peered":"2024-04-26T12:31:26.912471+0000","last_clean":"2024-04-26T12:31:26.912471+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:31:26.912471+0000","last_undegraded":"2024-04-26T12:31:26.912471+0000","last_fullsized":"2024-04-26T12:31:26.912471+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911740+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:31:26.911740+0000","last_peered":"2024-04-26T12:31:26.911740+0000","last_clean":"2024-04-26T12:31:26.911740+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:31:26.911740+0000","last_undegraded":"2024-04-26T12:31:26.911740+0000","last_fullsized":"2024-04-26T12:31:26.911740+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911269+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:31:26.911269+0000","last_peered":"2024-04-26T12:31:26.911269+0000","last_clean":"2024-04-26T12:31:26.911269+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:31:26.911269+0000","last_undegraded":"2024-04-26T12:31:26.911269+0000","last_fullsized":"2024-04-26T12:31:26.911269+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929063+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:31:25.929063+0000","last_peered":"2024-04-26T12:31:25.929063+0000","last_clean":"2024-04-26T12:31:25.929063+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:31:25.929063+0000","last_undegraded":"2024-04-26T12:31:25.929063+0000","last_fullsized":"2024-04-26T12:31:25.929063+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912018+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:31:26.912018+0000","last_peered":"2024-04-26T12:31:26.912018+0000","last_clean":"2024-04-26T12:31:26.912018+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:31:26.912018+0000","last_undegraded":"2024-04-26T12:31:26.912018+0000","last_fullsized":"2024-04-26T12:31:26.912018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912519+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:31:26.912519+0000","last_peered":"2024-04-26T12:31:26.912519+0000","last_clean":"2024-04-26T12:31:26.912519+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:31:26.912519+0000","last_undegraded":"2024-04-26T12:31:26.912519+0000","last_fullsized":"2024-04-26T12:31:26.912519+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911942+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:31:26.911942+0000","last_peered":"2024-04-26T12:31:26.911942+0000","last_clean":"2024-04-26T12:31:26.911942+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:31:26.911942+0000","last_undegraded":"2024-04-26T12:31:26.911942+0000","last_fullsized":"2024-04-26T12:31:26.911942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911414+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:31:26.911414+0000","last_peered":"2024-04-26T12:31:26.911414+0000","last_clean":"2024-04-26T12:31:26.911414+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:31:26.911414+0000","last_undegraded":"2024-04-26T12:31:26.911414+0000","last_fullsized":"2024-04-26T12:31:26.911414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.928968+0000","last_change":"2024-04-26T12:31:07.233644+0000","last_active":"2024-04-26T12:31:25.928968+0000","last_peered":"2024-04-26T12:31:25.928968+0000","last_clean":"2024-04-26T12:31:25.928968+0000","last_became_active":"2024-04-26T12:31:07.233477+0000","last_became_peered":"2024-04-26T12:31:07.233477+0000","last_unstale":"2024-04-26T12:31:25.928968+0000","last_undegraded":"2024-04-26T12:31:25.928968+0000","last_fullsized":"2024-04-26T12:31:25.928968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:24.149502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911946+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:31:26.911946+0000","last_peered":"2024-04-26T12:31:26.911946+0000","last_clean":"2024-04-26T12:31:26.911946+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:31:26.911946+0000","last_undegraded":"2024-04-26T12:31:26.911946+0000","last_fullsized":"2024-04-26T12:31:26.911946+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911158+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:31:26.911158+0000","last_peered":"2024-04-26T12:31:26.911158+0000","last_clean":"2024-04-26T12:31:26.911158+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:31:26.911158+0000","last_undegraded":"2024-04-26T12:31:26.911158+0000","last_fullsized":"2024-04-26T12:31:26.911158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929737+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:31:25.929737+0000","last_peered":"2024-04-26T12:31:25.929737+0000","last_clean":"2024-04-26T12:31:25.929737+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:31:25.929737+0000","last_undegraded":"2024-04-26T12:31:25.929737+0000","last_fullsized":"2024-04-26T12:31:25.929737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929530+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:31:25.929530+0000","last_peered":"2024-04-26T12:31:25.929530+0000","last_clean":"2024-04-26T12:31:25.929530+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:31:25.929530+0000","last_undegraded":"2024-04-26T12:31:25.929530+0000","last_fullsized":"2024-04-26T12:31:25.929530+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911649+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:31:26.911649+0000","last_peered":"2024-04-26T12:31:26.911649+0000","last_clean":"2024-04-26T12:31:26.911649+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:31:26.911649+0000","last_undegraded":"2024-04-26T12:31:26.911649+0000","last_fullsized":"2024-04-26T12:31:26.911649+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.928997+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:31:25.928997+0000","last_peered":"2024-04-26T12:31:25.928997+0000","last_clean":"2024-04-26T12:31:25.928997+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:31:25.928997+0000","last_undegraded":"2024-04-26T12:31:25.928997+0000","last_fullsized":"2024-04-26T12:31:25.928997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911867+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:31:26.911867+0000","last_peered":"2024-04-26T12:31:26.911867+0000","last_clean":"2024-04-26T12:31:26.911867+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:31:26.911867+0000","last_undegraded":"2024-04-26T12:31:26.911867+0000","last_fullsized":"2024-04-26T12:31:26.911867+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911888+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:31:26.911888+0000","last_peered":"2024-04-26T12:31:26.911888+0000","last_clean":"2024-04-26T12:31:26.911888+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:31:26.911888+0000","last_undegraded":"2024-04-26T12:31:26.911888+0000","last_fullsized":"2024-04-26T12:31:26.911888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911240+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:31:26.911240+0000","last_peered":"2024-04-26T12:31:26.911240+0000","last_clean":"2024-04-26T12:31:26.911240+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:31:26.911240+0000","last_undegraded":"2024-04-26T12:31:26.911240+0000","last_fullsized":"2024-04-26T12:31:26.911240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912888+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:31:26.912888+0000","last_peered":"2024-04-26T12:31:26.912888+0000","last_clean":"2024-04-26T12:31:26.912888+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:31:26.912888+0000","last_undegraded":"2024-04-26T12:31:26.912888+0000","last_fullsized":"2024-04-26T12:31:26.912888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911930+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:31:26.911930+0000","last_peered":"2024-04-26T12:31:26.911930+0000","last_clean":"2024-04-26T12:31:26.911930+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:31:26.911930+0000","last_undegraded":"2024-04-26T12:31:26.911930+0000","last_fullsized":"2024-04-26T12:31:26.911930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929260+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:31:25.929260+0000","last_peered":"2024-04-26T12:31:25.929260+0000","last_clean":"2024-04-26T12:31:25.929260+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:31:25.929260+0000","last_undegraded":"2024-04-26T12:31:25.929260+0000","last_fullsized":"2024-04-26T12:31:25.929260+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929096+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:31:25.929096+0000","last_peered":"2024-04-26T12:31:25.929096+0000","last_clean":"2024-04-26T12:31:25.929096+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:31:25.929096+0000","last_undegraded":"2024-04-26T12:31:25.929096+0000","last_fullsized":"2024-04-26T12:31:25.929096+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929283+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:31:25.929283+0000","last_peered":"2024-04-26T12:31:25.929283+0000","last_clean":"2024-04-26T12:31:25.929283+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:31:25.929283+0000","last_undegraded":"2024-04-26T12:31:25.929283+0000","last_fullsized":"2024-04-26T12:31:25.929283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912493+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:31:26.912493+0000","last_peered":"2024-04-26T12:31:26.912493+0000","last_clean":"2024-04-26T12:31:26.912493+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:31:26.912493+0000","last_undegraded":"2024-04-26T12:31:26.912493+0000","last_fullsized":"2024-04-26T12:31:26.912493+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912392+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:31:26.912392+0000","last_peered":"2024-04-26T12:31:26.912392+0000","last_clean":"2024-04-26T12:31:26.912392+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:31:26.912392+0000","last_undegraded":"2024-04-26T12:31:26.912392+0000","last_fullsized":"2024-04-26T12:31:26.912392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929608+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:31:25.929608+0000","last_peered":"2024-04-26T12:31:25.929608+0000","last_clean":"2024-04-26T12:31:25.929608+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:31:25.929608+0000","last_undegraded":"2024-04-26T12:31:25.929608+0000","last_fullsized":"2024-04-26T12:31:25.929608+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912206+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:31:26.912206+0000","last_peered":"2024-04-26T12:31:26.912206+0000","last_clean":"2024-04-26T12:31:26.912206+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:31:26.912206+0000","last_undegraded":"2024-04-26T12:31:26.912206+0000","last_fullsized":"2024-04-26T12:31:26.912206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911996+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:31:26.911996+0000","last_peered":"2024-04-26T12:31:26.911996+0000","last_clean":"2024-04-26T12:31:26.911996+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:26.911996+0000","last_undegraded":"2024-04-26T12:31:26.911996+0000","last_fullsized":"2024-04-26T12:31:26.911996+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.928731+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:31:25.928731+0000","last_peered":"2024-04-26T12:31:25.928731+0000","last_clean":"2024-04-26T12:31:25.928731+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:31:25.928731+0000","last_undegraded":"2024-04-26T12:31:25.928731+0000","last_fullsized":"2024-04-26T12:31:25.928731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911928+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:31:26.911928+0000","last_peered":"2024-04-26T12:31:26.911928+0000","last_clean":"2024-04-26T12:31:26.911928+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:31:26.911928+0000","last_undegraded":"2024-04-26T12:31:26.911928+0000","last_fullsized":"2024-04-26T12:31:26.911928+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912183+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:31:26.912183+0000","last_peered":"2024-04-26T12:31:26.912183+0000","last_clean":"2024-04-26T12:31:26.912183+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:31:26.912183+0000","last_undegraded":"2024-04-26T12:31:26.912183+0000","last_fullsized":"2024-04-26T12:31:26.912183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.912073+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:31:26.912073+0000","last_peered":"2024-04-26T12:31:26.912073+0000","last_clean":"2024-04-26T12:31:26.912073+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:31:26.912073+0000","last_undegraded":"2024-04-26T12:31:26.912073+0000","last_fullsized":"2024-04-26T12:31:26.912073+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911219+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:31:26.911219+0000","last_peered":"2024-04-26T12:31:26.911219+0000","last_clean":"2024-04-26T12:31:26.911219+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:31:26.911219+0000","last_undegraded":"2024-04-26T12:31:26.911219+0000","last_fullsized":"2024-04-26T12:31:26.911219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929221+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:31:25.929221+0000","last_peered":"2024-04-26T12:31:25.929221+0000","last_clean":"2024-04-26T12:31:25.929221+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:31:25.929221+0000","last_undegraded":"2024-04-26T12:31:25.929221+0000","last_fullsized":"2024-04-26T12:31:25.929221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.911685+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:31:26.911685+0000","last_peered":"2024-04-26T12:31:26.911685+0000","last_clean":"2024-04-26T12:31:26.911685+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:31:26.911685+0000","last_undegraded":"2024-04-26T12:31:26.911685+0000","last_fullsized":"2024-04-26T12:31:26.911685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.929380+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:31:25.929380+0000","last_peered":"2024-04-26T12:31:25.929380+0000","last_clean":"2024-04-26T12:31:25.929380+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:31:25.929380+0000","last_undegraded":"2024-04-26T12:31:25.929380+0000","last_fullsized":"2024-04-26T12:31:25.929380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738383,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":723964,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.56399999999999995}]},{"osd":1,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.54400000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":125796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":723348,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.503}]},{"osd":2,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.315},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.30199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:33.451 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:33.452 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:33.462 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:33.493 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:33.492+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:33.589 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:33.590 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:33.594 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:33.593+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:33.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:33.695 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:33.694+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:33.740 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:33.740 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:33.751 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:33.795 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:33.795+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:33.896 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:33.896+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:33.918 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:33.919 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:33.929 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:33.997 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:33.997+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:34.007 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:31:34.057 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:34.057 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:34.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:34.108 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:34.107+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:34.200 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:34.199+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:34.208 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:34.208 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:34.218 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:34.301 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:34.300+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:34.344 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:34.344 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:34.354 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:34.403 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:34.402+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:34.482 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:34.482 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:34.492 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:34.503 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:34.502+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:34.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:34.604 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:34.603+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:34.632 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:34.633 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:34.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:34.673 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:34.695 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:34.704 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:34.703+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:34.715 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:34.717 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:34.717 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:34.717 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:34.771 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:34.772 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:34.772 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:34.772 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:34.772 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:34.782 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:34.805 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:34.805+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:34.906 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:34.905+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:34.951 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:34.951 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:34.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 67.659958453000002, 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.952 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:34.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:34.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:34.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346702292000003, 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:34.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:34.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:34.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:34.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:34.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:34.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:34.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:34.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:34.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.964 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346660612999997, 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:34.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:34.966 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.968 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:34.970 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346631834, 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:34.972 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:34.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:34.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:34.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346602185999998, 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:34.976 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:34.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:34.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:34.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346563371999999, 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:34.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:34.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:34.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:34.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:34.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:34.990 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346534583999997, 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:34.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:34.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:34.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.997 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346507443, 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:34.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:34.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:35.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:35.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:35.003 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346465723000001, 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:35.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:35.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.009 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346422605999997, 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:35.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.34640392, 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.016 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346381051000002, 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.022 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:35.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346350168999997, 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.028 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:35.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:35.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:35.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.034 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346332697999998, 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:35.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:35.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:35.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:35.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.040 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346309963000003, 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:35.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:35.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346280421000003, 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:35.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:35.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:35.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346254979000001, 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:35.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:35.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:35.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346225812999997, 2024-04-26T12:31:35.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:35.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:35.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:35.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.066 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346211887999999, 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:35.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:35.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:35.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 62.346194552999997, 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:35.073 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:35.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:35.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:35.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:35.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:35.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:35.078 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.078 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.078 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.078 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:35.078 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:35.078 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:35.079 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:35.080 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:35.078+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:35.180 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:35.179+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:35.221 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:35.221 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:35.221 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:35.221 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:35.231 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:35.281 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:35.280+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:35.359 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:35.359 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:35.359 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:35.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:35.382 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:35.382+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:35.482 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:35.482+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.934466665999999, 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:35.539 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:35.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.934406428000003, 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:35.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.934373108000003, 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.934343317, 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.556 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:35.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:35.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.934330002999999, 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:35.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:35.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:35.566 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.934313027999998, 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.934245937999997, 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:35.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.575 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.934215557999998, 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:35.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:35.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:35.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.93419282, 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:35.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:35.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:35.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.929986732000003, 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:35.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.924616948999997, 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:35.591 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.924436237999998, 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.924409394000001, 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.595 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.599 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.924369769000002, 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:35.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:35.603 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.924296169999998, 2024-04-26T12:31:35.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:35.605 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.605 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.605 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:35.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:35.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:35.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.922836508000003, 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:35.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.922552252000003, 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:35.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.918019577999999, 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:35.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 62.917890528999997, 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.621 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:35.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.625 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 58.628545201000001, 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:35.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:35.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:35.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:35.631 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:35.633 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:35.634 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:35.632+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:35.733 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:35.732+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:35.773 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:35.773 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:35.774 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:35.774 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:35.784 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:35.834 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:35.834+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:35.911 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:35.911 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:35.911 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:35.911 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:35.911 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:35.921 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:35.965 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:35.965+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:36.021 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:31:36.036 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:36.036+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:36.050 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 69.158220544000002, 2024-04-26T12:31:36.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.444982684000003, 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.055 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:36.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:36.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:36.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.444924622000002, 2024-04-26T12:31:36.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:36.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:36.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:36.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.067 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.444896069000002, 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.073 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.444876594, 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:36.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.444856549999997, 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.080 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:36.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:36.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.444833252999999, 2024-04-26T12:31:36.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:36.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:36.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:36.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.444812810999998, 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:36.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.444792264999997, 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:36.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:36.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.104 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.444760271, 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:36.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:36.109 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.443353295000001, 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.113 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.442699617000002, 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.117 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.442477560999997, 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:36.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:36.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.438024343999999, 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:36.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:36.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.432596029000003, 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.131 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.432335659000003, 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:36.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.432302262999997, 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:36.136 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:36.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.432097261999999, 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:36.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:36.144 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.426471085999999, 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:36.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:36.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:36.149 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 63.426091675999999, 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:36.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:36.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:36.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:36.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.154 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:36.154 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:36.154 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:36.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:36.156 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:36.154+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:36.256 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:36.256+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:36.295 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:36.296 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:36.296 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:36.296 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:36.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:36.357 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:36.356+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:36.433 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:36.433 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:36.433 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:36.433 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:36.434 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:36.443 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:36.458 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:36.458+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:36.559 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:36.558+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 69.281571485000001, 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968315324000002, 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968273644999996, 2024-04-26T12:31:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968244865999999, 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968215217999997, 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968176403999998, 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968147616000003, 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968120474999999, 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968078755000001, 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968035638000003, 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.627 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:36.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:36.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:36.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.968016951999999, 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.638 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.967994083000001, 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:36.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.967963201000003, 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:36.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:36.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.967945729999997, 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:36.650 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.967922995000002, 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.967893453000002, 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.667 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.967868011, 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:36.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:36.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:36.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:36.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.967838845000003, 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.673 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:36.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:36.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:36.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.967824919999998, 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.684 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 63.967807585000003, 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:36.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:36.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:36.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:36.689 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:36.691 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:36.690+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:36.691 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:36.730 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:36.791 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:36.790+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:36.832 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:36.832 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:36.832 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:36.832 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:36.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:36.892 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:36.892+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:36.904 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:36.926 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:36.946 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:36.948 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:36.948 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:36.948 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:36.993 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:36.993+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:37.010 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:37.010 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:37.020 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:37.025 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:31:37.094 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:37.093+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:37.148 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:37.149 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:37.159 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:37.195 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:37.194+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:37.296 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:37.296+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:37.299 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:37.299 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:37.309 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:37.397 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:37.397+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:37.437 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:37.437 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:37.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:37.498 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:37.497+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:37.598 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:37.598+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:37.615 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:37.615 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:37.625 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:37.699 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:37.699+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:37.766 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:37.766 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:37.777 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:37.800 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:37.799+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:37.901 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:37.900+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:37.904 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:37.905 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:37.915 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:38.002 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:38.002+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:38.043 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:38.043 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:38.053 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:38.102 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:38.102+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:38.194 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:38.194 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:38.204 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:38.205 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:38.204+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:38.305 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:38.305+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:38.332 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:38.332 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:38.342 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:38.406 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:38.405+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:38.452 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:38.452 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:38.452 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T12:31:38.452 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:31:38.452 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:31:38.453 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T12:31:38.470 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:38.470 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:38.480 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:38.525 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:38.525+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:38.586 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:38.586 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:31:38.586 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:38.608 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:38.607+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:38.619 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:38.619 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:38.630 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:38.714 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:38.714+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:38.798 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:38.798 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:38.808 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:38.810 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:38.809+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:38.911 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:38.910+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:38.962 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:38.978 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:38.978 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:38.989 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:39.033 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:39.032+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:39.039 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:31:39.112 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:39.111+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:39.117 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:39.117 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:39.127 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:39.167 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:39.189 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:39.209 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:39.211 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:39.212 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:39.212 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:39.212+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:39.296 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:39.296 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:39.296 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:39.296 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:39.296 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:39.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:39.314 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:39.313+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:39.415 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:39.414+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:39.435 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 72.144002822999994, 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:39.436 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:39.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:39.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.441 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830746661999996, 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:39.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.447 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830704983000004, 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:39.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830676204, 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.454 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:39.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:39.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:39.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830646556000005, 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.460 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:39.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.466 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830607741999998, 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:39.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:39.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.472 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830578954000003, 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:39.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.478 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830551813, 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:39.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:39.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830510093000001, 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:39.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830466975999997, 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:39.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:39.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830448290000007, 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:39.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:39.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:39.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830425421000001, 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:39.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:39.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:39.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830394538999997, 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:39.510 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:39.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:39.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830377068000004, 2024-04-26T12:31:39.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:39.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:39.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:39.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:39.522 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830354333000002, 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:39.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:39.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:39.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:39.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830324790999995, 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:39.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:39.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.534 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830299349000001, 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:39.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:39.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:39.540 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830270182999996, 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:39.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830256258000006, 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:39.547 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:39.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:39.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 66.830238922999996, 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:39.553 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:39.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:39.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:39.558 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:39.558 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:39.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:39.560 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:39.558+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:39.660 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:39.660+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:39.700 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:39.700 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:39.700 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:39.700 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:39.710 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:39.761 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:39.760+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:39.840 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:39.841 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:39.850 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:39.861 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:39.861+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:39.963 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:39.962+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:40.019 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:40.019 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:40.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:40.019 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:40.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.019 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.019 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:40.019 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.414387175000002, 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:40.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:40.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:40.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.026 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.026 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.026 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:40.027 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.414326936999998, 2024-04-26T12:31:40.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:40.027 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.027 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.027 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:40.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:40.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:40.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:40.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.414293616999998, 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:40.033 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:40.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:40.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:40.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.039 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.414263825999996, 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:40.046 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.414250511999995, 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:40.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.052 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.414233537000001, 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:40.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.414166446999999, 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:40.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:40.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.063 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.414136067000001, 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:40.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:40.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:40.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:40.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.068 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.068 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.414113329000003, 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.409907240999999, 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:40.073 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.077 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.404537457999993, 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:40.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:40.082 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.404356746999994, 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:40.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.404329903000004, 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:40.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.091 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.404290278000005, 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:40.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:40.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.404216679000001, 2024-04-26T12:31:40.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:40.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.402757016999999, 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:40.100 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:40.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.104 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.402472760999999, 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:40.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.397940086999995, 2024-04-26T12:31:40.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:40.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:40.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:40.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.397811038, 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:40.114 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:40.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 63.108465709999997, 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:40.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:40.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:40.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:40.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.125 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:40.125 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:40.125 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:40.127 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:40.126+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:40.127 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:31:40.128 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:40.227 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:40.227+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:40.270 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:40.270 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:40.270 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:40.270 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:40.280 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:40.364 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:40.364+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:40.428 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:40.428+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:40.448 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:40.448 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:40.448 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:40.448 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:40.448 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:40.458 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:40.542 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:40.542+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:40.628 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:40.628 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:40.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:40.628 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 73.736322939000004, 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:40.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:40.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:40.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:40.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:40.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:40.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:40.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.634 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.023085078999998, 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:40.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:40.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:40.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:40.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:40.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.641 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.641 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.642 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:40.642 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.023027017000004, 2024-04-26T12:31:40.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:40.642 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.642 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.642 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:40.648 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.022998463999997, 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:40.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:40.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:40.654 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.022978988999995, 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:40.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:40.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.660 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.022958944999999, 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:40.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:40.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.022935648000001, 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:40.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.673 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.022915205999993, 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:40.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:40.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.679 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.022894660000006, 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:40.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.022862665999995, 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.684 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:40.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.688 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.021455689999996, 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:40.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:40.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:40.693 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.020802012000004, 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:40.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:40.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.020579956000006, 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:40.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.016126739000001, 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:40.701 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.705 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.010698423999997, 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:40.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:40.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:40.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.010438054000005, 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:40.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:40.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.010404657999999, 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:40.714 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.010199657000001, 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:40.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.004573480999994, 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:40.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:40.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:40.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 68.004194071000001, 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:40.727 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:40.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:40.732 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:40.732 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:40.733 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:40.734 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:40.732+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:40.834 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:40.834+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:40.873 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:40.873 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:40.873 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:40.874 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:40.885 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:40.935 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:40.934+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:41.013 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:41.013 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:41.013 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:41.013 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:41.013 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:41.023 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:41.064 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:41.063+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:41.137 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:41.137+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.90134784, 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.193 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.198 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.588091679000001, 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.205 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.588049999999996, 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:41.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:41.211 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.588021221000005, 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:41.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:41.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:41.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:41.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587991572999996, 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:41.217 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:41.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:41.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:41.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587952759000004, 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:41.223 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587923970999995, 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:41.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:41.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:41.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587896830000005, 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587855110000007, 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587811993000003, 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587793306999998, 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.258 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587770438000007, 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:41.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:41.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:41.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587739556000002, 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:41.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:41.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587722084999996, 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:41.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:41.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:41.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:41.276 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587699349999994, 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587669808000001, 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:41.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:41.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587644366000006, 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587615200000002, 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:41.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587601274999997, 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:41.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:41.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:41.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 68.587583940000002, 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:41.310 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:41.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:41.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:41.311 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.311 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.311 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.311 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:41.311 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:41.311 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:41.311 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:41.313 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:41.314 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:41.312+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:41.413 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:41.412+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:41.454 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:41.454 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:41.454 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:41.454 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:41.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:41.515 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:41.514+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:41.516 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:41.540 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:41.576 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:41.578 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:41.578 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:41.578 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:41.615 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:41.615+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:41.631 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:41.631 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:41.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:41.717 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:41.716+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:41.769 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:41.769 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:41.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:41.817 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:41.817+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:41.918 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:41.918+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:41.919 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:41.919 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:41.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:42.020 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:42.019+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:42.097 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:42.097 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:42.107 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:42.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:31:42.151 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:42.151+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:42.222 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:42.222+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:42.235 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:42.235 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:42.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:42.323 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:42.323+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:42.387 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:42.387 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:42.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:42.424 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:42.423+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:42.525 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:42.524+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:42.526 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:42.526 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:42.536 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:42.626 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:42.626+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:42.663 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:42.663 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:42.674 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:42.727 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:42.727+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:42.814 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:42.814 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:42.824 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:42.869 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:42.868+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:42.929 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:42.929+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:42.951 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:42.951 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:42.961 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:43.030 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:43.030+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:43.115 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:31:43.130 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:43.131 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:43.131 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:43.131+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:43.140 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:43.232 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:43.232+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:43.279 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:43.279 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:43.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:43.333 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:43.332+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:43.434 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:43.434+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:43.459 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:43.459 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:43.469 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:43.535 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:43.534+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:43.592 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:43.597 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:43.597 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:43.597 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T12:31:43.597 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:31:43.597 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:31:43.598 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T12:31:43.635 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:43.635+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:43.636 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:43.636 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:43.647 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:43.729 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:43.729 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "" 2024-04-26T12:31:43.730 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:43.736 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:43.735+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:43.785 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:43.787 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:43.787 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:43.797 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:43.816 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:43.836 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:43.837 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:43.836+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:43.838 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:43.938 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:43.938+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:43.966 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:43.966 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:43.966 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:43.966 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:43.966 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:43.976 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:44.038 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:44.038+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:44.106 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:44.106 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:44.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:44.106 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 76.814922639000002, 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501666478000004, 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.112 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:44.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:44.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:44.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501624798999998, 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.124 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501596019999994, 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.130 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501566371999999, 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:44.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:44.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:44.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501527558000006, 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:44.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501498769999998, 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:44.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:44.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:44.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501471628999994, 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:44.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501429908999995, 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.155 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:44.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501386792000005, 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:44.161 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:44.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:44.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:44.167 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501368106000001, 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:44.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:44.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501345236999995, 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.174 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:44.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:44.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501314355000005, 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:44.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:44.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:44.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:44.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:44.186 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501296883999998, 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:44.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:44.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:44.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:44.192 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501274148999997, 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:44.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:44.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:44.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.198 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501244607000004, 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501219164999995, 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.205 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:44.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:44.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:44.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:44.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:44.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:44.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:44.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501189999000005, 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.219 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501176074, 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:44.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:44.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 71.501158739000005, 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:44.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:44.230 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:44.232 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:44.231+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:44.232 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:44.333 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:44.333+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:44.364 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:44.364 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:44.364 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:44.365 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:44.374 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:44.434 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:44.434+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:44.501 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:44.501 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:44.501 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:44.501 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:44.501 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:44.511 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:44.535 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:44.535+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:44.635 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:44.634+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:44.640 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.036665255000003, 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:44.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:44.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:44.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:44.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.036605016999999, 2024-04-26T12:31:44.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:44.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:44.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.036571696999999, 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:44.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:44.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.036541905999997, 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:44.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.036528591999996, 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:44.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:44.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:44.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.666 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.667 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.036511617000002, 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:44.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.672 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.036444527, 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.036414147000002, 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.680 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.036391409000004, 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.684 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.032185321, 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:44.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:44.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.026815537999994, 2024-04-26T12:31:44.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:44.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:44.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.026634826999995, 2024-04-26T12:31:44.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:44.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:44.696 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.026607983000005, 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:44.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:44.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.026568358000006, 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:44.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:44.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:44.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.026494759000002, 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:44.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.025035097, 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.709 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:44.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.024750840999999, 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:44.713 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:44.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:44.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.020218166999996, 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:44.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.020089118000001, 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:44.721 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.725 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.730743790000005, 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:44.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:44.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:44.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:44.731 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:44.731 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:44.732 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:44.774 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:44.773+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:44.836 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:44.836+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:44.866 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:44.866 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:44.876 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:44.937 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:44.936+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:45.003 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:45.003 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:45.003 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:45.003 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:45.003 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:45.013 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:45.038 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:45.037+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:45.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:31:45.138 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:45.138+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:45.142 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:45.142 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 78.250423660999999, 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:45.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.537185801000007, 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.537127738999999, 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.159 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.537099186000006, 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:45.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:45.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:45.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.537079711000004, 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:45.165 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:45.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:45.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:45.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:45.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.537059666999994, 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:45.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:45.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:45.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:45.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.537036369999996, 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:45.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.537015928000002, 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.184 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:45.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:45.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.536995382000001, 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:45.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:45.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.536963388000004, 2024-04-26T12:31:45.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:45.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.535556412000005, 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.200 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:45.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:45.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.534902733999999, 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:45.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.534680678000001, 2024-04-26T12:31:45.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:45.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:45.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.530227460999996, 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.213 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:45.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.217 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.524799146000007, 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:45.221 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.524538776, 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.524505379999994, 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.226 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.524300378999996, 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.230 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:45.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.518674203000003, 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:45.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:45.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:45.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:45.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:45.240 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 72.518294792999995, 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:45.244 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:45.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:45.247 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:45.245+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:45.347 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:45.346+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:45.387 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:45.387 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:45.387 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:45.387 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:45.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:45.448 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:45.447+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:45.548 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:45.548+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:45.565 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:45.565 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:45.575 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:45.650 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:45.650+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:45.705 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:45.705 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:45.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:45.705 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:45.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.705 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 78.413706645000005, 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:45.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100450484000007, 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:45.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:45.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:45.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:45.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:45.718 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100408805000001, 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:45.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:45.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:45.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:45.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:45.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100380025999996, 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:45.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:45.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.730 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100350378000002, 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:45.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:45.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100311563999995, 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:45.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:45.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.742 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100282776, 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:45.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.748 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100255634999996, 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:45.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:45.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:45.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100213914999998, 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:45.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.761 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100170797999994, 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:45.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:45.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.767 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100152112000004, 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:45.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:45.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:45.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100129242999998, 2024-04-26T12:31:45.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:45.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:45.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:45.780 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100098360999993, 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:45.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:45.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:45.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100080890000001, 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:45.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100058154999999, 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:45.793 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:45.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:45.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.798 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100028613000006, 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:45.799 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:45.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.100003170999997, 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:45.805 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.806 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:45.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:45.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:45.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.811 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.099974005000007, 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:45.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:45.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.099960080000002, 2024-04-26T12:31:45.817 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:45.818 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:45.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.821 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:45.823 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 73.099942745000007, 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:45.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:45.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:45.828 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:45.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:45.831 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:45.830+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:45.855 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:45.931 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:45.930+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:45.970 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:45.971 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:45.971 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:45.971 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:45.981 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:46.032 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:46.032+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:46.091 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:46.112 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:46.133 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:46.133+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:46.138 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:31:46.149 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:46.151 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:46.151 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:46.151 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:46.151 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:46.151 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:46.161 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:46.234 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:46.234+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:46.288 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:46.288 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:46.298 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:46.335 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:46.334+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:46.436 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:46.435+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:46.438 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:46.438 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:46.448 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:46.537 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:46.537+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:46.575 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:46.575 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:46.585 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:46.637 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:46.637+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:46.738 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:46.738+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:46.752 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:46.752 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:46.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:46.839 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:46.838+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:46.902 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:46.902 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:46.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:46.941 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:46.940+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:47.040 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:47.040 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:47.041 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:47.040+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:47.050 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:47.142 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:47.141+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:47.177 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:47.177 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:47.187 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:47.243 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:47.242+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:47.328 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:47.328 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:47.338 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:47.344 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:47.344+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:47.445 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:47.445+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:47.465 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:47.465 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:47.475 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:47.546 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:47.545+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:47.603 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:47.603 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:47.613 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:47.654 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:47.653+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:47.748 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:47.747+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:47.755 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:47.755 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:47.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:47.848 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:47.848+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:47.892 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:47.892 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:47.902 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:47.949 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:47.948+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:48.029 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:48.029 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:48.039 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:48.051 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:48.050+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:48.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:31:48.151 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:48.150+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:48.165 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:48.175 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:48.175 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:48.185 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:48.269 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:48.268+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:48.352 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:48.353 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:48.353 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:48.352+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:48.363 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:48.409 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:48.446 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:48.453 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:48.452+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:48.483 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:48.488 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:48.488 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:48.488 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 81.242158066000002, 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.534 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:48.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:48.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928901905000004, 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:48.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:48.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:48.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928860225999998, 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:48.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:48.551 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928831446999993, 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928801798999999, 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.557 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:48.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:48.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:48.562 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928762985000006, 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928734196999997, 2024-04-26T12:31:48.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:48.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:48.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:48.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928707055999993, 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:48.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928665335999995, 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:48.585 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928622219000005, 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:48.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:48.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:48.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928603533, 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:48.591 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:48.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:48.597 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928580663999995, 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:48.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:48.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:48.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928549782000005, 2024-04-26T12:31:48.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:48.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:48.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928532310999998, 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.609 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928509575999996, 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:48.620 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928480034000003, 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:48.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:48.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928454591999994, 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.632 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928425426000004, 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:48.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:48.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:48.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928411500999999, 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:48.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:48.644 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 75.928394166000004, 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:48.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:48.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:48.648 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.649 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.649 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.649 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:48.649 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:48.649 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:48.650 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:48.650+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:48.651 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:48.741 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:48.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:31:48.750 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:48.750+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:48.791 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:48.791 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:48.791 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:48.791 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:48.801 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:48.851 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:48.851+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:48.929 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:48.929 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:48.929 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:48.929 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:48.929 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:48.938 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:48.951 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:48.951+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:49.052 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:49.051+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:49.066 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.462378485000002, 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:49.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.072 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.462318246999999, 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:49.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.462284926999999, 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:49.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:49.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:49.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.462255135999996, 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:49.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:49.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:49.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.462241821999996, 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:49.088 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:49.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.093 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.462224847000002, 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:49.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.462157757, 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:49.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.102 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.462127377000002, 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:49.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:49.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.462104639000003, 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:49.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.457898551, 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:49.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:49.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.452528767999993, 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:49.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.452348056999995, 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:49.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:49.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.452321213000005, 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.452281588000005, 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.130 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.452207989000001, 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:49.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.450748326999999, 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:49.135 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:49.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:49.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.450464070999999, 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.445931396999995, 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.445802348000001, 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 72.156457020000005, 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:49.156 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:49.157 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:49.156+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:49.158 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:49.177 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:31:49.258 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:49.258+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:49.298 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:49.298 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:49.298 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:49.298 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:49.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:49.359 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:49.357+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:49.435 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:49.435 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:49.435 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:49.435 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:49.435 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:49.445 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:49.460 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:49.459+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:49.560 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:49.559+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:49.614 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 82.722909877999996, 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.009672018000003, 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.619 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:49.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:49.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:49.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:49.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.009613955999995, 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:49.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:49.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:49.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.009585403000003, 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.632 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:49.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:49.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:49.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:49.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.009565928000001, 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.638 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.009545884000005, 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.644 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:49.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:49.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:49.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:49.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:49.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.009522587000006, 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.655 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.009502144999999, 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:49.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:49.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:49.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:49.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.009481598999997, 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.009449605, 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:49.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:49.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.670 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.008042629000002, 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:49.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.007388950999996, 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.007166894999997, 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.678 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:49.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 77.002713678000006, 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.682 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.997285363000003, 2024-04-26T12:31:49.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:49.690 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.997024992999997, 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.996991597000005, 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:49.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.996786596000007, 2024-04-26T12:31:49.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:49.703 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.99116042, 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:49.707 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 76.990781010000006, 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:49.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:49.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:49.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:49.711 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:49.713 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:49.712+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:49.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:49.813 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:49.812+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:49.854 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:49.855 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:49.855 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:49.855 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:49.865 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:49.914 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:49.914+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:50.015 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:50.014+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:50.032 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:50.032 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:50.032 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:50.032 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:50.033 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:50.043 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:50.116 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:50.116+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:50.174 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.882007575000003, 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568751414000005, 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568709734999999, 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568680955999994, 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568651308, 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568612494000007, 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568583705999998, 2024-04-26T12:31:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568556564999994, 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:50.217 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:50.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:50.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568514844999996, 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:50.223 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568471728000006, 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.229 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:50.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568453042000002, 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:50.235 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:50.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:50.241 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568430172999996, 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:50.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:50.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:50.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568399291000006, 2024-04-26T12:31:50.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568381819999999, 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:50.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:50.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:50.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:50.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568359084999997, 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.264 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568329543000004, 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.270 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568304100999995, 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:50.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:50.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:50.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:50.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:50.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568274935000005, 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.276 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:50.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:50.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:50.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:50.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:50.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568261010000001, 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:50.287 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:50.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:50.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.287 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:50.287 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:50.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:50.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.288 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:50.288 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:50.288 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:50.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.288 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:50.289 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:50.289 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.289 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.289 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.289 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:50.289 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:50.290 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 77.568243675000005, 2024-04-26T12:31:50.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:50.290 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:50.290 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:50.290 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:50.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:50.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:50.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:50.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:50.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.294 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.295 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.295 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:50.295 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:50.295 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:50.297 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:31:50.297 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:50.296+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:50.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:31:50.298 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:50.397 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:50.396+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:50.440 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:50.440 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:50.441 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:50.441 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:50.451 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:50.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:50.535 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:50.534+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:50.599 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:50.598+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:50.619 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:50.619 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:50.619 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:50.619 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:50.619 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:50.629 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:50.700 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:50.699+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:50.726 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:50.750 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:50.786 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:50.791 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:50.791 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:50.791 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:50.797 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:50.797 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:50.800 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:50.799+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:50.807 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:50.901 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:50.900+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:50.947 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:50.947 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:50.959 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:51.001 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:51.001+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:51.086 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:51.086 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:51.097 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:51.102 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:51.101+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:51.188 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:31:51.190 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:31:51.203 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:51.203+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:51.209 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:31:51.225 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:51.225 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:51.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:51.304 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:51.303+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:51.376 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:51.376 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:51.386 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:51.405 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:51.405+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:51.506 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:51.505+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:51.513 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:51.513 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:51.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:51.607 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:51.606+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:51.652 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:51.652 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:51.661 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:51.708 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:51.708+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:51.802 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:51.802 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:51.809 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:51.808+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:51.812 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:51.910 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:51.909+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:51.980 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:51.980 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:51.990 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:52.010 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:52.010+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:52.111 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:52.110+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:52.117 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:52.117 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:52.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:52.201 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:31:52.203 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:31:52.213 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:52.212+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:52.221 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:31:52.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:52.268 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:52.268 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:52.279 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:52.313 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:52.312+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:52.406 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:52.406 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:52.413 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:52.412+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:52.418 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:52.514 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:52.513+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:52.586 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:52.586 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:52.596 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:52.640 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:52.639+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:52.664 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:31:52.665 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:31:52.679 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-04-26T12:31:52.195937+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82240,"kb_used_data":1180,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033280,"statfs":{"total":289910292480,"available":289826078720,"internally_reserved":0,"allocated":1208320,"data_stored":1657588,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.211017"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730224+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:31:47.730224+0000","last_peered":"2024-04-26T12:31:47.730224+0000","last_clean":"2024-04-26T12:31:47.730224+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:31:47.730224+0000","last_undegraded":"2024-04-26T12:31:47.730224+0000","last_fullsized":"2024-04-26T12:31:47.730224+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730171+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:31:47.730171+0000","last_peered":"2024-04-26T12:31:47.730171+0000","last_clean":"2024-04-26T12:31:47.730171+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:31:47.730171+0000","last_undegraded":"2024-04-26T12:31:47.730171+0000","last_fullsized":"2024-04-26T12:31:47.730171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126164+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:31:46.126164+0000","last_peered":"2024-04-26T12:31:46.126164+0000","last_clean":"2024-04-26T12:31:46.126164+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:31:46.126164+0000","last_undegraded":"2024-04-26T12:31:46.126164+0000","last_fullsized":"2024-04-26T12:31:46.126164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125896+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:31:46.125896+0000","last_peered":"2024-04-26T12:31:46.125896+0000","last_clean":"2024-04-26T12:31:46.125896+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:31:46.125896+0000","last_undegraded":"2024-04-26T12:31:46.125896+0000","last_fullsized":"2024-04-26T12:31:46.125896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729806+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:31:47.729806+0000","last_peered":"2024-04-26T12:31:47.729806+0000","last_clean":"2024-04-26T12:31:47.729806+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:31:47.729806+0000","last_undegraded":"2024-04-26T12:31:47.729806+0000","last_fullsized":"2024-04-26T12:31:47.729806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119684+0000","last_change":"2024-04-26T12:31:07.232711+0000","last_active":"2024-04-26T12:31:46.119684+0000","last_peered":"2024-04-26T12:31:46.119684+0000","last_clean":"2024-04-26T12:31:46.119684+0000","last_became_active":"2024-04-26T12:31:07.232528+0000","last_became_peered":"2024-04-26T12:31:07.232528+0000","last_unstale":"2024-04-26T12:31:46.119684+0000","last_undegraded":"2024-04-26T12:31:46.119684+0000","last_fullsized":"2024-04-26T12:31:46.119684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:16.731908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119494+0000","last_change":"2024-04-26T12:31:07.231727+0000","last_active":"2024-04-26T12:31:46.119494+0000","last_peered":"2024-04-26T12:31:46.119494+0000","last_clean":"2024-04-26T12:31:46.119494+0000","last_became_active":"2024-04-26T12:31:07.231554+0000","last_became_peered":"2024-04-26T12:31:07.231554+0000","last_unstale":"2024-04-26T12:31:46.119494+0000","last_undegraded":"2024-04-26T12:31:46.119494+0000","last_fullsized":"2024-04-26T12:31:46.119494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:12.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125234+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:31:46.125234+0000","last_peered":"2024-04-26T12:31:46.125234+0000","last_clean":"2024-04-26T12:31:46.125234+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:31:46.125234+0000","last_undegraded":"2024-04-26T12:31:46.125234+0000","last_fullsized":"2024-04-26T12:31:46.125234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120244+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:31:46.120244+0000","last_peered":"2024-04-26T12:31:46.120244+0000","last_clean":"2024-04-26T12:31:46.120244+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:31:46.120244+0000","last_undegraded":"2024-04-26T12:31:46.120244+0000","last_fullsized":"2024-04-26T12:31:46.120244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730210+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:31:47.730210+0000","last_peered":"2024-04-26T12:31:47.730210+0000","last_clean":"2024-04-26T12:31:47.730210+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:31:47.730210+0000","last_undegraded":"2024-04-26T12:31:47.730210+0000","last_fullsized":"2024-04-26T12:31:47.730210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120042+0000","last_change":"2024-04-26T12:31:07.232741+0000","last_active":"2024-04-26T12:31:46.120042+0000","last_peered":"2024-04-26T12:31:46.120042+0000","last_clean":"2024-04-26T12:31:46.120042+0000","last_became_active":"2024-04-26T12:31:07.232521+0000","last_became_peered":"2024-04-26T12:31:07.232521+0000","last_unstale":"2024-04-26T12:31:46.120042+0000","last_undegraded":"2024-04-26T12:31:46.120042+0000","last_fullsized":"2024-04-26T12:31:46.120042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.363233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729904+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:31:47.729904+0000","last_peered":"2024-04-26T12:31:47.729904+0000","last_clean":"2024-04-26T12:31:47.729904+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:31:47.729904+0000","last_undegraded":"2024-04-26T12:31:47.729904+0000","last_fullsized":"2024-04-26T12:31:47.729904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729766+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:31:47.729766+0000","last_peered":"2024-04-26T12:31:47.729766+0000","last_clean":"2024-04-26T12:31:47.729766+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:31:47.729766+0000","last_undegraded":"2024-04-26T12:31:47.729766+0000","last_fullsized":"2024-04-26T12:31:47.729766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125747+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:31:46.125747+0000","last_peered":"2024-04-26T12:31:46.125747+0000","last_clean":"2024-04-26T12:31:46.125747+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:31:46.125747+0000","last_undegraded":"2024-04-26T12:31:46.125747+0000","last_fullsized":"2024-04-26T12:31:46.125747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125382+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:31:46.125382+0000","last_peered":"2024-04-26T12:31:46.125382+0000","last_clean":"2024-04-26T12:31:46.125382+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:31:46.125382+0000","last_undegraded":"2024-04-26T12:31:46.125382+0000","last_fullsized":"2024-04-26T12:31:46.125382+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119437+0000","last_change":"2024-04-26T12:31:07.233006+0000","last_active":"2024-04-26T12:31:46.119437+0000","last_peered":"2024-04-26T12:31:46.119437+0000","last_clean":"2024-04-26T12:31:46.119437+0000","last_became_active":"2024-04-26T12:31:07.232842+0000","last_became_peered":"2024-04-26T12:31:07.232842+0000","last_unstale":"2024-04-26T12:31:46.119437+0000","last_undegraded":"2024-04-26T12:31:46.119437+0000","last_fullsized":"2024-04-26T12:31:46.119437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.359074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120265+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:31:46.120265+0000","last_peered":"2024-04-26T12:31:46.120265+0000","last_clean":"2024-04-26T12:31:46.120265+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:31:46.120265+0000","last_undegraded":"2024-04-26T12:31:46.120265+0000","last_fullsized":"2024-04-26T12:31:46.120265+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730394+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:31:47.730394+0000","last_peered":"2024-04-26T12:31:47.730394+0000","last_clean":"2024-04-26T12:31:47.730394+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:31:47.730394+0000","last_undegraded":"2024-04-26T12:31:47.730394+0000","last_fullsized":"2024-04-26T12:31:47.730394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120136+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:31:46.120136+0000","last_peered":"2024-04-26T12:31:46.120136+0000","last_clean":"2024-04-26T12:31:46.120136+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:31:46.120136+0000","last_undegraded":"2024-04-26T12:31:46.120136+0000","last_fullsized":"2024-04-26T12:31:46.120136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125845+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:31:46.125845+0000","last_peered":"2024-04-26T12:31:46.125845+0000","last_clean":"2024-04-26T12:31:46.125845+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:31:46.125845+0000","last_undegraded":"2024-04-26T12:31:46.125845+0000","last_fullsized":"2024-04-26T12:31:46.125845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125659+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:31:46.125659+0000","last_peered":"2024-04-26T12:31:46.125659+0000","last_clean":"2024-04-26T12:31:46.125659+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:31:46.125659+0000","last_undegraded":"2024-04-26T12:31:46.125659+0000","last_fullsized":"2024-04-26T12:31:46.125659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729582+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:31:47.729582+0000","last_peered":"2024-04-26T12:31:47.729582+0000","last_clean":"2024-04-26T12:31:47.729582+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:31:47.729582+0000","last_undegraded":"2024-04-26T12:31:47.729582+0000","last_fullsized":"2024-04-26T12:31:47.729582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119732+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:31:46.119732+0000","last_peered":"2024-04-26T12:31:46.119732+0000","last_clean":"2024-04-26T12:31:46.119732+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:31:46.119732+0000","last_undegraded":"2024-04-26T12:31:46.119732+0000","last_fullsized":"2024-04-26T12:31:46.119732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729646+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:31:47.729646+0000","last_peered":"2024-04-26T12:31:47.729646+0000","last_clean":"2024-04-26T12:31:47.729646+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:31:47.729646+0000","last_undegraded":"2024-04-26T12:31:47.729646+0000","last_fullsized":"2024-04-26T12:31:47.729646+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730319+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:31:47.730319+0000","last_peered":"2024-04-26T12:31:47.730319+0000","last_clean":"2024-04-26T12:31:47.730319+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:31:47.730319+0000","last_undegraded":"2024-04-26T12:31:47.730319+0000","last_fullsized":"2024-04-26T12:31:47.730319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120325+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:31:46.120325+0000","last_peered":"2024-04-26T12:31:46.120325+0000","last_clean":"2024-04-26T12:31:46.120325+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:31:46.120325+0000","last_undegraded":"2024-04-26T12:31:46.120325+0000","last_fullsized":"2024-04-26T12:31:46.120325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126060+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:31:46.126060+0000","last_peered":"2024-04-26T12:31:46.126060+0000","last_clean":"2024-04-26T12:31:46.126060+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:31:46.126060+0000","last_undegraded":"2024-04-26T12:31:46.126060+0000","last_fullsized":"2024-04-26T12:31:46.126060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729822+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:31:47.729822+0000","last_peered":"2024-04-26T12:31:47.729822+0000","last_clean":"2024-04-26T12:31:47.729822+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:47.729822+0000","last_undegraded":"2024-04-26T12:31:47.729822+0000","last_fullsized":"2024-04-26T12:31:47.729822+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730128+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:31:47.730128+0000","last_peered":"2024-04-26T12:31:47.730128+0000","last_clean":"2024-04-26T12:31:47.730128+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:31:47.730128+0000","last_undegraded":"2024-04-26T12:31:47.730128+0000","last_fullsized":"2024-04-26T12:31:47.730128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119739+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:31:46.119739+0000","last_peered":"2024-04-26T12:31:46.119739+0000","last_clean":"2024-04-26T12:31:46.119739+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:31:46.119739+0000","last_undegraded":"2024-04-26T12:31:46.119739+0000","last_fullsized":"2024-04-26T12:31:46.119739+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120513+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:31:46.120513+0000","last_peered":"2024-04-26T12:31:46.120513+0000","last_clean":"2024-04-26T12:31:46.120513+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:31:46.120513+0000","last_undegraded":"2024-04-26T12:31:46.120513+0000","last_fullsized":"2024-04-26T12:31:46.120513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119554+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:31:46.119554+0000","last_peered":"2024-04-26T12:31:46.119554+0000","last_clean":"2024-04-26T12:31:46.119554+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:31:46.119554+0000","last_undegraded":"2024-04-26T12:31:46.119554+0000","last_fullsized":"2024-04-26T12:31:46.119554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730467+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:31:47.730467+0000","last_peered":"2024-04-26T12:31:47.730467+0000","last_clean":"2024-04-26T12:31:47.730467+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:31:47.730467+0000","last_undegraded":"2024-04-26T12:31:47.730467+0000","last_fullsized":"2024-04-26T12:31:47.730467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120411+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:31:46.120411+0000","last_peered":"2024-04-26T12:31:46.120411+0000","last_clean":"2024-04-26T12:31:46.120411+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:31:46.120411+0000","last_undegraded":"2024-04-26T12:31:46.120411+0000","last_fullsized":"2024-04-26T12:31:46.120411+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119555+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:31:46.119555+0000","last_peered":"2024-04-26T12:31:46.119555+0000","last_clean":"2024-04-26T12:31:46.119555+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:31:46.119555+0000","last_undegraded":"2024-04-26T12:31:46.119555+0000","last_fullsized":"2024-04-26T12:31:46.119555+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120374+0000","last_change":"2024-04-26T12:31:07.233093+0000","last_active":"2024-04-26T12:31:46.120374+0000","last_peered":"2024-04-26T12:31:46.120374+0000","last_clean":"2024-04-26T12:31:46.120374+0000","last_became_active":"2024-04-26T12:31:07.232858+0000","last_became_peered":"2024-04-26T12:31:07.232858+0000","last_unstale":"2024-04-26T12:31:46.120374+0000","last_undegraded":"2024-04-26T12:31:46.120374+0000","last_fullsized":"2024-04-26T12:31:46.120374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.889139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119824+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:31:46.119824+0000","last_peered":"2024-04-26T12:31:46.119824+0000","last_clean":"2024-04-26T12:31:46.119824+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:31:46.119824+0000","last_undegraded":"2024-04-26T12:31:46.119824+0000","last_fullsized":"2024-04-26T12:31:46.119824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730321+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:31:47.730321+0000","last_peered":"2024-04-26T12:31:47.730321+0000","last_clean":"2024-04-26T12:31:47.730321+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:31:47.730321+0000","last_undegraded":"2024-04-26T12:31:47.730321+0000","last_fullsized":"2024-04-26T12:31:47.730321+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119818+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:31:46.119818+0000","last_peered":"2024-04-26T12:31:46.119818+0000","last_clean":"2024-04-26T12:31:46.119818+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:31:46.119818+0000","last_undegraded":"2024-04-26T12:31:46.119818+0000","last_fullsized":"2024-04-26T12:31:46.119818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125766+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:31:46.125766+0000","last_peered":"2024-04-26T12:31:46.125766+0000","last_clean":"2024-04-26T12:31:46.125766+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:31:46.125766+0000","last_undegraded":"2024-04-26T12:31:46.125766+0000","last_fullsized":"2024-04-26T12:31:46.125766+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125885+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:31:46.125885+0000","last_peered":"2024-04-26T12:31:46.125885+0000","last_clean":"2024-04-26T12:31:46.125885+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:31:46.125885+0000","last_undegraded":"2024-04-26T12:31:46.125885+0000","last_fullsized":"2024-04-26T12:31:46.125885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125858+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:31:46.125858+0000","last_peered":"2024-04-26T12:31:46.125858+0000","last_clean":"2024-04-26T12:31:46.125858+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:31:46.125858+0000","last_undegraded":"2024-04-26T12:31:46.125858+0000","last_fullsized":"2024-04-26T12:31:46.125858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729991+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:31:47.729991+0000","last_peered":"2024-04-26T12:31:47.729991+0000","last_clean":"2024-04-26T12:31:47.729991+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:31:47.729991+0000","last_undegraded":"2024-04-26T12:31:47.729991+0000","last_fullsized":"2024-04-26T12:31:47.729991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119907+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:31:46.119907+0000","last_peered":"2024-04-26T12:31:46.119907+0000","last_clean":"2024-04-26T12:31:46.119907+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:31:46.119907+0000","last_undegraded":"2024-04-26T12:31:46.119907+0000","last_fullsized":"2024-04-26T12:31:46.119907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730388+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:31:47.730388+0000","last_peered":"2024-04-26T12:31:47.730388+0000","last_clean":"2024-04-26T12:31:47.730388+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:31:47.730388+0000","last_undegraded":"2024-04-26T12:31:47.730388+0000","last_fullsized":"2024-04-26T12:31:47.730388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729630+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:31:47.729630+0000","last_peered":"2024-04-26T12:31:47.729630+0000","last_clean":"2024-04-26T12:31:47.729630+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:31:47.729630+0000","last_undegraded":"2024-04-26T12:31:47.729630+0000","last_fullsized":"2024-04-26T12:31:47.729630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120446+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:31:46.120446+0000","last_peered":"2024-04-26T12:31:46.120446+0000","last_clean":"2024-04-26T12:31:46.120446+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:31:46.120446+0000","last_undegraded":"2024-04-26T12:31:46.120446+0000","last_fullsized":"2024-04-26T12:31:46.120446+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125438+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:31:46.125438+0000","last_peered":"2024-04-26T12:31:46.125438+0000","last_clean":"2024-04-26T12:31:46.125438+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:31:46.125438+0000","last_undegraded":"2024-04-26T12:31:46.125438+0000","last_fullsized":"2024-04-26T12:31:46.125438+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120495+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:31:46.120495+0000","last_peered":"2024-04-26T12:31:46.120495+0000","last_clean":"2024-04-26T12:31:46.120495+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:31:46.120495+0000","last_undegraded":"2024-04-26T12:31:46.120495+0000","last_fullsized":"2024-04-26T12:31:46.120495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126014+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:31:46.126014+0000","last_peered":"2024-04-26T12:31:46.126014+0000","last_clean":"2024-04-26T12:31:46.126014+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:31:46.126014+0000","last_undegraded":"2024-04-26T12:31:46.126014+0000","last_fullsized":"2024-04-26T12:31:46.126014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729785+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:31:47.729785+0000","last_peered":"2024-04-26T12:31:47.729785+0000","last_clean":"2024-04-26T12:31:47.729785+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:31:47.729785+0000","last_undegraded":"2024-04-26T12:31:47.729785+0000","last_fullsized":"2024-04-26T12:31:47.729785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730282+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:31:47.730282+0000","last_peered":"2024-04-26T12:31:47.730282+0000","last_clean":"2024-04-26T12:31:47.730282+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:31:47.730282+0000","last_undegraded":"2024-04-26T12:31:47.730282+0000","last_fullsized":"2024-04-26T12:31:47.730282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729708+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:31:47.729708+0000","last_peered":"2024-04-26T12:31:47.729708+0000","last_clean":"2024-04-26T12:31:47.729708+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:31:47.729708+0000","last_undegraded":"2024-04-26T12:31:47.729708+0000","last_fullsized":"2024-04-26T12:31:47.729708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729326+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:31:47.729326+0000","last_peered":"2024-04-26T12:31:47.729326+0000","last_clean":"2024-04-26T12:31:47.729326+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:31:47.729326+0000","last_undegraded":"2024-04-26T12:31:47.729326+0000","last_fullsized":"2024-04-26T12:31:47.729326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125577+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:31:46.125577+0000","last_peered":"2024-04-26T12:31:46.125577+0000","last_clean":"2024-04-26T12:31:46.125577+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:31:46.125577+0000","last_undegraded":"2024-04-26T12:31:46.125577+0000","last_fullsized":"2024-04-26T12:31:46.125577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125598+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:31:46.125598+0000","last_peered":"2024-04-26T12:31:46.125598+0000","last_clean":"2024-04-26T12:31:46.125598+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:31:46.125598+0000","last_undegraded":"2024-04-26T12:31:46.125598+0000","last_fullsized":"2024-04-26T12:31:46.125598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120183+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:31:46.120183+0000","last_peered":"2024-04-26T12:31:46.120183+0000","last_clean":"2024-04-26T12:31:46.120183+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:31:46.120183+0000","last_undegraded":"2024-04-26T12:31:46.120183+0000","last_fullsized":"2024-04-26T12:31:46.120183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120014+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:31:46.120014+0000","last_peered":"2024-04-26T12:31:46.120014+0000","last_clean":"2024-04-26T12:31:46.120014+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:31:46.120014+0000","last_undegraded":"2024-04-26T12:31:46.120014+0000","last_fullsized":"2024-04-26T12:31:46.120014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125634+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:31:46.125634+0000","last_peered":"2024-04-26T12:31:46.125634+0000","last_clean":"2024-04-26T12:31:46.125634+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:31:46.125634+0000","last_undegraded":"2024-04-26T12:31:46.125634+0000","last_fullsized":"2024-04-26T12:31:46.125634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125466+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:31:46.125466+0000","last_peered":"2024-04-26T12:31:46.125466+0000","last_clean":"2024-04-26T12:31:46.125466+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:31:46.125466+0000","last_undegraded":"2024-04-26T12:31:46.125466+0000","last_fullsized":"2024-04-26T12:31:46.125466+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126239+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:31:46.126239+0000","last_peered":"2024-04-26T12:31:46.126239+0000","last_clean":"2024-04-26T12:31:46.126239+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:31:46.126239+0000","last_undegraded":"2024-04-26T12:31:46.126239+0000","last_fullsized":"2024-04-26T12:31:46.126239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729487+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:31:47.729487+0000","last_peered":"2024-04-26T12:31:47.729487+0000","last_clean":"2024-04-26T12:31:47.729487+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:31:47.729487+0000","last_undegraded":"2024-04-26T12:31:47.729487+0000","last_fullsized":"2024-04-26T12:31:47.729487+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126058+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:31:46.126058+0000","last_peered":"2024-04-26T12:31:46.126058+0000","last_clean":"2024-04-26T12:31:46.126058+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:31:46.126058+0000","last_undegraded":"2024-04-26T12:31:46.126058+0000","last_fullsized":"2024-04-26T12:31:46.126058+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729534+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:31:47.729534+0000","last_peered":"2024-04-26T12:31:47.729534+0000","last_clean":"2024-04-26T12:31:47.729534+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:31:47.729534+0000","last_undegraded":"2024-04-26T12:31:47.729534+0000","last_fullsized":"2024-04-26T12:31:47.729534+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120337+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:31:46.120337+0000","last_peered":"2024-04-26T12:31:46.120337+0000","last_clean":"2024-04-26T12:31:46.120337+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:31:46.120337+0000","last_undegraded":"2024-04-26T12:31:46.120337+0000","last_fullsized":"2024-04-26T12:31:46.120337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120224+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:31:46.120224+0000","last_peered":"2024-04-26T12:31:46.120224+0000","last_clean":"2024-04-26T12:31:46.120224+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:31:46.120224+0000","last_undegraded":"2024-04-26T12:31:46.120224+0000","last_fullsized":"2024-04-26T12:31:46.120224+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126153+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:31:46.126153+0000","last_peered":"2024-04-26T12:31:46.126153+0000","last_clean":"2024-04-26T12:31:46.126153+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:31:46.126153+0000","last_undegraded":"2024-04-26T12:31:46.126153+0000","last_fullsized":"2024-04-26T12:31:46.126153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729996+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:31:47.729996+0000","last_peered":"2024-04-26T12:31:47.729996+0000","last_clean":"2024-04-26T12:31:47.729996+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:31:47.729996+0000","last_undegraded":"2024-04-26T12:31:47.729996+0000","last_fullsized":"2024-04-26T12:31:47.729996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125680+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:31:46.125680+0000","last_peered":"2024-04-26T12:31:46.125680+0000","last_clean":"2024-04-26T12:31:46.125680+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:31:46.125680+0000","last_undegraded":"2024-04-26T12:31:46.125680+0000","last_fullsized":"2024-04-26T12:31:46.125680+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125757+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:31:46.125757+0000","last_peered":"2024-04-26T12:31:46.125757+0000","last_clean":"2024-04-26T12:31:46.125757+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:31:46.125757+0000","last_undegraded":"2024-04-26T12:31:46.125757+0000","last_fullsized":"2024-04-26T12:31:46.125757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120141+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:31:46.120141+0000","last_peered":"2024-04-26T12:31:46.120141+0000","last_clean":"2024-04-26T12:31:46.120141+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:31:46.120141+0000","last_undegraded":"2024-04-26T12:31:46.120141+0000","last_fullsized":"2024-04-26T12:31:46.120141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119661+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:31:46.119661+0000","last_peered":"2024-04-26T12:31:46.119661+0000","last_clean":"2024-04-26T12:31:46.119661+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:31:46.119661+0000","last_undegraded":"2024-04-26T12:31:46.119661+0000","last_fullsized":"2024-04-26T12:31:46.119661+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729463+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:31:47.729463+0000","last_peered":"2024-04-26T12:31:47.729463+0000","last_clean":"2024-04-26T12:31:47.729463+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:31:47.729463+0000","last_undegraded":"2024-04-26T12:31:47.729463+0000","last_fullsized":"2024-04-26T12:31:47.729463+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120495+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:31:46.120495+0000","last_peered":"2024-04-26T12:31:46.120495+0000","last_clean":"2024-04-26T12:31:46.120495+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:31:46.120495+0000","last_undegraded":"2024-04-26T12:31:46.120495+0000","last_fullsized":"2024-04-26T12:31:46.120495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125787+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:31:46.125787+0000","last_peered":"2024-04-26T12:31:46.125787+0000","last_clean":"2024-04-26T12:31:46.125787+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:31:46.125787+0000","last_undegraded":"2024-04-26T12:31:46.125787+0000","last_fullsized":"2024-04-26T12:31:46.125787+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":236,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125285+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:31:46.125285+0000","last_peered":"2024-04-26T12:31:46.125285+0000","last_clean":"2024-04-26T12:31:46.125285+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:31:46.125285+0000","last_undegraded":"2024-04-26T12:31:46.125285+0000","last_fullsized":"2024-04-26T12:31:46.125285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119796+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:31:46.119796+0000","last_peered":"2024-04-26T12:31:46.119796+0000","last_clean":"2024-04-26T12:31:46.119796+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:31:46.119796+0000","last_undegraded":"2024-04-26T12:31:46.119796+0000","last_fullsized":"2024-04-26T12:31:46.119796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729448+0000","last_change":"2024-04-26T12:31:07.233644+0000","last_active":"2024-04-26T12:31:47.729448+0000","last_peered":"2024-04-26T12:31:47.729448+0000","last_clean":"2024-04-26T12:31:47.729448+0000","last_became_active":"2024-04-26T12:31:07.233477+0000","last_became_peered":"2024-04-26T12:31:07.233477+0000","last_unstale":"2024-04-26T12:31:47.729448+0000","last_undegraded":"2024-04-26T12:31:47.729448+0000","last_fullsized":"2024-04-26T12:31:47.729448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:24.149502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125338+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:31:46.125338+0000","last_peered":"2024-04-26T12:31:46.125338+0000","last_clean":"2024-04-26T12:31:46.125338+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:31:46.125338+0000","last_undegraded":"2024-04-26T12:31:46.125338+0000","last_fullsized":"2024-04-26T12:31:46.125338+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119576+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:31:46.119576+0000","last_peered":"2024-04-26T12:31:46.119576+0000","last_clean":"2024-04-26T12:31:46.119576+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:31:46.119576+0000","last_undegraded":"2024-04-26T12:31:46.119576+0000","last_fullsized":"2024-04-26T12:31:46.119576+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730394+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:31:47.730394+0000","last_peered":"2024-04-26T12:31:47.730394+0000","last_clean":"2024-04-26T12:31:47.730394+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:31:47.730394+0000","last_undegraded":"2024-04-26T12:31:47.730394+0000","last_fullsized":"2024-04-26T12:31:47.730394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729531+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:31:47.729531+0000","last_peered":"2024-04-26T12:31:47.729531+0000","last_clean":"2024-04-26T12:31:47.729531+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:31:47.729531+0000","last_undegraded":"2024-04-26T12:31:47.729531+0000","last_fullsized":"2024-04-26T12:31:47.729531+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120120+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:31:46.120120+0000","last_peered":"2024-04-26T12:31:46.120120+0000","last_clean":"2024-04-26T12:31:46.120120+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:31:46.120120+0000","last_undegraded":"2024-04-26T12:31:46.120120+0000","last_fullsized":"2024-04-26T12:31:46.120120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729854+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:31:47.729854+0000","last_peered":"2024-04-26T12:31:47.729854+0000","last_clean":"2024-04-26T12:31:47.729854+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:31:47.729854+0000","last_undegraded":"2024-04-26T12:31:47.729854+0000","last_fullsized":"2024-04-26T12:31:47.729854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120330+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:31:46.120330+0000","last_peered":"2024-04-26T12:31:46.120330+0000","last_clean":"2024-04-26T12:31:46.120330+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:31:46.120330+0000","last_undegraded":"2024-04-26T12:31:46.120330+0000","last_fullsized":"2024-04-26T12:31:46.120330+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120394+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:31:46.120394+0000","last_peered":"2024-04-26T12:31:46.120394+0000","last_clean":"2024-04-26T12:31:46.120394+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:31:46.120394+0000","last_undegraded":"2024-04-26T12:31:46.120394+0000","last_fullsized":"2024-04-26T12:31:46.120394+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119635+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:31:46.119635+0000","last_peered":"2024-04-26T12:31:46.119635+0000","last_clean":"2024-04-26T12:31:46.119635+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:31:46.119635+0000","last_undegraded":"2024-04-26T12:31:46.119635+0000","last_fullsized":"2024-04-26T12:31:46.119635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126050+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:31:46.126050+0000","last_peered":"2024-04-26T12:31:46.126050+0000","last_clean":"2024-04-26T12:31:46.126050+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:31:46.126050+0000","last_undegraded":"2024-04-26T12:31:46.126050+0000","last_fullsized":"2024-04-26T12:31:46.126050+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120470+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:31:46.120470+0000","last_peered":"2024-04-26T12:31:46.120470+0000","last_clean":"2024-04-26T12:31:46.120470+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:31:46.120470+0000","last_undegraded":"2024-04-26T12:31:46.120470+0000","last_fullsized":"2024-04-26T12:31:46.120470+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729666+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:31:47.729666+0000","last_peered":"2024-04-26T12:31:47.729666+0000","last_clean":"2024-04-26T12:31:47.729666+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:31:47.729666+0000","last_undegraded":"2024-04-26T12:31:47.729666+0000","last_fullsized":"2024-04-26T12:31:47.729666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729899+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:31:47.729899+0000","last_peered":"2024-04-26T12:31:47.729899+0000","last_clean":"2024-04-26T12:31:47.729899+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:31:47.729899+0000","last_undegraded":"2024-04-26T12:31:47.729899+0000","last_fullsized":"2024-04-26T12:31:47.729899+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730119+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:31:47.730119+0000","last_peered":"2024-04-26T12:31:47.730119+0000","last_clean":"2024-04-26T12:31:47.730119+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:31:47.730119+0000","last_undegraded":"2024-04-26T12:31:47.730119+0000","last_fullsized":"2024-04-26T12:31:47.730119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125741+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:31:46.125741+0000","last_peered":"2024-04-26T12:31:46.125741+0000","last_clean":"2024-04-26T12:31:46.125741+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:31:46.125741+0000","last_undegraded":"2024-04-26T12:31:46.125741+0000","last_fullsized":"2024-04-26T12:31:46.125741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125696+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:31:46.125696+0000","last_peered":"2024-04-26T12:31:46.125696+0000","last_clean":"2024-04-26T12:31:46.125696+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:31:46.125696+0000","last_undegraded":"2024-04-26T12:31:46.125696+0000","last_fullsized":"2024-04-26T12:31:46.125696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730321+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:31:47.730321+0000","last_peered":"2024-04-26T12:31:47.730321+0000","last_clean":"2024-04-26T12:31:47.730321+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:31:47.730321+0000","last_undegraded":"2024-04-26T12:31:47.730321+0000","last_fullsized":"2024-04-26T12:31:47.730321+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125565+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:31:46.125565+0000","last_peered":"2024-04-26T12:31:46.125565+0000","last_clean":"2024-04-26T12:31:46.125565+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:31:46.125565+0000","last_undegraded":"2024-04-26T12:31:46.125565+0000","last_fullsized":"2024-04-26T12:31:46.125565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120543+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:31:46.120543+0000","last_peered":"2024-04-26T12:31:46.120543+0000","last_clean":"2024-04-26T12:31:46.120543+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:46.120543+0000","last_undegraded":"2024-04-26T12:31:46.120543+0000","last_fullsized":"2024-04-26T12:31:46.120543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729464+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:31:47.729464+0000","last_peered":"2024-04-26T12:31:47.729464+0000","last_clean":"2024-04-26T12:31:47.729464+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:31:47.729464+0000","last_undegraded":"2024-04-26T12:31:47.729464+0000","last_fullsized":"2024-04-26T12:31:47.729464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120415+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:31:46.120415+0000","last_peered":"2024-04-26T12:31:46.120415+0000","last_clean":"2024-04-26T12:31:46.120415+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:31:46.120415+0000","last_undegraded":"2024-04-26T12:31:46.120415+0000","last_fullsized":"2024-04-26T12:31:46.120415+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125492+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:31:46.125492+0000","last_peered":"2024-04-26T12:31:46.125492+0000","last_clean":"2024-04-26T12:31:46.125492+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:31:46.125492+0000","last_undegraded":"2024-04-26T12:31:46.125492+0000","last_fullsized":"2024-04-26T12:31:46.125492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125379+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:31:46.125379+0000","last_peered":"2024-04-26T12:31:46.125379+0000","last_clean":"2024-04-26T12:31:46.125379+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:31:46.125379+0000","last_undegraded":"2024-04-26T12:31:46.125379+0000","last_fullsized":"2024-04-26T12:31:46.125379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119620+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:31:46.119620+0000","last_peered":"2024-04-26T12:31:46.119620+0000","last_clean":"2024-04-26T12:31:46.119620+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:31:46.119620+0000","last_undegraded":"2024-04-26T12:31:46.119620+0000","last_fullsized":"2024-04-26T12:31:46.119620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729997+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:31:47.729997+0000","last_peered":"2024-04-26T12:31:47.729997+0000","last_clean":"2024-04-26T12:31:47.729997+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:31:47.729997+0000","last_undegraded":"2024-04-26T12:31:47.729997+0000","last_fullsized":"2024-04-26T12:31:47.729997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120120+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:31:46.120120+0000","last_peered":"2024-04-26T12:31:46.120120+0000","last_clean":"2024-04-26T12:31:46.120120+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:31:46.120120+0000","last_undegraded":"2024-04-26T12:31:46.120120+0000","last_fullsized":"2024-04-26T12:31:46.120120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730128+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:31:47.730128+0000","last_peered":"2024-04-26T12:31:47.730128+0000","last_clean":"2024-04-26T12:31:47.730128+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:31:47.730128+0000","last_undegraded":"2024-04-26T12:31:47.730128+0000","last_fullsized":"2024-04-26T12:31:47.730128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":749308,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.40300000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.46400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":155364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:31:30 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.372},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:31:30 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46400000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":752916,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.379}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:52.683 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:52.716 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:52.715+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:52.727 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:52.728 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:52.738 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:52.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:52.822 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:52.821+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:52.906 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:52.906 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:52.916 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:52.957 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:52.956+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:53.001 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:53.018 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:53.018+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:53.023 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:53.044 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:53.050 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:53.051 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:53.051 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.796601026999994, 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.088 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:53.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:53.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.094 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483344865999996, 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:53.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:53.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483303187000004, 2024-04-26T12:31:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:53.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483274408, 2024-04-26T12:31:53.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:53.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:53.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483244760000005, 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:53.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:53.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.117 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483205945999998, 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:53.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:53.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:53.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:53.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:53.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483177158000004, 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:53.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:53.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483150017, 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.129 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:53.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:53.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:53.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483108297000001, 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.135 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:53.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:53.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:53.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483065179999997, 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:53.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:53.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:53.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483046494000007, 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:53.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.483023625000001, 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.153 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:53.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:53.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.482992742999997, 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:53.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.482975272000004, 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:53.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:53.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.482952537000003, 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:53.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:53.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.482922994999996, 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.177 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.482897553000001, 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.183 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:53.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:53.189 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.189 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.189 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.482868386999996, 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:53.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.195 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.482854462000006, 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:53.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:53.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:53.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:53.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:53.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 80.482837126999996, 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:53.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:53.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:53.206 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:53.208 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:53.208 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:53.207+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:53.309 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:53.308+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:53.333 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:31:53.335 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:31:53.349 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:53.349 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:53.349 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:53.354 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-26T12:31:52.985994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82240,"kb_used_data":1180,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033280,"statfs":{"total":289910292480,"available":289826078720,"internally_reserved":0,"allocated":1208320,"data_stored":1657588,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000710"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730224+0000","last_change":"2024-04-26T12:30:32.614604+0000","last_active":"2024-04-26T12:31:47.730224+0000","last_peered":"2024-04-26T12:31:47.730224+0000","last_clean":"2024-04-26T12:31:47.730224+0000","last_became_active":"2024-04-26T12:30:32.613577+0000","last_became_peered":"2024-04-26T12:30:32.613577+0000","last_unstale":"2024-04-26T12:31:47.730224+0000","last_undegraded":"2024-04-26T12:31:47.730224+0000","last_fullsized":"2024-04-26T12:31:47.730224+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730171+0000","last_change":"2024-04-26T12:30:32.614464+0000","last_active":"2024-04-26T12:31:47.730171+0000","last_peered":"2024-04-26T12:31:47.730171+0000","last_clean":"2024-04-26T12:31:47.730171+0000","last_became_active":"2024-04-26T12:30:32.613476+0000","last_became_peered":"2024-04-26T12:30:32.613476+0000","last_unstale":"2024-04-26T12:31:47.730171+0000","last_undegraded":"2024-04-26T12:31:47.730171+0000","last_fullsized":"2024-04-26T12:31:47.730171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126164+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:31:46.126164+0000","last_peered":"2024-04-26T12:31:46.126164+0000","last_clean":"2024-04-26T12:31:46.126164+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:31:46.126164+0000","last_undegraded":"2024-04-26T12:31:46.126164+0000","last_fullsized":"2024-04-26T12:31:46.126164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125896+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:31:46.125896+0000","last_peered":"2024-04-26T12:31:46.125896+0000","last_clean":"2024-04-26T12:31:46.125896+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:31:46.125896+0000","last_undegraded":"2024-04-26T12:31:46.125896+0000","last_fullsized":"2024-04-26T12:31:46.125896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729806+0000","last_change":"2024-04-26T12:30:32.608393+0000","last_active":"2024-04-26T12:31:47.729806+0000","last_peered":"2024-04-26T12:31:47.729806+0000","last_clean":"2024-04-26T12:31:47.729806+0000","last_became_active":"2024-04-26T12:30:32.607846+0000","last_became_peered":"2024-04-26T12:30:32.607846+0000","last_unstale":"2024-04-26T12:31:47.729806+0000","last_undegraded":"2024-04-26T12:31:47.729806+0000","last_fullsized":"2024-04-26T12:31:47.729806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119684+0000","last_change":"2024-04-26T12:31:07.232711+0000","last_active":"2024-04-26T12:31:46.119684+0000","last_peered":"2024-04-26T12:31:46.119684+0000","last_clean":"2024-04-26T12:31:46.119684+0000","last_became_active":"2024-04-26T12:31:07.232528+0000","last_became_peered":"2024-04-26T12:31:07.232528+0000","last_unstale":"2024-04-26T12:31:46.119684+0000","last_undegraded":"2024-04-26T12:31:46.119684+0000","last_fullsized":"2024-04-26T12:31:46.119684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:16.731908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119494+0000","last_change":"2024-04-26T12:31:07.231727+0000","last_active":"2024-04-26T12:31:46.119494+0000","last_peered":"2024-04-26T12:31:46.119494+0000","last_clean":"2024-04-26T12:31:46.119494+0000","last_became_active":"2024-04-26T12:31:07.231554+0000","last_became_peered":"2024-04-26T12:31:07.231554+0000","last_unstale":"2024-04-26T12:31:46.119494+0000","last_undegraded":"2024-04-26T12:31:46.119494+0000","last_fullsized":"2024-04-26T12:31:46.119494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:12.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125234+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:31:46.125234+0000","last_peered":"2024-04-26T12:31:46.125234+0000","last_clean":"2024-04-26T12:31:46.125234+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:31:46.125234+0000","last_undegraded":"2024-04-26T12:31:46.125234+0000","last_fullsized":"2024-04-26T12:31:46.125234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120244+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:31:46.120244+0000","last_peered":"2024-04-26T12:31:46.120244+0000","last_clean":"2024-04-26T12:31:46.120244+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:31:46.120244+0000","last_undegraded":"2024-04-26T12:31:46.120244+0000","last_fullsized":"2024-04-26T12:31:46.120244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730210+0000","last_change":"2024-04-26T12:30:32.613967+0000","last_active":"2024-04-26T12:31:47.730210+0000","last_peered":"2024-04-26T12:31:47.730210+0000","last_clean":"2024-04-26T12:31:47.730210+0000","last_became_active":"2024-04-26T12:30:32.612664+0000","last_became_peered":"2024-04-26T12:30:32.612664+0000","last_unstale":"2024-04-26T12:31:47.730210+0000","last_undegraded":"2024-04-26T12:31:47.730210+0000","last_fullsized":"2024-04-26T12:31:47.730210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120042+0000","last_change":"2024-04-26T12:31:07.232741+0000","last_active":"2024-04-26T12:31:46.120042+0000","last_peered":"2024-04-26T12:31:46.120042+0000","last_clean":"2024-04-26T12:31:46.120042+0000","last_became_active":"2024-04-26T12:31:07.232521+0000","last_became_peered":"2024-04-26T12:31:07.232521+0000","last_unstale":"2024-04-26T12:31:46.120042+0000","last_undegraded":"2024-04-26T12:31:46.120042+0000","last_fullsized":"2024-04-26T12:31:46.120042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.363233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729904+0000","last_change":"2024-04-26T12:30:32.614730+0000","last_active":"2024-04-26T12:31:47.729904+0000","last_peered":"2024-04-26T12:31:47.729904+0000","last_clean":"2024-04-26T12:31:47.729904+0000","last_became_active":"2024-04-26T12:30:32.613558+0000","last_became_peered":"2024-04-26T12:30:32.613558+0000","last_unstale":"2024-04-26T12:31:47.729904+0000","last_undegraded":"2024-04-26T12:31:47.729904+0000","last_fullsized":"2024-04-26T12:31:47.729904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729766+0000","last_change":"2024-04-26T12:30:32.612787+0000","last_active":"2024-04-26T12:31:47.729766+0000","last_peered":"2024-04-26T12:31:47.729766+0000","last_clean":"2024-04-26T12:31:47.729766+0000","last_became_active":"2024-04-26T12:30:32.612275+0000","last_became_peered":"2024-04-26T12:30:32.612275+0000","last_unstale":"2024-04-26T12:31:47.729766+0000","last_undegraded":"2024-04-26T12:31:47.729766+0000","last_fullsized":"2024-04-26T12:31:47.729766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125747+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:31:46.125747+0000","last_peered":"2024-04-26T12:31:46.125747+0000","last_clean":"2024-04-26T12:31:46.125747+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:31:46.125747+0000","last_undegraded":"2024-04-26T12:31:46.125747+0000","last_fullsized":"2024-04-26T12:31:46.125747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125382+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:31:46.125382+0000","last_peered":"2024-04-26T12:31:46.125382+0000","last_clean":"2024-04-26T12:31:46.125382+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:31:46.125382+0000","last_undegraded":"2024-04-26T12:31:46.125382+0000","last_fullsized":"2024-04-26T12:31:46.125382+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119437+0000","last_change":"2024-04-26T12:31:07.233006+0000","last_active":"2024-04-26T12:31:46.119437+0000","last_peered":"2024-04-26T12:31:46.119437+0000","last_clean":"2024-04-26T12:31:46.119437+0000","last_became_active":"2024-04-26T12:31:07.232842+0000","last_became_peered":"2024-04-26T12:31:07.232842+0000","last_unstale":"2024-04-26T12:31:46.119437+0000","last_undegraded":"2024-04-26T12:31:46.119437+0000","last_fullsized":"2024-04-26T12:31:46.119437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.359074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120265+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:31:46.120265+0000","last_peered":"2024-04-26T12:31:46.120265+0000","last_clean":"2024-04-26T12:31:46.120265+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:31:46.120265+0000","last_undegraded":"2024-04-26T12:31:46.120265+0000","last_fullsized":"2024-04-26T12:31:46.120265+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730394+0000","last_change":"2024-04-26T12:30:32.612444+0000","last_active":"2024-04-26T12:31:47.730394+0000","last_peered":"2024-04-26T12:31:47.730394+0000","last_clean":"2024-04-26T12:31:47.730394+0000","last_became_active":"2024-04-26T12:30:32.611977+0000","last_became_peered":"2024-04-26T12:30:32.611977+0000","last_unstale":"2024-04-26T12:31:47.730394+0000","last_undegraded":"2024-04-26T12:31:47.730394+0000","last_fullsized":"2024-04-26T12:31:47.730394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120136+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:31:46.120136+0000","last_peered":"2024-04-26T12:31:46.120136+0000","last_clean":"2024-04-26T12:31:46.120136+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:31:46.120136+0000","last_undegraded":"2024-04-26T12:31:46.120136+0000","last_fullsized":"2024-04-26T12:31:46.120136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125845+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:31:46.125845+0000","last_peered":"2024-04-26T12:31:46.125845+0000","last_clean":"2024-04-26T12:31:46.125845+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:31:46.125845+0000","last_undegraded":"2024-04-26T12:31:46.125845+0000","last_fullsized":"2024-04-26T12:31:46.125845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125659+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:31:46.125659+0000","last_peered":"2024-04-26T12:31:46.125659+0000","last_clean":"2024-04-26T12:31:46.125659+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:31:46.125659+0000","last_undegraded":"2024-04-26T12:31:46.125659+0000","last_fullsized":"2024-04-26T12:31:46.125659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729582+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:31:47.729582+0000","last_peered":"2024-04-26T12:31:47.729582+0000","last_clean":"2024-04-26T12:31:47.729582+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:31:47.729582+0000","last_undegraded":"2024-04-26T12:31:47.729582+0000","last_fullsized":"2024-04-26T12:31:47.729582+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119732+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:31:46.119732+0000","last_peered":"2024-04-26T12:31:46.119732+0000","last_clean":"2024-04-26T12:31:46.119732+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:31:46.119732+0000","last_undegraded":"2024-04-26T12:31:46.119732+0000","last_fullsized":"2024-04-26T12:31:46.119732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729646+0000","last_change":"2024-04-26T12:30:32.608019+0000","last_active":"2024-04-26T12:31:47.729646+0000","last_peered":"2024-04-26T12:31:47.729646+0000","last_clean":"2024-04-26T12:31:47.729646+0000","last_became_active":"2024-04-26T12:30:32.607674+0000","last_became_peered":"2024-04-26T12:30:32.607674+0000","last_unstale":"2024-04-26T12:31:47.729646+0000","last_undegraded":"2024-04-26T12:31:47.729646+0000","last_fullsized":"2024-04-26T12:31:47.729646+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730319+0000","last_change":"2024-04-26T12:30:32.614940+0000","last_active":"2024-04-26T12:31:47.730319+0000","last_peered":"2024-04-26T12:31:47.730319+0000","last_clean":"2024-04-26T12:31:47.730319+0000","last_became_active":"2024-04-26T12:30:32.614091+0000","last_became_peered":"2024-04-26T12:30:32.614091+0000","last_unstale":"2024-04-26T12:31:47.730319+0000","last_undegraded":"2024-04-26T12:31:47.730319+0000","last_fullsized":"2024-04-26T12:31:47.730319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120325+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:31:46.120325+0000","last_peered":"2024-04-26T12:31:46.120325+0000","last_clean":"2024-04-26T12:31:46.120325+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:31:46.120325+0000","last_undegraded":"2024-04-26T12:31:46.120325+0000","last_fullsized":"2024-04-26T12:31:46.120325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126060+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:31:46.126060+0000","last_peered":"2024-04-26T12:31:46.126060+0000","last_clean":"2024-04-26T12:31:46.126060+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:31:46.126060+0000","last_undegraded":"2024-04-26T12:31:46.126060+0000","last_fullsized":"2024-04-26T12:31:46.126060+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729822+0000","last_change":"2024-04-26T12:30:32.153886+0000","last_active":"2024-04-26T12:31:47.729822+0000","last_peered":"2024-04-26T12:31:47.729822+0000","last_clean":"2024-04-26T12:31:47.729822+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:47.729822+0000","last_undegraded":"2024-04-26T12:31:47.729822+0000","last_fullsized":"2024-04-26T12:31:47.729822+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730128+0000","last_change":"2024-04-26T12:30:32.617001+0000","last_active":"2024-04-26T12:31:47.730128+0000","last_peered":"2024-04-26T12:31:47.730128+0000","last_clean":"2024-04-26T12:31:47.730128+0000","last_became_active":"2024-04-26T12:30:32.616191+0000","last_became_peered":"2024-04-26T12:30:32.616191+0000","last_unstale":"2024-04-26T12:31:47.730128+0000","last_undegraded":"2024-04-26T12:31:47.730128+0000","last_fullsized":"2024-04-26T12:31:47.730128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119739+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:31:46.119739+0000","last_peered":"2024-04-26T12:31:46.119739+0000","last_clean":"2024-04-26T12:31:46.119739+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:31:46.119739+0000","last_undegraded":"2024-04-26T12:31:46.119739+0000","last_fullsized":"2024-04-26T12:31:46.119739+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120513+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:31:46.120513+0000","last_peered":"2024-04-26T12:31:46.120513+0000","last_clean":"2024-04-26T12:31:46.120513+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:31:46.120513+0000","last_undegraded":"2024-04-26T12:31:46.120513+0000","last_fullsized":"2024-04-26T12:31:46.120513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119554+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:31:46.119554+0000","last_peered":"2024-04-26T12:31:46.119554+0000","last_clean":"2024-04-26T12:31:46.119554+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:31:46.119554+0000","last_undegraded":"2024-04-26T12:31:46.119554+0000","last_fullsized":"2024-04-26T12:31:46.119554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730467+0000","last_change":"2024-04-26T12:30:32.613072+0000","last_active":"2024-04-26T12:31:47.730467+0000","last_peered":"2024-04-26T12:31:47.730467+0000","last_clean":"2024-04-26T12:31:47.730467+0000","last_became_active":"2024-04-26T12:30:32.612374+0000","last_became_peered":"2024-04-26T12:30:32.612374+0000","last_unstale":"2024-04-26T12:31:47.730467+0000","last_undegraded":"2024-04-26T12:31:47.730467+0000","last_fullsized":"2024-04-26T12:31:47.730467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:02.424270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120411+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:31:46.120411+0000","last_peered":"2024-04-26T12:31:46.120411+0000","last_clean":"2024-04-26T12:31:46.120411+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:31:46.120411+0000","last_undegraded":"2024-04-26T12:31:46.120411+0000","last_fullsized":"2024-04-26T12:31:46.120411+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119555+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:31:46.119555+0000","last_peered":"2024-04-26T12:31:46.119555+0000","last_clean":"2024-04-26T12:31:46.119555+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:31:46.119555+0000","last_undegraded":"2024-04-26T12:31:46.119555+0000","last_fullsized":"2024-04-26T12:31:46.119555+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120374+0000","last_change":"2024-04-26T12:31:07.233093+0000","last_active":"2024-04-26T12:31:46.120374+0000","last_peered":"2024-04-26T12:31:46.120374+0000","last_clean":"2024-04-26T12:31:46.120374+0000","last_became_active":"2024-04-26T12:31:07.232858+0000","last_became_peered":"2024-04-26T12:31:07.232858+0000","last_unstale":"2024-04-26T12:31:46.120374+0000","last_undegraded":"2024-04-26T12:31:46.120374+0000","last_fullsized":"2024-04-26T12:31:46.120374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.889139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119824+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:31:46.119824+0000","last_peered":"2024-04-26T12:31:46.119824+0000","last_clean":"2024-04-26T12:31:46.119824+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:31:46.119824+0000","last_undegraded":"2024-04-26T12:31:46.119824+0000","last_fullsized":"2024-04-26T12:31:46.119824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730321+0000","last_change":"2024-04-26T12:30:32.156472+0000","last_active":"2024-04-26T12:31:47.730321+0000","last_peered":"2024-04-26T12:31:47.730321+0000","last_clean":"2024-04-26T12:31:47.730321+0000","last_became_active":"2024-04-26T12:30:32.156036+0000","last_became_peered":"2024-04-26T12:30:32.156036+0000","last_unstale":"2024-04-26T12:31:47.730321+0000","last_undegraded":"2024-04-26T12:31:47.730321+0000","last_fullsized":"2024-04-26T12:31:47.730321+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:15.705938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119818+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:31:46.119818+0000","last_peered":"2024-04-26T12:31:46.119818+0000","last_clean":"2024-04-26T12:31:46.119818+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:31:46.119818+0000","last_undegraded":"2024-04-26T12:31:46.119818+0000","last_fullsized":"2024-04-26T12:31:46.119818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125766+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:31:46.125766+0000","last_peered":"2024-04-26T12:31:46.125766+0000","last_clean":"2024-04-26T12:31:46.125766+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:31:46.125766+0000","last_undegraded":"2024-04-26T12:31:46.125766+0000","last_fullsized":"2024-04-26T12:31:46.125766+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125885+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:31:46.125885+0000","last_peered":"2024-04-26T12:31:46.125885+0000","last_clean":"2024-04-26T12:31:46.125885+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:31:46.125885+0000","last_undegraded":"2024-04-26T12:31:46.125885+0000","last_fullsized":"2024-04-26T12:31:46.125885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125858+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:31:46.125858+0000","last_peered":"2024-04-26T12:31:46.125858+0000","last_clean":"2024-04-26T12:31:46.125858+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:31:46.125858+0000","last_undegraded":"2024-04-26T12:31:46.125858+0000","last_fullsized":"2024-04-26T12:31:46.125858+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729991+0000","last_change":"2024-04-26T12:30:32.614774+0000","last_active":"2024-04-26T12:31:47.729991+0000","last_peered":"2024-04-26T12:31:47.729991+0000","last_clean":"2024-04-26T12:31:47.729991+0000","last_became_active":"2024-04-26T12:30:32.612934+0000","last_became_peered":"2024-04-26T12:30:32.612934+0000","last_unstale":"2024-04-26T12:31:47.729991+0000","last_undegraded":"2024-04-26T12:31:47.729991+0000","last_fullsized":"2024-04-26T12:31:47.729991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119907+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:31:46.119907+0000","last_peered":"2024-04-26T12:31:46.119907+0000","last_clean":"2024-04-26T12:31:46.119907+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:31:46.119907+0000","last_undegraded":"2024-04-26T12:31:46.119907+0000","last_fullsized":"2024-04-26T12:31:46.119907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730388+0000","last_change":"2024-04-26T12:30:32.615854+0000","last_active":"2024-04-26T12:31:47.730388+0000","last_peered":"2024-04-26T12:31:47.730388+0000","last_clean":"2024-04-26T12:31:47.730388+0000","last_became_active":"2024-04-26T12:30:32.613447+0000","last_became_peered":"2024-04-26T12:30:32.613447+0000","last_unstale":"2024-04-26T12:31:47.730388+0000","last_undegraded":"2024-04-26T12:31:47.730388+0000","last_fullsized":"2024-04-26T12:31:47.730388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729630+0000","last_change":"2024-04-26T12:30:32.155857+0000","last_active":"2024-04-26T12:31:47.729630+0000","last_peered":"2024-04-26T12:31:47.729630+0000","last_clean":"2024-04-26T12:31:47.729630+0000","last_became_active":"2024-04-26T12:30:32.154816+0000","last_became_peered":"2024-04-26T12:30:32.154816+0000","last_unstale":"2024-04-26T12:31:47.729630+0000","last_undegraded":"2024-04-26T12:31:47.729630+0000","last_fullsized":"2024-04-26T12:31:47.729630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:55.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120446+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:31:46.120446+0000","last_peered":"2024-04-26T12:31:46.120446+0000","last_clean":"2024-04-26T12:31:46.120446+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:31:46.120446+0000","last_undegraded":"2024-04-26T12:31:46.120446+0000","last_fullsized":"2024-04-26T12:31:46.120446+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125438+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:31:46.125438+0000","last_peered":"2024-04-26T12:31:46.125438+0000","last_clean":"2024-04-26T12:31:46.125438+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:31:46.125438+0000","last_undegraded":"2024-04-26T12:31:46.125438+0000","last_fullsized":"2024-04-26T12:31:46.125438+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120495+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:31:46.120495+0000","last_peered":"2024-04-26T12:31:46.120495+0000","last_clean":"2024-04-26T12:31:46.120495+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:31:46.120495+0000","last_undegraded":"2024-04-26T12:31:46.120495+0000","last_fullsized":"2024-04-26T12:31:46.120495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126014+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:31:46.126014+0000","last_peered":"2024-04-26T12:31:46.126014+0000","last_clean":"2024-04-26T12:31:46.126014+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:31:46.126014+0000","last_undegraded":"2024-04-26T12:31:46.126014+0000","last_fullsized":"2024-04-26T12:31:46.126014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729785+0000","last_change":"2024-04-26T12:30:32.611578+0000","last_active":"2024-04-26T12:31:47.729785+0000","last_peered":"2024-04-26T12:31:47.729785+0000","last_clean":"2024-04-26T12:31:47.729785+0000","last_became_active":"2024-04-26T12:30:32.611130+0000","last_became_peered":"2024-04-26T12:30:32.611130+0000","last_unstale":"2024-04-26T12:31:47.729785+0000","last_undegraded":"2024-04-26T12:31:47.729785+0000","last_fullsized":"2024-04-26T12:31:47.729785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730282+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:31:47.730282+0000","last_peered":"2024-04-26T12:31:47.730282+0000","last_clean":"2024-04-26T12:31:47.730282+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:31:47.730282+0000","last_undegraded":"2024-04-26T12:31:47.730282+0000","last_fullsized":"2024-04-26T12:31:47.730282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729708+0000","last_change":"2024-04-26T12:30:32.609069+0000","last_active":"2024-04-26T12:31:47.729708+0000","last_peered":"2024-04-26T12:31:47.729708+0000","last_clean":"2024-04-26T12:31:47.729708+0000","last_became_active":"2024-04-26T12:30:32.608844+0000","last_became_peered":"2024-04-26T12:30:32.608844+0000","last_unstale":"2024-04-26T12:31:47.729708+0000","last_undegraded":"2024-04-26T12:31:47.729708+0000","last_fullsized":"2024-04-26T12:31:47.729708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729326+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:31:47.729326+0000","last_peered":"2024-04-26T12:31:47.729326+0000","last_clean":"2024-04-26T12:31:47.729326+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:31:47.729326+0000","last_undegraded":"2024-04-26T12:31:47.729326+0000","last_fullsized":"2024-04-26T12:31:47.729326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125577+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:31:46.125577+0000","last_peered":"2024-04-26T12:31:46.125577+0000","last_clean":"2024-04-26T12:31:46.125577+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:31:46.125577+0000","last_undegraded":"2024-04-26T12:31:46.125577+0000","last_fullsized":"2024-04-26T12:31:46.125577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125598+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:31:46.125598+0000","last_peered":"2024-04-26T12:31:46.125598+0000","last_clean":"2024-04-26T12:31:46.125598+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:31:46.125598+0000","last_undegraded":"2024-04-26T12:31:46.125598+0000","last_fullsized":"2024-04-26T12:31:46.125598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120183+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:31:46.120183+0000","last_peered":"2024-04-26T12:31:46.120183+0000","last_clean":"2024-04-26T12:31:46.120183+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:31:46.120183+0000","last_undegraded":"2024-04-26T12:31:46.120183+0000","last_fullsized":"2024-04-26T12:31:46.120183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120014+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:31:46.120014+0000","last_peered":"2024-04-26T12:31:46.120014+0000","last_clean":"2024-04-26T12:31:46.120014+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:31:46.120014+0000","last_undegraded":"2024-04-26T12:31:46.120014+0000","last_fullsized":"2024-04-26T12:31:46.120014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125634+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:31:46.125634+0000","last_peered":"2024-04-26T12:31:46.125634+0000","last_clean":"2024-04-26T12:31:46.125634+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:31:46.125634+0000","last_undegraded":"2024-04-26T12:31:46.125634+0000","last_fullsized":"2024-04-26T12:31:46.125634+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125466+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:31:46.125466+0000","last_peered":"2024-04-26T12:31:46.125466+0000","last_clean":"2024-04-26T12:31:46.125466+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:31:46.125466+0000","last_undegraded":"2024-04-26T12:31:46.125466+0000","last_fullsized":"2024-04-26T12:31:46.125466+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126239+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:31:46.126239+0000","last_peered":"2024-04-26T12:31:46.126239+0000","last_clean":"2024-04-26T12:31:46.126239+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:31:46.126239+0000","last_undegraded":"2024-04-26T12:31:46.126239+0000","last_fullsized":"2024-04-26T12:31:46.126239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729487+0000","last_change":"2024-04-26T12:30:32.154805+0000","last_active":"2024-04-26T12:31:47.729487+0000","last_peered":"2024-04-26T12:31:47.729487+0000","last_clean":"2024-04-26T12:31:47.729487+0000","last_became_active":"2024-04-26T12:30:32.154079+0000","last_became_peered":"2024-04-26T12:30:32.154079+0000","last_unstale":"2024-04-26T12:31:47.729487+0000","last_undegraded":"2024-04-26T12:31:47.729487+0000","last_fullsized":"2024-04-26T12:31:47.729487+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:46.765517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126058+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:31:46.126058+0000","last_peered":"2024-04-26T12:31:46.126058+0000","last_clean":"2024-04-26T12:31:46.126058+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:31:46.126058+0000","last_undegraded":"2024-04-26T12:31:46.126058+0000","last_fullsized":"2024-04-26T12:31:46.126058+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729534+0000","last_change":"2024-04-26T12:30:32.153927+0000","last_active":"2024-04-26T12:31:47.729534+0000","last_peered":"2024-04-26T12:31:47.729534+0000","last_clean":"2024-04-26T12:31:47.729534+0000","last_became_active":"2024-04-26T12:30:32.153521+0000","last_became_peered":"2024-04-26T12:30:32.153521+0000","last_unstale":"2024-04-26T12:31:47.729534+0000","last_undegraded":"2024-04-26T12:31:47.729534+0000","last_fullsized":"2024-04-26T12:31:47.729534+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120337+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:31:46.120337+0000","last_peered":"2024-04-26T12:31:46.120337+0000","last_clean":"2024-04-26T12:31:46.120337+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:31:46.120337+0000","last_undegraded":"2024-04-26T12:31:46.120337+0000","last_fullsized":"2024-04-26T12:31:46.120337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120224+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:31:46.120224+0000","last_peered":"2024-04-26T12:31:46.120224+0000","last_clean":"2024-04-26T12:31:46.120224+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:31:46.120224+0000","last_undegraded":"2024-04-26T12:31:46.120224+0000","last_fullsized":"2024-04-26T12:31:46.120224+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126153+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:31:46.126153+0000","last_peered":"2024-04-26T12:31:46.126153+0000","last_clean":"2024-04-26T12:31:46.126153+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:31:46.126153+0000","last_undegraded":"2024-04-26T12:31:46.126153+0000","last_fullsized":"2024-04-26T12:31:46.126153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729996+0000","last_change":"2024-04-26T12:30:32.611320+0000","last_active":"2024-04-26T12:31:47.729996+0000","last_peered":"2024-04-26T12:31:47.729996+0000","last_clean":"2024-04-26T12:31:47.729996+0000","last_became_active":"2024-04-26T12:30:32.610950+0000","last_became_peered":"2024-04-26T12:30:32.610950+0000","last_unstale":"2024-04-26T12:31:47.729996+0000","last_undegraded":"2024-04-26T12:31:47.729996+0000","last_fullsized":"2024-04-26T12:31:47.729996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:25.003414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125680+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:31:46.125680+0000","last_peered":"2024-04-26T12:31:46.125680+0000","last_clean":"2024-04-26T12:31:46.125680+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:31:46.125680+0000","last_undegraded":"2024-04-26T12:31:46.125680+0000","last_fullsized":"2024-04-26T12:31:46.125680+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125757+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:31:46.125757+0000","last_peered":"2024-04-26T12:31:46.125757+0000","last_clean":"2024-04-26T12:31:46.125757+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:31:46.125757+0000","last_undegraded":"2024-04-26T12:31:46.125757+0000","last_fullsized":"2024-04-26T12:31:46.125757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120141+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:31:46.120141+0000","last_peered":"2024-04-26T12:31:46.120141+0000","last_clean":"2024-04-26T12:31:46.120141+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:31:46.120141+0000","last_undegraded":"2024-04-26T12:31:46.120141+0000","last_fullsized":"2024-04-26T12:31:46.120141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119661+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:31:46.119661+0000","last_peered":"2024-04-26T12:31:46.119661+0000","last_clean":"2024-04-26T12:31:46.119661+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:31:46.119661+0000","last_undegraded":"2024-04-26T12:31:46.119661+0000","last_fullsized":"2024-04-26T12:31:46.119661+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729463+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:31:47.729463+0000","last_peered":"2024-04-26T12:31:47.729463+0000","last_clean":"2024-04-26T12:31:47.729463+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:31:47.729463+0000","last_undegraded":"2024-04-26T12:31:47.729463+0000","last_fullsized":"2024-04-26T12:31:47.729463+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120495+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:31:46.120495+0000","last_peered":"2024-04-26T12:31:46.120495+0000","last_clean":"2024-04-26T12:31:46.120495+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:31:46.120495+0000","last_undegraded":"2024-04-26T12:31:46.120495+0000","last_fullsized":"2024-04-26T12:31:46.120495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125787+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:31:46.125787+0000","last_peered":"2024-04-26T12:31:46.125787+0000","last_clean":"2024-04-26T12:31:46.125787+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:31:46.125787+0000","last_undegraded":"2024-04-26T12:31:46.125787+0000","last_fullsized":"2024-04-26T12:31:46.125787+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":236,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125285+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:31:46.125285+0000","last_peered":"2024-04-26T12:31:46.125285+0000","last_clean":"2024-04-26T12:31:46.125285+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:31:46.125285+0000","last_undegraded":"2024-04-26T12:31:46.125285+0000","last_fullsized":"2024-04-26T12:31:46.125285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119796+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:31:46.119796+0000","last_peered":"2024-04-26T12:31:46.119796+0000","last_clean":"2024-04-26T12:31:46.119796+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:31:46.119796+0000","last_undegraded":"2024-04-26T12:31:46.119796+0000","last_fullsized":"2024-04-26T12:31:46.119796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729448+0000","last_change":"2024-04-26T12:31:07.233644+0000","last_active":"2024-04-26T12:31:47.729448+0000","last_peered":"2024-04-26T12:31:47.729448+0000","last_clean":"2024-04-26T12:31:47.729448+0000","last_became_active":"2024-04-26T12:31:07.233477+0000","last_became_peered":"2024-04-26T12:31:07.233477+0000","last_unstale":"2024-04-26T12:31:47.729448+0000","last_undegraded":"2024-04-26T12:31:47.729448+0000","last_fullsized":"2024-04-26T12:31:47.729448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:24.149502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125338+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:31:46.125338+0000","last_peered":"2024-04-26T12:31:46.125338+0000","last_clean":"2024-04-26T12:31:46.125338+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:31:46.125338+0000","last_undegraded":"2024-04-26T12:31:46.125338+0000","last_fullsized":"2024-04-26T12:31:46.125338+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119576+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:31:46.119576+0000","last_peered":"2024-04-26T12:31:46.119576+0000","last_clean":"2024-04-26T12:31:46.119576+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:31:46.119576+0000","last_undegraded":"2024-04-26T12:31:46.119576+0000","last_fullsized":"2024-04-26T12:31:46.119576+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730394+0000","last_change":"2024-04-26T12:30:32.613702+0000","last_active":"2024-04-26T12:31:47.730394+0000","last_peered":"2024-04-26T12:31:47.730394+0000","last_clean":"2024-04-26T12:31:47.730394+0000","last_became_active":"2024-04-26T12:30:32.612697+0000","last_became_peered":"2024-04-26T12:30:32.612697+0000","last_unstale":"2024-04-26T12:31:47.730394+0000","last_undegraded":"2024-04-26T12:31:47.730394+0000","last_fullsized":"2024-04-26T12:31:47.730394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:51.923479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729531+0000","last_change":"2024-04-26T12:30:26.796816+0000","last_active":"2024-04-26T12:31:47.729531+0000","last_peered":"2024-04-26T12:31:47.729531+0000","last_clean":"2024-04-26T12:31:47.729531+0000","last_became_active":"2024-04-26T12:30:26.796424+0000","last_became_peered":"2024-04-26T12:30:26.796424+0000","last_unstale":"2024-04-26T12:31:47.729531+0000","last_undegraded":"2024-04-26T12:31:47.729531+0000","last_fullsized":"2024-04-26T12:31:47.729531+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:23.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120120+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:31:46.120120+0000","last_peered":"2024-04-26T12:31:46.120120+0000","last_clean":"2024-04-26T12:31:46.120120+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:31:46.120120+0000","last_undegraded":"2024-04-26T12:31:46.120120+0000","last_fullsized":"2024-04-26T12:31:46.120120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729854+0000","last_change":"2024-04-26T12:30:32.615229+0000","last_active":"2024-04-26T12:31:47.729854+0000","last_peered":"2024-04-26T12:31:47.729854+0000","last_clean":"2024-04-26T12:31:47.729854+0000","last_became_active":"2024-04-26T12:30:32.615041+0000","last_became_peered":"2024-04-26T12:30:32.615041+0000","last_unstale":"2024-04-26T12:31:47.729854+0000","last_undegraded":"2024-04-26T12:31:47.729854+0000","last_fullsized":"2024-04-26T12:31:47.729854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:09.581214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120330+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:31:46.120330+0000","last_peered":"2024-04-26T12:31:46.120330+0000","last_clean":"2024-04-26T12:31:46.120330+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:31:46.120330+0000","last_undegraded":"2024-04-26T12:31:46.120330+0000","last_fullsized":"2024-04-26T12:31:46.120330+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120394+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:31:46.120394+0000","last_peered":"2024-04-26T12:31:46.120394+0000","last_clean":"2024-04-26T12:31:46.120394+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:31:46.120394+0000","last_undegraded":"2024-04-26T12:31:46.120394+0000","last_fullsized":"2024-04-26T12:31:46.120394+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119635+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:31:46.119635+0000","last_peered":"2024-04-26T12:31:46.119635+0000","last_clean":"2024-04-26T12:31:46.119635+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:31:46.119635+0000","last_undegraded":"2024-04-26T12:31:46.119635+0000","last_fullsized":"2024-04-26T12:31:46.119635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.126050+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:31:46.126050+0000","last_peered":"2024-04-26T12:31:46.126050+0000","last_clean":"2024-04-26T12:31:46.126050+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:31:46.126050+0000","last_undegraded":"2024-04-26T12:31:46.126050+0000","last_fullsized":"2024-04-26T12:31:46.126050+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120470+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:31:46.120470+0000","last_peered":"2024-04-26T12:31:46.120470+0000","last_clean":"2024-04-26T12:31:46.120470+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:31:46.120470+0000","last_undegraded":"2024-04-26T12:31:46.120470+0000","last_fullsized":"2024-04-26T12:31:46.120470+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729666+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:31:47.729666+0000","last_peered":"2024-04-26T12:31:47.729666+0000","last_clean":"2024-04-26T12:31:47.729666+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:31:47.729666+0000","last_undegraded":"2024-04-26T12:31:47.729666+0000","last_fullsized":"2024-04-26T12:31:47.729666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729899+0000","last_change":"2024-04-26T12:30:32.155856+0000","last_active":"2024-04-26T12:31:47.729899+0000","last_peered":"2024-04-26T12:31:47.729899+0000","last_clean":"2024-04-26T12:31:47.729899+0000","last_became_active":"2024-04-26T12:30:32.154678+0000","last_became_peered":"2024-04-26T12:30:32.154678+0000","last_unstale":"2024-04-26T12:31:47.729899+0000","last_undegraded":"2024-04-26T12:31:47.729899+0000","last_fullsized":"2024-04-26T12:31:47.729899+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730119+0000","last_change":"2024-04-26T12:30:32.612108+0000","last_active":"2024-04-26T12:31:47.730119+0000","last_peered":"2024-04-26T12:31:47.730119+0000","last_clean":"2024-04-26T12:31:47.730119+0000","last_became_active":"2024-04-26T12:30:32.611734+0000","last_became_peered":"2024-04-26T12:30:32.611734+0000","last_unstale":"2024-04-26T12:31:47.730119+0000","last_undegraded":"2024-04-26T12:31:47.730119+0000","last_fullsized":"2024-04-26T12:31:47.730119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125741+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:31:46.125741+0000","last_peered":"2024-04-26T12:31:46.125741+0000","last_clean":"2024-04-26T12:31:46.125741+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:31:46.125741+0000","last_undegraded":"2024-04-26T12:31:46.125741+0000","last_fullsized":"2024-04-26T12:31:46.125741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125696+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:31:46.125696+0000","last_peered":"2024-04-26T12:31:46.125696+0000","last_clean":"2024-04-26T12:31:46.125696+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:31:46.125696+0000","last_undegraded":"2024-04-26T12:31:46.125696+0000","last_fullsized":"2024-04-26T12:31:46.125696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730321+0000","last_change":"2024-04-26T12:30:32.157601+0000","last_active":"2024-04-26T12:31:47.730321+0000","last_peered":"2024-04-26T12:31:47.730321+0000","last_clean":"2024-04-26T12:31:47.730321+0000","last_became_active":"2024-04-26T12:30:32.156430+0000","last_became_peered":"2024-04-26T12:30:32.156430+0000","last_unstale":"2024-04-26T12:31:47.730321+0000","last_undegraded":"2024-04-26T12:31:47.730321+0000","last_fullsized":"2024-04-26T12:31:47.730321+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.045912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125565+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:31:46.125565+0000","last_peered":"2024-04-26T12:31:46.125565+0000","last_clean":"2024-04-26T12:31:46.125565+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:31:46.125565+0000","last_undegraded":"2024-04-26T12:31:46.125565+0000","last_fullsized":"2024-04-26T12:31:46.125565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120543+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:31:46.120543+0000","last_peered":"2024-04-26T12:31:46.120543+0000","last_clean":"2024-04-26T12:31:46.120543+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:31:46.120543+0000","last_undegraded":"2024-04-26T12:31:46.120543+0000","last_fullsized":"2024-04-26T12:31:46.120543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729464+0000","last_change":"2024-04-26T12:30:32.613101+0000","last_active":"2024-04-26T12:31:47.729464+0000","last_peered":"2024-04-26T12:31:47.729464+0000","last_clean":"2024-04-26T12:31:47.729464+0000","last_became_active":"2024-04-26T12:30:32.612614+0000","last_became_peered":"2024-04-26T12:30:32.612614+0000","last_unstale":"2024-04-26T12:31:47.729464+0000","last_undegraded":"2024-04-26T12:31:47.729464+0000","last_fullsized":"2024-04-26T12:31:47.729464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120415+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:31:46.120415+0000","last_peered":"2024-04-26T12:31:46.120415+0000","last_clean":"2024-04-26T12:31:46.120415+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:31:46.120415+0000","last_undegraded":"2024-04-26T12:31:46.120415+0000","last_fullsized":"2024-04-26T12:31:46.120415+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125492+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:31:46.125492+0000","last_peered":"2024-04-26T12:31:46.125492+0000","last_clean":"2024-04-26T12:31:46.125492+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:31:46.125492+0000","last_undegraded":"2024-04-26T12:31:46.125492+0000","last_fullsized":"2024-04-26T12:31:46.125492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.125379+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:31:46.125379+0000","last_peered":"2024-04-26T12:31:46.125379+0000","last_clean":"2024-04-26T12:31:46.125379+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:31:46.125379+0000","last_undegraded":"2024-04-26T12:31:46.125379+0000","last_fullsized":"2024-04-26T12:31:46.125379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.119620+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:31:46.119620+0000","last_peered":"2024-04-26T12:31:46.119620+0000","last_clean":"2024-04-26T12:31:46.119620+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:31:46.119620+0000","last_undegraded":"2024-04-26T12:31:46.119620+0000","last_fullsized":"2024-04-26T12:31:46.119620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.729997+0000","last_change":"2024-04-26T12:30:32.611603+0000","last_active":"2024-04-26T12:31:47.729997+0000","last_peered":"2024-04-26T12:31:47.729997+0000","last_clean":"2024-04-26T12:31:47.729997+0000","last_became_active":"2024-04-26T12:30:32.611224+0000","last_became_peered":"2024-04-26T12:30:32.611224+0000","last_unstale":"2024-04-26T12:31:47.729997+0000","last_undegraded":"2024-04-26T12:31:47.729997+0000","last_fullsized":"2024-04-26T12:31:47.729997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.120120+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:31:46.120120+0000","last_peered":"2024-04-26T12:31:46.120120+0000","last_clean":"2024-04-26T12:31:46.120120+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:31:46.120120+0000","last_undegraded":"2024-04-26T12:31:46.120120+0000","last_fullsized":"2024-04-26T12:31:46.120120+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.730128+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:31:47.730128+0000","last_peered":"2024-04-26T12:31:47.730128+0000","last_clean":"2024-04-26T12:31:47.730128+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:31:47.730128+0000","last_undegraded":"2024-04-26T12:31:47.730128+0000","last_fullsized":"2024-04-26T12:31:47.730128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738387,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":749308,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.40300000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.46400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":155364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:31:30 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.372},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:31:30 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.46400000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":752916,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.379}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:53.358 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:31:53.359 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:53.359 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T12:31:53.359 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:31:53.360 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:53.409 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:53.408+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:53.486 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:53.487 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:53.487 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:53.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:53.510 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:53.510+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:53.611 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:53.611+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:53.666 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:53.666 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.061748609000006, 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:53.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:53.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:53.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.061688371000002, 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.676 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.061655051000002, 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:53.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:53.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:53.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:53.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.06162526, 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.061611945999999, 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.687 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:53.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:53.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:53.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.061594971000005, 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:53.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:53.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.061527881000004, 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:53.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:53.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.701 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.061497501000005, 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.705 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.061474763000007, 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:53.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.057268675000003, 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.713 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.051898891999997, 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.717 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.051718180999998, 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.051691336999994, 2024-04-26T12:31:53.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:53.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:53.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.051651711999995, 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:53.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:53.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.051578113000005, 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:53.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:53.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.733 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.050118451000003, 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.049834195000003, 2024-04-26T12:31:53.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.740 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.045301520999999, 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:53.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:53.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:53.744 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.045172472000004, 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:53.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 76.755827143999994, 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:53.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:53.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:53.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:53.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:53.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.754 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:53.754 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:53.754 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:53.756 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:53.756 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:53.755+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:53.782 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:31:53.782 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-26T12:31:53.782 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 44, 2024-04-26T12:31:53.782 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "64cc8c72-72d6-4335-8e3d-3304aaa6cad9", 2024-04-26T12:31:53.782 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2024-04-26T12:30:16.108777+0000", 2024-04-26T12:31:53.782 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2024-04-26T12:31:52.181914+0000", 2024-04-26T12:31:53.782 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2024-04-26T12:30:24.744360+0000", 2024-04-26T12:31:53.782 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2024-04-26T12:30:17.865270+0000", 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5801984, 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "noscrub", 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2024-04-26T12:31:53.783 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 4, 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 3, 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:25.029168+0000", 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:31:53.784 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:31:53.785 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "11", 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:31:53.786 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:31:53.787 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:31:53.788 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2024-04-26T12:31:53.789 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 0.94602459669113159, 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 0.94999998807907104, 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 2, 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "rbd", 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:25.763407+0000", 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:31:53.790 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 8, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 8, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 8, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 8, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 8, 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:31:53.791 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "11", 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:31:53.792 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:31:53.793 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:31:53.794 INFO:teuthology.orchestra.run.smithi038.stdout: "options": {}, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd": {} 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 0.94602459669113159, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 0.94999998807907104, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.795 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 3, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:30.379996+0000", 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:31:53.796 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "14", 2024-04-26T12:31:53.797 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:31:53.798 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:31:53.799 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:31:53.800 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.2200000286102295, 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.2200000286102295, 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.2200000286102295, 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.2200000286102295, 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 0.94602459669113159, 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 0.94999998807907104, 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.801 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 4, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:31.544710+0000", 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:31:53.802 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.803 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "15", 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:31:53.804 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:31:53.805 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2024-04-26T12:31:53.806 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.1699999570846558, 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.1699999570846558, 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.1699999570846558, 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.1699999570846558, 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 0.94602459669113159, 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 0.94999998807907104, 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.807 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "25a1a54a-7d63-4c77-a385-f8147232ba3f", 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 8, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 23, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2024-04-26T12:31:53.808 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6800", 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6801", 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2024-04-26T12:31:53.809 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6802", 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6803", 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2024-04-26T12:31:53.810 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6806", 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6807", 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2024-04-26T12:31:53.811 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6804", 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6805", 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.98:6801/40381", 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.98:6803/40381", 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.98:6807/40381", 2024-04-26T12:31:53.812 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.98:6805/40381", 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc", 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2024-04-26T12:31:53.813 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 8, 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 23, 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6800", 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6801", 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:31:53.814 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6802", 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6803", 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.815 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6806", 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6807", 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.816 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6804", 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6805", 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.116:6801/40366", 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.116:6803/40366", 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.116:6807/40366", 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.116:6805/40366", 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "0ddc67e1-ee46-4691-bc16-6366296d9929", 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2024-04-26T12:31:53.818 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 0.83807373046875, 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 8, 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 13, 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6800", 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.819 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6801", 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6802", 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6803", 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6806", 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.821 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6807", 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6804", 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6805", 2024-04-26T12:31:53.822 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.133:6801/40554", 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.133:6803/40554", 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40554", 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40554", 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2024-04-26T12:31:53.823 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2024-04-26T12:30:22.897372+0000", 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2024-04-26T12:31:53.824 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2024-04-26T12:30:22.974464+0000", 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2024-04-26T12:30:22.873008+0000", 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.825 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2024-04-26T12:31:53.826 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:31:53.827 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-26T12:31:53.829 INFO:tasks.thrashosds.thrasher:j is {'epoch': 44, 'fsid': '64cc8c72-72d6-4335-8e3d-3304aaa6cad9', 'created': '2024-04-26T12:30:16.108777+0000', 'modified': '2024-04-26T12:31:52.181914+0000', 'last_up_change': '2024-04-26T12:30:24.744360+0000', 'last_in_change': '2024-04-26T12:30:17.865270+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:30:25.029168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9460245966911316, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:30:25.763407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9460245966911316, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:30:30.379996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 0.9460245966911316, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:30:31.544710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 0.9460245966911316, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}], 'osds': [{'osd': 0, 'uuid': '25a1a54a-7d63-4c77-a385-f8147232ba3f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 40381}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 40381}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 40381}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 40381}]}, 'public_addr': '172.21.15.98:6801/40381', 'cluster_addr': '172.21.15.98:6803/40381', 'heartbeat_back_addr': '172.21.15.98:6807/40381', 'heartbeat_front_addr': '172.21.15.98:6805/40381', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 40366}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 40366}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 40366}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 40366}]}, 'public_addr': '172.21.15.116:6801/40366', 'cluster_addr': '172.21.15.116:6803/40366', 'heartbeat_back_addr': '172.21.15.116:6807/40366', 'heartbeat_front_addr': '172.21.15.116:6805/40366', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ddc67e1-ee46-4691-bc16-6366296d9929', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.83807373046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6800', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6801', 'nonce': 40554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6802', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6803', 'nonce': 40554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6806', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6807', 'nonce': 40554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6804', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6805', 'nonce': 40554}]}, 'public_addr': '172.21.15.133:6801/40554', 'cluster_addr': '172.21.15.133:6803/40554', 'heartbeat_back_addr': '172.21.15.133:6807/40554', 'heartbeat_front_addr': '172.21.15.133:6805/40554', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:30:22.897372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:30:22.974464+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:30:22.873008+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:31:53.829 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T12:31:53.856 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:53.855+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:53.896 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:53.896 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:53.896 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:53.896 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:53.906 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:53.957 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:53.957+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:54.034 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:54.034 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:54.044 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:54.087 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:54.086+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:54.159 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:54.157+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:54.173 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:54.173 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 87.281985511000002, 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:54.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:54.178 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.178 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.178 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.178 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.568747650999995, 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:54.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:54.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:54.184 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.568689589000002, 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.190 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.568661035999995, 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:54.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.568641561000007, 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:54.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.568621516999997, 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.203 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:54.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:54.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:54.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:54.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:54.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:54.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:54.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:54.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:54.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:54.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:54.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.568598219999998, 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:54.216 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.568577778000005, 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:54.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:54.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:54.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:54.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:54.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:54.223 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.568557232000003, 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.568525238000007, 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:54.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.567118261999994, 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:54.232 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:54.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.234 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.234 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:54.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:54.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:54.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:54.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:54.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:54.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:54.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:54.238 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.238 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.238 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.239 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:54.239 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:54.239 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.566464584000002, 2024-04-26T12:31:54.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:54.239 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.240 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:54.240 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:54.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:54.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:54.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:54.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:54.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:54.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:54.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:54.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:54.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:54.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:54.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:54.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:54.246 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.247 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.247 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.247 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:54.247 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:54.248 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.566242528000004, 2024-04-26T12:31:54.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:54.248 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.248 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.248 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:54.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:54.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:54.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:54.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:54.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:54.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:54.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:54.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:54.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:54.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:54.256 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.257 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.257 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.257 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:54.257 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:54.258 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.561789310999998, 2024-04-26T12:31:54.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:54.258 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.258 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.261 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:54.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:54.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:54.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:54.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:54.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:54.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:54.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:54.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:54.270 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.556360995999995, 2024-04-26T12:31:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:54.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:54.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:54.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:54.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:54.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:54.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:54.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:54.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:54.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:54.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:54.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:54.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:54.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:54.279 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.280 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.280 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:54.280 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:54.281 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.556100626000003, 2024-04-26T12:31:54.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:54.281 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.281 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.281 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:54.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:54.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:54.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:54.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:54.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:54.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:54.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:54.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:54.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:54.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:54.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:54.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:54.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:54.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:54.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:54.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:54.289 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.290 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.290 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.290 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:54.290 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:54.291 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.556067229999996, 2024-04-26T12:31:54.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:54.291 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.291 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.291 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:54.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:54.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:54.296 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.555862228999999, 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:54.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:54.302 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.550236053000006, 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:54.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 81.549856642999998, 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:54.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:54.312 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.313 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.313 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.313 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:54.313 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:54.313 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:54.313 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:31:54.315 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:54.316 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:54.314+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:54.416 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:54.415+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:54.456 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:54.457 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:54.457 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:54.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:54.516 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:54.516+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:54.598 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:54.598 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:54.599 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:54.599 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:54.599 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:54.608 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:54.617 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:54.617+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:54.718 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:54.717+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:54.738 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:54.738 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:54.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:54.738 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 87.447048039999999, 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133791879, 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133750199999994, 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133721421000004, 2024-04-26T12:31:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133691772999995, 2024-04-26T12:31:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133652959000003, 2024-04-26T12:31:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133624170999994, 2024-04-26T12:31:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:54.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133597030000004, 2024-04-26T12:31:54.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:54.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:54.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:54.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133555310000006, 2024-04-26T12:31:54.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:54.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:54.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133512193000001, 2024-04-26T12:31:54.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.793 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:54.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:54.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.798 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133493506999997, 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.799 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.800 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:54.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133470638000006, 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.805 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.806 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:54.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:54.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:54.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133439756000001, 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:54.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:54.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133422284999995, 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.817 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:54.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:54.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:54.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133399549999993, 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.828 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133370008, 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:54.829 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:54.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.834 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133344566000005, 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.835 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:54.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133315400000001, 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:54.840 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:54.842 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:54.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:54.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:54.846 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133301474999996, 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.847 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:54.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:54.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:54.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:54.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 82.133284140000001, 2024-04-26T12:31:54.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.856 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.857 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.857 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:54.857 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:54.857 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:54.858 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:54.859 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:54.857+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:54.959 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:54.958+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:55.000 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:55.000 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:55.000 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:55.000 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:55.010 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:55.060 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:55.060+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:55.069 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:55.161 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:55.160+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:55.178 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:55.178 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:55.178 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:55.188 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:55.223 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:31:55.272 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:55.271+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:55.284 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:55.305 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:55.325 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:55.327 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:55.356 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:55.356 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:55.364 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:55.363+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:55.367 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:55.465 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:55.464+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:55.510 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:55.510 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:55.520 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:55.604 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:55.603+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:55.667 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:55.666+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:55.688 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:55.688 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:55.699 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:55.767 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:55.767+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:55.866 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:55.866 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:55.869 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:55.869+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:55.877 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:55.969 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:55.969+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:56.017 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:56.018 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:56.028 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:56.069 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:56.069+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:56.156 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:56.156 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:56.167 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:56.170 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:56.170+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:56.271 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:56.271+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:56.294 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:56.294 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:56.304 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:56.372 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:56.371+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:56.443 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:56.443 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:56.453 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:56.497 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:56.496+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:56.574 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:56.573+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:56.580 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:56.580 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:56.591 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:56.674 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:56.673+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:56.758 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:56.758 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:56.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:56.775 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:56.774+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:56.876 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:56.875+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:56.909 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:56.909 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:56.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:57.006 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:57.005+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:57.078 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:57.077+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:57.090 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:57.090 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:57.100 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:57.179 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:57.178+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:57.240 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:31:57.268 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:57.268 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:57.278 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:57.279 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:57.279+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:57.343 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:31:57.381 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:57.379+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:57.418 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:57.419 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:57.429 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:57.481 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:57.481+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:57.557 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:57.582 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:57.581+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:57.596 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:57.596 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:57.597 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:57.607 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:57.617 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:57.620 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:57.620 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:57.620 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:57.683 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:57.682+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:57.739 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:57.739 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:57.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:57.739 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:57.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.739 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:57.739 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:57.739 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 90.447140382000001, 2024-04-26T12:31:57.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:57.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:57.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:57.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:57.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133884221000002, 2024-04-26T12:31:57.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:57.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:57.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:57.754 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.754 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.754 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.754 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.755 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:57.755 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133842541999996, 2024-04-26T12:31:57.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:57.755 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.755 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.755 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:57.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:57.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:57.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:57.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:57.762 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133813763000006, 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:57.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:57.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:57.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.768 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133784114999997, 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:57.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:57.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:57.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133745301000005, 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:57.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:57.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:57.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133716512999996, 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.783 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:57.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:57.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:57.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:57.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133689372000006, 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133647651999993, 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133604535000003, 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133585848999999, 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133562979999994, 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.819 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.820 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133532098000003, 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:57.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:57.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:57.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:57.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133514626999997, 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.828 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.829 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:57.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:57.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:57.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.832 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:57.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:57.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:57.833 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:57.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:57.834 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.834 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.834 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:57.834 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:57.834 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.834 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.835 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133491891999995, 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.840 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.841 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133462350000002, 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.842 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:57.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:57.847 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133436907999993, 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.848 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:57.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:57.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133407742000003, 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:57.854 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:57.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133393816999998, 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:57.860 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 85.133376482000003, 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:57.866 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:57.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:57.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:57.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:57.870 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:57.872 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:57.873 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:57.871+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:57.973 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:57.972+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:58.013 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:58.013 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:58.013 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:58.023 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:58.073 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:58.072+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:58.151 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:58.151 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:58.151 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:31:58.151 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:31:58.151 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:58.161 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:58.202 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:58.201+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:58.255 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:31:58.274 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:58.273+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:58.331 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:31:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:31:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:31:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.331 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.726805235, 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:31:58.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:31:58.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:58.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.726744996999997, 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:31:58.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.342 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.726711676999997, 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:31:58.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:31:58.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.726681885999994, 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:31:58.348 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.353 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.726668571999994, 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:31:58.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.726651597, 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:31:58.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:31:58.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:31:58.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:58.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:31:58.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:31:58.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:31:58.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.726584506999998, 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:58.365 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:58.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:31:58.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.369 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.726554127, 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:58.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:31:58.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:31:58.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:58.373 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.726531389000002, 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:31:58.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:58.377 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:58.378 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.722325300999998, 2024-04-26T12:31:58.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:58.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:31:58.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.382 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.716955518000006, 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.716774806999993, 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.387 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:31:58.391 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.716747963000003, 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:31:58.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:31:58.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.716708338000004, 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.716634739, 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.401 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:31:58.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:31:58.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.715175076999998, 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.406 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:31:58.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.410 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.714890820999997, 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:31:58.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.710358146999994, 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.415 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:31:58.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:31:58.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 85.710229097999999, 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.420 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:31:58.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:31:58.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 81.420883770000003, 2024-04-26T12:31:58.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:31:58.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:31:58.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:31:58.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:31:58.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:31:58.432 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:31:58.432 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:58.433 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:58.432+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:58.434 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:31:58.534 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:58.533+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:58.577 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:58.577 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:58.577 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:31:58.577 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:58.587 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:31:58.635 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:58.634+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:58.735 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:58.734+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:58.756 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:31:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:31:58.756 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:31:58.756 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:58.767 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:31:58.830 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:31:58.830 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:31:58.830 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T12:31:58.830 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:31:58.830 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:31:58.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T12:31:58.836 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:31:58.835+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 92.044147300999995, 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.936 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:58.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:58.940 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.330909441000003, 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:31:58.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:58.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.946 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.330851378999995, 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:31:58.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:31:58.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:31:58.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:58.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.330822826000002, 2024-04-26T12:31:58.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:58.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.330803351, 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:31:58.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:31:58.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.330783307000004, 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:31:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:31:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:31:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:31:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:31:58.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:31:58.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:31:58.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:31:58.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:31:58.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:31:58.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.972 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.330760010000006, 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:58.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.978 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.330739567999998, 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:31:58.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:31:58.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:31:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:31:58.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.330719021999997, 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.984 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:31:58.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:31:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:31:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.330687028, 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.329280052000001, 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:31:58.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:31:58.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.328626373999995, 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:58.997 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:58.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:58.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.328404317999997, 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:31:59.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:31:59.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:31:59.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.323951101000006, 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:59.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:59.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.318522786000003, 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:31:59.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:31:59.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.318262415999996, 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:59.013 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:31:59.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:59.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.318229020000004, 2024-04-26T12:31:59.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:31:59.021 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.318024019000006, 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:31:59.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:31:59.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:31:59.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.312397842999999, 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:59.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:59.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:59.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.029 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 86.312018433000006, 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.033 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.034 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.034 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:31:59.034 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:31:59.034 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:31:59.036 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:59.036 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "" 2024-04-26T12:31:59.036 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:59.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:31:59.037 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:59.034+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:59.137 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:59.135+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:59.177 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:31:59.178 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:59.188 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:31:59.237 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:59.236+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:59.315 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:59.315 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:31:59.315 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:31:59.315 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:31:59.315 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:59.325 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:31:59.337 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:59.337+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:59.438 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:59.437+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:59.455 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 92.163754733000005, 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:31:59.456 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:31:59.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850498572000006, 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:31:59.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:31:59.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:31:59.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.467 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850456893, 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:31:59.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:31:59.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:31:59.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850428113999996, 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:31:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:31:59.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850398466000001, 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.485 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850359651999995, 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:31:59.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:31:59.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850330864, 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:31:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:31:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850303722999996, 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850262002999997, 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:31:59.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:31:59.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:31:59.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850218885999993, 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:31:59.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:31:59.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:31:59.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850200200000003, 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.515 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:31:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:31:59.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850177330999998, 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:31:59.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:31:59.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:31:59.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850146448999993, 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:31:59.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:31:59.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:31:59.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:31:59.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850128978000001, 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:31:59.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850106242999999, 2024-04-26T12:31:59.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:31:59.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850076701000006, 2024-04-26T12:31:59.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:31:59.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:31:59.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:31:59.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:31:59.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:31:59.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:31:59.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:31:59.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:31:59.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:31:59.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:31:59.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:31:59.552 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.552 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.552 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.553 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.553 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:59.553 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850051258999997, 2024-04-26T12:31:59.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:31:59.553 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.553 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.553 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:31:59.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850022093000007, 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:31:59.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:31:59.564 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.850008168000002, 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:59.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:31:59.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:31:59.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:31:59.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:31:59.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:31:59.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:31:59.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.572 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:31:59.572 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:59.572 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 86.849990833000007, 2024-04-26T12:31:59.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:31:59.572 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:31:59.572 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:31:59.572 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:31:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:31:59.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:31:59.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:31:59.576 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.577 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:31:59.577 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:31:59.577 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:31:59.578 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:59.577+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:59.581 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:31:59.638 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:31:59.679 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:31:59.678+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:31:59.715 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:31:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:31:59.715 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:31:59.715 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:31:59.726 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:31:59.780 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:59.780+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:59.813 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:31:59.834 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:31:59.854 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:31:59.854 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:31:59.854 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:31:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:31:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:31:59.856 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:31:59.864 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:31:59.905 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:59.904+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:31:59.983 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:31:59.982+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:00.032 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:00.032 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:00.042 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:00.087 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:00.086+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:00.183 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:00.183 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:00.184 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:00.184+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:00.194 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:00.272 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:32:00.286 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:00.285+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:00.361 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:00.361 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:00.371 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:00.387 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:00.386+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:00.489 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:00.488+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:00.498 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:00.498 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:00.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:00.590 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:00.589+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:00.652 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:00.652 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:00.663 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:00.691 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:00.690+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:00.792 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:00.791+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:00.832 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:00.832 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:00.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:00.927 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:00.926+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:00.994 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:00.992+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:01.010 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:01.010 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:01.020 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:01.095 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:01.094+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:01.160 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:01.160 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:01.171 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:01.196 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:01.195+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:01.298 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:01.297+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:01.298 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:01.298 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:01.308 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:01.315 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:32:01.398 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:01.398+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:01.434 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:01.434 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:01.444 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:01.499 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:01.498+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:01.584 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:01.584 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:01.595 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:01.640 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:01.639+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:01.701 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:01.700+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:01.723 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:01.723 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:01.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:01.803 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:01.802+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:01.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:01.902 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:01.902 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:01.903 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:01.903+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:01.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:02.005 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:02.003+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:02.049 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:02.049 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:02.060 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:02.066 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:02.103 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:02.105 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:02.104+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:02.140 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:02.142 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:02.142 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:02.142 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:02.187 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:02.188 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:02.188 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:02.188 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:02.188 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:02.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:02.205 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:02.204+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:02.306 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:02.306+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:02.327 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 95.036017186999999, 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:32:02.328 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:32:02.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:32:02.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:32:02.334 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.334 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.334 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.334 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.334 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:02.334 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722761026000001, 2024-04-26T12:32:02.334 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:32:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:32:02.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:32:02.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.339 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.340 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722719346999995, 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.342 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.343 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.344 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.345 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:32:02.346 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722690568000004, 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:02.347 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:32:02.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:32:02.351 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.352 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722660919999996, 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.353 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.354 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.355 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:32:02.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:32:02.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.358 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722622106000003, 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.359 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:32:02.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:32:02.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:32:02.364 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722593317999994, 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.365 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.366 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:32:02.370 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722566177000004, 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:32:02.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:32:02.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.373 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:32:02.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:32:02.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:32:02.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:32:02.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:32:02.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722524457000006, 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.377 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722481340000002, 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:32:02.383 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722462653999997, 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:02.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:32:02.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:32:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.395 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722439785000006, 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:32:02.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.401 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722408903000002, 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:32:02.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:02.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:32:02.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:32:02.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:32:02.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:32:02.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:02.408 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722391431999995, 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:02.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:02.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.414 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722368696999993, 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:02.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:32:02.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:32:02.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722339155, 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:32:02.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:32:02.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:32:02.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722313713000005, 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:32:02.427 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722284547000001, 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.433 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:02.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:32:02.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:32:02.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:32:02.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:32:02.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:32:02.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722270621999996, 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:02.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:32:02.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:32:02.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 89.722253287000001, 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:02.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:32:02.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:02.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:02.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:02.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:32:02.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:32:02.451 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.451 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.451 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.451 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:02.451 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:02.451 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:02.452 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:02.453 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:02.451+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:02.553 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:02.553+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:02.593 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:02.594 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:32:02.594 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:02.604 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:02.654 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:02.653+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:02.755 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:02.754+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:02.771 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:02.771 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:02.772 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:32:02.772 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:32:02.772 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:02.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:02.857 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:02.856+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:02.910 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:02.910 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.306321834000002, 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:32:02.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.916 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.306261595999999, 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:02.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:32:02.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:02.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.306228275999999, 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.922 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:32:02.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:02.927 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.306198484999996, 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:32:02.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:32:02.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.306185170999996, 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.937 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.306168196000002, 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:32:02.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:32:02.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:32:02.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:32:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:32:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:32:02.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.306101106, 2024-04-26T12:32:02.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:32:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.306070726000002, 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.951 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.306047988000003, 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:02.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:32:02.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:32:02.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:32:02.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.301841899999999, 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:32:02.959 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.296472116999993, 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:32:02.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.296291405999995, 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:32:02.963 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.296264562000005, 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.967 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:32:02.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.296224937000005, 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.296151338000001, 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.294691675999999, 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:02.979 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:32:02.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:32:02.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.294407419999999, 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.289874745999995, 2024-04-26T12:32:02.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:02.990 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.289745697000001, 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:32:02.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 86.000400369000005, 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:02.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:02.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:02.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:02.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:02.999 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:03.000 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:03.000 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:03.001 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:03.002 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:03.000+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:03.102 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:03.102+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:03.141 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:03.142 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:03.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:32:03.142 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:03.152 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:03.203 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:03.203+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:03.278 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:03.279 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:03.279 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:03.279 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:03.279 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:03.288 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:03.330 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:32:03.332 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:03.331+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:03.405 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:03.405+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 96.526134651000007, 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.418 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.812896791, 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:32:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:32:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:32:03.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:32:03.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.812838729000006, 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:32:03.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:32:03.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:32:03.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:32:03.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.812810175999999, 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.441 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.812790700999997, 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:32:03.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:32:03.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:32:03.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:32:03.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.812770657000002, 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.812747360000003, 2024-04-26T12:32:03.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.812726917999996, 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.459 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.464 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.812706371999994, 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:32:03.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:32:03.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:32:03.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.812674377999997, 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.469 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:32:03.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:32:03.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.811267401999999, 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.477 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.810613724000007, 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:32:03.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:32:03.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.810391667999994, 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.481 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:03.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:32:03.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:32:03.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.805938451000003, 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.485 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:32:03.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:32:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.800510136, 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:32:03.489 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:32:03.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.800249765999993, 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:32:03.493 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.800216370000001, 2024-04-26T12:32:03.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.800011369000003, 2024-04-26T12:32:03.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:32:03.505 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.794385192999997, 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:32:03.509 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 90.794005783000003, 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:03.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:32:03.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:32:03.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:03.513 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:03.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:03.515 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:03.514+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:03.616 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:03.615+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:03.656 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:03.656 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:03.656 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:32:03.656 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:03.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:03.752 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:03.751+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:03.818 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:03.818+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:03.836 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:03.836 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:03.836 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:03.836 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:03.836 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:03.846 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:03.930 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:03.929+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:04.016 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:04.016 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:04.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:04.016 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:04.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.016 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:32:04.016 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:04.016 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.724307701000001, 2024-04-26T12:32:04.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:32:04.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.022 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.411051540000003, 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:32:04.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:32:04.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.411009860999997, 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:04.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:32:04.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:32:04.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.034 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410981082000006, 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:32:04.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:04.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.040 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410951433999998, 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:32:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:32:04.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:32:04.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:32:04.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.047 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410912620000005, 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:32:04.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:04.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:32:04.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:32:04.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:32:04.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:32:04.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:32:04.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410883831999996, 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:32:04.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:32:04.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410856691000006, 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.063 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:32:04.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:32:04.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:32:04.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.070 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410814970999994, 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:04.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:04.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:32:04.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:32:04.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:04.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:32:04.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:32:04.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:32:04.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.078 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410771854000004, 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:32:04.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:32:04.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:32:04.085 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410753167999999, 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:32:04.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:04.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:32:04.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:32:04.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:32:04.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:32:04.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410730298999994, 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.094 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:32:04.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:32:04.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410699417000004, 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:32:04.100 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:32:04.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.106 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410681945999997, 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:04.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:04.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:32:04.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:32:04.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:04.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:32:04.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:32:04.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:32:04.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:04.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:32:04.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:32:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410659210999995, 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:32:04.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410629669000002, 2024-04-26T12:32:04.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:32:04.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:04.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.127 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410604226999993, 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410575061000003, 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:32:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:32:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410561135999998, 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:32:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 91.410543801000003, 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:32:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:32:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:32:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:04.152 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:04.153 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:32:04.153 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:32:04.153 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:32:04.153 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:32:04.153 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:32:04.154 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:32:04.156 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:04.152+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:04.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:04.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:04.254 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:04.253+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:04.293 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "" 2024-04-26T12:32:04.293 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:04.298 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:04.299 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:04.299 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:32:04.299 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:04.309 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:04.355 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:04.354+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:04.356 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:32:04.389 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:04.410 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:04.431 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:04.432 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:04.433 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:04.436 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:04.436 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:04.447 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:04.456 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:04.455+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:04.557 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:04.556+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:04.574 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:04.574 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:04.584 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:04.658 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:04.658+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:04.714 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:04.714 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:04.725 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:04.769 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:04.768+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:04.852 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:04.852 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:04.860 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:04.859+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:04.861 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:04.961 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:04.960+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:05.028 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:05.028 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:05.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:05.062 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:05.062+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:05.163 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:05.163+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:05.179 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:05.179 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:05.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:05.274 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:05.273+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:05.358 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:05.358 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:05.365 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:05.364+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:05.368 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:05.466 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:05.465+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:05.535 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:05.536 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:05.546 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:05.587 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:05.586+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:05.668 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:05.667+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:05.687 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:05.687 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:05.697 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:05.769 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:05.768+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:05.824 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:05.824 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:05.834 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:05.870 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:05.869+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:05.970 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:05.970+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:06.001 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:06.001 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:06.011 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:06.072 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:06.070+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:06.151 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:06.152 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:06.162 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:06.172 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:06.172+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:06.273 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:06.272+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:06.330 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:06.330 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:06.339 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:06.374 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:06.373+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:06.377 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:32:06.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:06.475 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:06.475+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:06.506 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:06.507 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:06.516 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:06.576 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:06.576+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:06.640 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:06.659 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:06.659 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:06.665 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:06.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:06.678 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:06.678+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:06.686 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:06.687 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:06.688 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:06.688 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:06.779 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:06.778+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:06.837 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:06.837 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:06.837 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:06.837 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:06.838 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:06.847 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:06.891 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:06.890+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 99.685456033999998, 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:32:06.977 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:32:06.982 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.372199873, 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:06.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:32:06.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:32:06.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:32:06.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.372158193999994, 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:06.989 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:32:06.994 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.372129415000003, 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:06.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:06.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:06.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:32:06.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.372099766999995, 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:32:07.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:32:07.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:32:07.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:32:07.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.372060953000002, 2024-04-26T12:32:07.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:32:07.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:32:07.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:32:07.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.372032164999993, 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:32:07.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.019 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.372005024000003, 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:07.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:32:07.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:32:07.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371963304000005, 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:32:07.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:32:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:32:07.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371920187000001, 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:32:07.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:32:07.035 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371901500999996, 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:32:07.038 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:07.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:32:07.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.044 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371878632000005, 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.050 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371847750000001, 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:07.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:32:07.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:07.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:32:07.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:32:07.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:32:07.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371830278999994, 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:32:07.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:32:07.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:32:07.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:32:07.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371807544000006, 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.068 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371778001999999, 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:32:07.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:32:07.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:32:07.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371752560000004, 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:32:07.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:32:07.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371723394, 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:32:07.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:32:07.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371709468999995, 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:07.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:32:07.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 94.371692134, 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:07.093 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:07.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.098 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:07.098 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:07.098 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:07.099 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:07.100 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:07.098+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:07.199 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:07.199+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:07.240 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:07.240 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:32:07.240 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:07.250 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:07.300 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:07.299+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:07.376 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:32:07.377 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:32:07.377 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:07.387 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:07.401 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:07.400+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:07.502 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:07.501+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:07.517 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:07.517 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:32:07.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:32:07.517 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:07.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.517 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.517 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.912496073, 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:32:07.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:07.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.912435834999997, 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.523 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:07.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:32:07.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:07.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.912402514999997, 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:32:07.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.912372723999994, 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.540 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.912359409999993, 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:32:07.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:32:07.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:32:07.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:32:07.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.912342434999999, 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:32:07.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.548 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.549 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.550 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.551 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.912275344999998, 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:07.552 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:32:07.553 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.554 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:32:07.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:32:07.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.555 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.555 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.555 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:32:07.555 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:32:07.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.557 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.557 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.557 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.557 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.557 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.912244964999999, 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:07.558 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.559 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.560 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:07.561 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.912222227000001, 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:07.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.564 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:32:07.565 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.908016138999997, 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.902646356000005, 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041686700000000002, 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:07.569 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612455+0000", 2024-04-26T12:32:07.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612458+0000", 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-06 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612466+0000", 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0520000000000002e-06 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612476+0000", 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0087e-05 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612765+0000", 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028834800000000001 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612773+0000", 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3480000000000004e-06 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.572 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612872+0000", 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8797999999999998e-05 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.902465645000007, 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000818004, 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:07.573 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612636+0000", 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612635+0000", 2024-04-26T12:32:07.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612641+0000", 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5860000000000004e-06 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612649+0000", 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5490000000000006e-06 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612657+0000", 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613117+0000", 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046014100000000001 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613124+0000", 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8190000000000003e-06 2024-04-26T12:32:07.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613454+0000", 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033002699999999999 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.902438801000002, 2024-04-26T12:32:07.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:32:07.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:32:07.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.902399176000003, 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087587899999999998, 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612702+0000", 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612705+0000", 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.88e-06 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612711+0000", 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7989999999999996e-06 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612718+0000", 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2319999999999998e-06 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613485+0000", 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076772099999999996 2024-04-26T12:32:07.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613578+0000", 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2635999999999999e-05 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.902325576999999, 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.586 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T12:32:07.589 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.900865914999997, 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028652700000000002, 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614235+0000", 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614238+0000", 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6790000000000001e-06 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614244+0000", 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5860000000000001e-06 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614249+0000", 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0579999999999997e-06 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614418+0000", 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016864899999999999 2024-04-26T12:32:07.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614425+0000", 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6896000000000002e-05 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.593 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 4 lcod 14'1)", 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.900581658999997, 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000296741, 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.594 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614520+0000", 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614519+0000", 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614522+0000", 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-06 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614528+0000", 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614546+0000", 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7921e-05 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614699+0000", 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152103 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614816+0000", 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000117963 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.896048984999993, 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.597 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:07.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:32:07.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 94.895919935999999, 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:32:07.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:07.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 90.606574608000003, 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:07.606 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:32:07.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:07.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:07.611 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:07.613 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:07.614 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:07.612+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:07.683 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:32:07.714 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:07.712+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:07.755 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:32:07.755 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:07.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:07.850 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:07.849+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:07.916 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:07.914+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:07.933 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:07.933 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:07.933 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:07.933 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:07.933 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:07.943 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:08.016 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:08.016+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:08.113 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4165.0:74 1.0 e10/9 1:30306672:devicehealth::main.db.0000000000000000:head v 10'48, mlcod=10'43)", 2024-04-26T12:32:08.113 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 101.22148905100001, 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060249320000000002, 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889957+0000", 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889962+0000", 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4480000000000002e-06 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889968+0000", 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.889972+0000", 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890030+0000", 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7986999999999999e-05 2024-04-26T12:32:08.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.890053+0000", 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2694e-05 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895954+0000", 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059006409999999999 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:26.895982+0000", 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8649e-05 2024-04-26T12:32:08.117 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.508251190999999, 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:32:08.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:32:08.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:32:08.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.508193129000006, 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:32:08.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:32:08.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:32:08.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.508164575999999, 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:32:08.130 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:08.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.136 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.508145100999997, 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:32:08.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.142 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.508125057000001, 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:32:08.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.148 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.508101760000002, 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:32:08.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:32:08.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:32:08.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.508081317999995, 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:08.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:32:08.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.160 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.508060771999993, 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:08.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:32:08.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.165 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.508028777999996, 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:32:08.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:32:08.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:32:08.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:32:08.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:08.171 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.506621801999998, 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:32:08.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:32:08.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.505968124000006, 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:32:08.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.505746067999993, 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:32:08.179 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:08.183 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.501292851000002, 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:08.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:32:08.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.495864535999999, 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063916520000000003, 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615582+0000", 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615576+0000", 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999943 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615602+0000", 2024-04-26T12:32:08.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5649000000000001e-05 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615609+0000", 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0659999999999998e-06 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615615+0000", 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4989999999999999e-06 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615645+0000", 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0119000000000001e-05 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615665+0000", 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9536000000000001e-05 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621936+0000", 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062706760000000002 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621973+0000", 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7886999999999998e-05 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.495604166000007, 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062376269999999999, 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615842+0000", 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615856+0000", 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3882e-05 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615863+0000", 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615869+0000", 2024-04-26T12:32:08.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7490000000000001e-06 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616197+0000", 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000327514 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616217+0000", 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0027e-05 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622027+0000", 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0058105300000000004 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622080+0000", 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2296000000000002e-05 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.49557077, 2024-04-26T12:32:08.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061067270000000002, 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615876+0000", 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615879+0000", 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615886+0000", 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2260000000000002e-06 2024-04-26T12:32:08.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615896+0000", 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0284e-05 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615977+0000", 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1044999999999994e-05 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616003+0000", 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5664e-05 2024-04-26T12:32:08.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621953+0000", 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005950716 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621982+0000", 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8934000000000001e-05 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:30 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.495365769000003, 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060538149999999997, 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616081+0000", 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616080+0000", 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616086+0000", 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3570000000000003e-06 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616102+0000", 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6152000000000001e-05 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616110+0000", 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9410000000000007e-06 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616783+0000", 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067251799999999999 2024-04-26T12:32:08.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616814+0000", 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1291999999999998e-05 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622104+0000", 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052893910000000001 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622134+0000", 2024-04-26T12:32:08.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=14'2)", 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.489739592999996, 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064063499999999999, 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621707+0000", 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621706+0000", 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.206 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621713+0000", 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0820000000000001e-06 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621726+0000", 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2748000000000001e-05 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621732+0000", 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1380000000000004e-06 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621768+0000", 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6124000000000002e-05 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.621782+0000", 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4282e-05 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628077+0000", 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062946850000000004 2024-04-26T12:32:08.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628113+0000", 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6157e-05 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=14'2)", 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 95.489360183000002, 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060448769999999997, 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:08.209 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622086+0000", 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:08.210 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622085+0000", 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622093+0000", 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4540000000000001e-06 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622103+0000", 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0345e-05 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622112+0000", 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4079999999999998e-06 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622144+0000", 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2265999999999999e-05 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.622162+0000", 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7944999999999998e-05 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628115+0000", 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059533149999999998 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.628131+0000", 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5951e-05 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:08.213 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:08.215 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:08.215 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:08.214+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:08.316 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:08.315+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:08.356 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:08.356 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:08.356 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:32:08.356 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:08.366 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:08.417 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:08.416+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:08.494 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:08.495 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:08.495 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:08.495 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:08.495 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:08.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:08.548 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:08.547+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:08.618 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:08.618+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:08.636 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:32:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 101.34459189099999, 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:32:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:32:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031335729999995, 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.648 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031294051000003, 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:32:08.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:32:08.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:32:08.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031265271999999, 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:08.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:32:08.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.660 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031235624000004, 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:32:08.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:32:08.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031196809999997, 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.667 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:32:08.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031168022000003, 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:32:08.673 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:32:08.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:08.679 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031140880999999, 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:32:08.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:32:08.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:32:08.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031099161, 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.685 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:08.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:32:08.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:32:08.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:32:08.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031056043999996, 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.696 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031037358000006, 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:08.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:32:08.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:32:08.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.031014489, 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:08.708 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.030983606999996, 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:08.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.030966136000004, 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.030943401000002, 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:08.725 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.030913858999995, 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:32:08.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:32:08.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:32:08.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:32:08.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.030888417, 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.731 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:08.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:32:08.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.030859250999995, 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.742 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.030845326000005, 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:32:08.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:32:08.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:32:08.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 96.030827990999995, 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:08.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:08.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:08.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:08.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:32:08.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:32:08.753 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.753 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.753 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.753 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:08.753 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:08.753 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:08.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:08.756 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:08.756 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 87% (10976/12492) Updating files: 88% (10993/12492) Updating files: 89% (11118/12492) Updating files: 90% (11243/12492) Updating files: 91% (11368/12492) Updating files: 92% (11493/12492) Updating files: 93% (11618/12492) Updating files: 94% (11743/12492) Updating files: 95% (11868/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-26T12:32:08.757 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:08.754+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:08.856 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:08.855+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:08.897 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:08.897 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:08.897 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:32:08.897 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:08.907 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:08.922 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:08.943 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:08.957 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:08.956+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:08.963 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:08.965 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:08.965 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:08.965 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:09.035 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:09.036 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:09.046 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:09.058 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:09.057+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:09.159 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:09.158+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:09.213 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:09.213 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:09.223 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:09.259 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:09.258+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:09.304 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:32:09.304 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:32:09.304 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:32:09.304 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:32:09.304 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:32:09.304 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:32:09.360 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:09.360+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:09.368 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:09.369 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:09.380 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:09.441 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:09.441 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "" 2024-04-26T12:32:09.441 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:09.461 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:09.460+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:09.510 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:09.510 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:09.522 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:09.562 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:09.562+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:09.650 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:09.650 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:09.658 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '7d2137f0a666c92a9411c1af5c33e4968be54da6'. 2024-04-26T12:32:09.659 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:09.659 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T12:32:09.659 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T12:32:09.659 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T12:32:09.659 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:09.659 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T12:32:09.659 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T12:32:09.659 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:09.659 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2024-04-26T12:32:09.660 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:09.660 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2024-04-26T12:32:09.660 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:09.660 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2024-04-26T12:32:09.660 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:09.660 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T12:32:09.660 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:09.660 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 7d2137f0a66 Merge pull request #57086 from zdover23/wip-doc-2024-04-25-backport-57057-to-reef 2024-04-26T12:32:09.661 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:09.663 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:09.662+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:09.666 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T12:32:09.697 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:32:09.698 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T12:32:09.701 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T12:32:09.701 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T12:32:09.764 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:09.763+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:09.801 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:09.802 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:09.812 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:09.865 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:09.865+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:09.938 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:09.938 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:09.949 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:09.966 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:09.965+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:10.067 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:10.067+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:10.077 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:10.077 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:10.087 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:10.168 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:10.167+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:10.179 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T12:32:10.229 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:10.229 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:10.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:10.254 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T12:32:10.285 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:10.283+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:10.296 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T12:32:10.298 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T12:32:10.298 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T12:32:10.339 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T12:32:10.342 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:32:10.342 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T12:32:10.371 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:10.370+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:10.412 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-04-26T12:32:10.413 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-04-26T12:32:10.414 DEBUG:teuthology.orchestra.run.smithi038:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d2137f0a666c92a9411c1af5c33e4968be54da6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-04-26T12:32:10.414 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:10.414 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:10.427 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:10.473 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:10.472+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:10.484 INFO:tasks.workunit.client.0.smithi038.stderr:+ set -e 2024-04-26T12:32:10.484 INFO:tasks.workunit.client.0.smithi038.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-04-26T12:32:10.536 INFO:tasks.workunit.client.0.smithi038.stderr:--2024-04-26 12:32:10-- http://download.ceph.com/qa/fsync-tester.c 2024-04-26T12:32:10.536 INFO:tasks.workunit.client.0.smithi038.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-26T12:32:10.553 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:10.553 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:10.557 INFO:tasks.workunit.client.0.smithi038.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-26T12:32:10.564 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:10.574 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:10.573+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:10.579 INFO:tasks.workunit.client.0.smithi038.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-26T12:32:10.579 INFO:tasks.workunit.client.0.smithi038.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-04-26T12:32:10.579 INFO:tasks.workunit.client.0.smithi038.stderr:Saving to: ‘fsync-tester.c’ 2024-04-26T12:32:10.587 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:10.587 INFO:tasks.workunit.client.0.smithi038.stderr: 0K .. 100% 358M=0s 2024-04-26T12:32:10.587 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:10.587 INFO:tasks.workunit.client.0.smithi038.stderr:2024-04-26 12:32:10 (358 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-04-26T12:32:10.588 INFO:tasks.workunit.client.0.smithi038.stderr: 2024-04-26T12:32:10.588 INFO:tasks.workunit.client.0.smithi038.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-04-26T12:32:10.664 INFO:tasks.workunit.client.0.smithi038.stderr:+ ./fsync-tester 2024-04-26T12:32:10.675 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:10.674+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:10.705 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:10.705 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:10.712 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:32:10.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:10.776 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:10.775+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:10.877 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:10.876+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:10.883 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:10.883 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:10.893 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:10.978 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:10.977+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:10.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:11.023 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:11.023 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:11.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:11.079 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:11.078+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:11.157 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:11.173 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:11.174 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:11.180 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:11.179+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:11.182 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:11.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:11.205 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:11.281 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:11.279+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:11.311 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:11.311 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:11.311 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:11.311 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:11.311 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:11.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:11.382 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:11.381+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:11.455 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:11.455 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:11.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:11.455 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:11.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4165.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 104.162750131, 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012768541, 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4165", 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "172.21.15.38:0/46190003", 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 165 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289282+0000", 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289281+0000", 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289287+0000", 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289293+0000", 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3569999999999997e-06 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.289298+0000", 2024-04-26T12:32:11.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3839999999999996e-06 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296512+0000", 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072141180000000003 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296566+0000", 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3573999999999999e-05 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.296642+0000", 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6384000000000006e-05 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.297922+0000", 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001279409 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.301998+0000", 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040765310000000004 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302030+0000", 2024-04-26T12:32:11.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1622999999999999e-05 2024-04-26T12:32:11.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:27.302050+0000", 2024-04-26T12:32:11.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0463e-05 2024-04-26T12:32:11.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.461 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849493969999997, 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:11.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:32:11.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:32:11.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:32:11.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:11.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849452291000006, 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:32:11.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:32:11.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:32:11.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:32:11.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:32:11.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:32:11.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:32:11.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:32:11.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:32:11.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:32:11.475 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849423512000001, 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:32:11.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:32:11.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849393864000007, 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:32:11.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:32:11.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:32:11.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:32:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:32:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:32:11.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:32:11.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:32:11.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.84935505, 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:32:11.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:11.496 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849326262000005, 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:32:11.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:32:11.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:32:11.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:32:11.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:32:11.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849299121000001, 2024-04-26T12:32:11.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:11.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:11.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:32:11.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:32:11.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:32:11.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:32:11.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.510 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849257401000003, 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:32:11.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:32:11.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849214283999999, 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015250929, 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.517 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602818+0000", 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602817+0000", 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602820+0000", 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9529999999999999e-06 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7389999999999999e-06 2024-04-26T12:32:11.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6009999999999999e-06 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602864+0000", 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5905999999999998e-05 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602871+0000", 2024-04-26T12:32:11.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610106+0000", 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072351799999999999 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610249+0000", 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014324699999999999 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610363+0000", 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000113986 2024-04-26T12:32:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617561+0000", 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071977999999999999 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617975+0000", 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00041364400000000001 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618022+0000", 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7135999999999997e-05 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618068+0000", 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6718999999999998e-05 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849195597999994, 2024-04-26T12:32:11.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:32:11.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:32:11.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849172729000003, 2024-04-26T12:32:11.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:11.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:11.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.535 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849141846999999, 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:32:11.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849124376000006, 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013008911, 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602907+0000", 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602915+0000", 2024-04-26T12:32:11.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1219999999999997e-06 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602922+0000", 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.253e-06 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1048999999999999e-05 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8009e-05 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610352+0000", 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073709170000000003 2024-04-26T12:32:11.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610468+0000", 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011586600000000001 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610722+0000", 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025454600000000003 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615343+0000", 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046202229999999997 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615805+0000", 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00046275999999999999 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615875+0000", 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0071e-05 2024-04-26T12:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615916+0000", 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0859000000000003e-05 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849101641000004, 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:32:11.548 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:32:11.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:32:11.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849072098999997, 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:11.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:32:11.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:32:11.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849046657000002, 2024-04-26T12:32:11.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:32:11.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.567 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849017490999998, 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014857799, 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603014+0000", 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603016+0000", 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.385e-06 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603020+0000", 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.754e-06 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603023+0000", 2024-04-26T12:32:11.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7537000000000003e-05 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603063+0000", 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611771+0000", 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0087073910000000001 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611922+0000", 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151595 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612095+0000", 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017240199999999999 2024-04-26T12:32:11.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616339+0000", 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042441909999999996 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617757+0000", 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001417738 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617804+0000", 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7590999999999999e-05 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617872+0000", 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7978000000000005e-05 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.574 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.849003565999993, 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:32:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:32:11.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 98.848986230999998, 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:11.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:11.585 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:11.586 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:11.587 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:11.588 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:11.586+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:11.688 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:11.687+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:11.727 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:11.727 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:11.727 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:32:11.727 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:11.737 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:11.790 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:11.789+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:11.864 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:32:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:32:11.865 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:11.875 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:11.919 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:11.918+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:11.991 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:11.990+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.400497564000005, 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003471446, 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.005 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602605+0000", 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602604+0000", 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602617+0000", 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3268000000000001e-05 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602629+0000", 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.234e-05 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602643+0000", 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4216000000000001e-05 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602704+0000", 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999994e-05 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602812+0000", 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010711 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602972+0000", 2024-04-26T12:32:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000160469 2024-04-26T12:32:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605502+0000", 2024-04-26T12:32:12.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025298109999999999 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605990+0000", 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048821299999999998 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606038+0000", 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7911000000000003e-05 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8782000000000002e-05 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.400437326000002, 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.011 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:12.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:32:12.016 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.400404006000002, 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:32:12.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.400374214999999, 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.027 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.400360900999999, 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:32:12.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:32:12.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:12.033 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.400343926000005, 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033180660000000002, 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:12.034 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602759+0000", 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602761+0000", 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4150000000000002e-06 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.035 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602765+0000", 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6100000000000002e-06 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602768+0000", 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602863+0000", 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5080000000000004e-05 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602989+0000", 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012667399999999999 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603122+0000", 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000132624 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605544+0000", 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024217729999999999 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605978+0000", 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00043400399999999999 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606034+0000", 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6709999999999997e-05 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.606077+0000", 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.400276836000003, 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:32:12.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.042 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.400246456000005, 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.046 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.400223718000007, 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:12.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.048 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.050 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 1 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.396017630000003, 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014549529999999999, 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:12.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607085+0000", 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607095+0000", 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607112+0000", 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7022999999999999e-05 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607123+0000", 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0998999999999999e-05 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607166+0000", 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3611e-05 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.053 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.608540+0000", 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013738439999999999 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:31 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.390440291999994, 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022830279999999999, 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612663+0000", 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612662+0000", 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612679+0000", 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6728999999999999e-05 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612687+0000", 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612693+0000", 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:32:12.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2474999999999998e-05 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612805+0000", 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8887999999999999e-05 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614846+0000", 2024-04-26T12:32:12.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020414130000000002 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614946+0000", 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9519999999999996e-05 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.390327068000005, 2024-04-26T12:32:12.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002354657, 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612776+0000", 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612786+0000", 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0421000000000001e-05 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612793+0000", 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1210000000000001e-06 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612799+0000", 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5759999999999996e-06 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613198+0000", 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00039942299999999999 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613228+0000", 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0224000000000001e-05 2024-04-26T12:32:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615094+0000", 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018654170000000001 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615130+0000", 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6782999999999997e-05 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.384050475999999, 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260592, 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619052+0000", 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619064+0000", 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1948e-05 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619072+0000", 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7389999999999999e-06 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619086+0000", 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4154999999999999e-05 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619114+0000", 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8184e-05 2024-04-26T12:32:12.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619128+0000", 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620273+0000", 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011450080000000001 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.620313+0000", 2024-04-26T12:32:12.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0265999999999997e-05 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 99.383921427000004, 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002045552, 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619181+0000", 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619186+0000", 2024-04-26T12:32:12.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619192+0000", 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7409999999999998e-06 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619199+0000", 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7619999999999998e-06 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:12.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116067 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.619328+0000", 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3352e-05 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621178+0000", 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018502799999999999 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.621227+0000", 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8615999999999997e-05 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 95.094576098999994, 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001501994, 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908527+0000", 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908525+0000", 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908533+0000", 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6669999999999996e-06 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908548+0000", 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.507e-05 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908558+0000", 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7010000000000008e-06 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908616+0000", 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8369000000000003e-05 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908723+0000", 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010726900000000001 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.908831+0000", 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010811000000000001 2024-04-26T12:32:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909428+0000", 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059687200000000003 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909956+0000", 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052785799999999997 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.909993+0000", 2024-04-26T12:32:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6854999999999999e-05 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:36.910029+0000", 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5753000000000001e-05 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:10 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.157638+0000", 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.84546453200000005, 2024-04-26T12:32:12.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011620188, 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 10 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.157638+0000", 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.157638+0000", 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.157637+0000", 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.161873+0000", 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042356670000000003 2024-04-26T12:32:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.161888+0000", 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.469e-05 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.161913+0000", 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5619e-05 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.161953+0000", 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9994999999999999e-05 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.162064+0000", 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110603 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.162162+0000", 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8166999999999997e-05 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.165478+0000", 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033158139999999998 2024-04-26T12:32:12.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.169188+0000", 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037099580000000002 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.169226+0000", 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8003000000000002e-05 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.169259+0000", 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2731999999999998e-05 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:11 4.37 4:eff9002a:::100000001f8.00000003:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.267034+0000", 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.736068626, 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012053753, 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.082 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 11 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.267034+0000", 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.267034+0000", 2024-04-26T12:32:12.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.267032+0000", 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271024+0000", 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039922810000000003 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271038+0000", 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4122e-05 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271064+0000", 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5568999999999999e-05 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271108+0000", 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3982e-05 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271213+0000", 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105486 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271310+0000", 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6546999999999996e-05 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.276749+0000", 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054389110000000003 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.279023+0000", 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022739050000000001 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.279059+0000", 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6498000000000002e-05 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.279088+0000", 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8878999999999999e-05 2024-04-26T12:32:12.087 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13 4.11 4:8be3ecac:::100000001f8.00000005:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.512505+0000", 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.49059763899999997, 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012436967, 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:12.088 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.512505+0000", 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.512505+0000", 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.512503+0000", 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517050+0000", 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045478560000000003 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517068+0000", 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7829000000000002e-05 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517076+0000", 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0320000000000003e-06 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517167+0000", 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1182999999999998e-05 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517333+0000", 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016567099999999999 2024-04-26T12:32:12.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517495+0000", 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016232400000000001 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.523470+0000", 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059745420000000002 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.524866+0000", 2024-04-26T12:32:12.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00139583 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.524909+0000", 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3554999999999999e-05 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.524942+0000", 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2802000000000002e-05 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:14 4.29 4:94178d8a:::100000001f8.00000006:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.636716+0000", 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.36638668400000002, 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011170441, 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 14 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.636716+0000", 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.636716+0000", 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.636690+0000", 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999743 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640499+0000", 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038082950000000002 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640526+0000", 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7254e-05 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640539+0000", 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2607e-05 2024-04-26T12:32:12.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640600+0000", 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1032000000000001e-05 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640774+0000", 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174303 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640929+0000", 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155308 2024-04-26T12:32:12.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.644600+0000", 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036711199999999999 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.647801+0000", 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032002329999999998 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.647848+0000", 2024-04-26T12:32:12.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7067999999999997e-05 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.647887+0000", 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8982e-05 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:15 4.2f 4:f59f865b:::100000001f8.00000007:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.762792+0000", 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.240311145, 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011049458999999999, 2024-04-26T12:32:12.099 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.762792+0000", 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.762792+0000", 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.762789+0000", 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766583+0000", 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037935849999999999 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766607+0000", 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3674999999999999e-05 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766620+0000", 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3175e-05 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766671+0000", 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.126e-05 2024-04-26T12:32:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766780+0000", 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109478 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766879+0000", 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.878e-05 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.770860+0000", 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039805209999999999 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.773782+0000", 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029219599999999999 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.773815+0000", 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3028999999999998e-05 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.773841+0000", 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6461e-05 2024-04-26T12:32:12.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.105 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:12.105 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:12.105 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:12.106 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:12.107 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:12.105+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:12.207 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:12.206+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:12.242 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:12.242 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:32:12.242 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:12.252 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:12.308 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:12.308+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:12.409 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:12.408+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:12.420 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:12.420 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:12.420 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:12.420 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:12.430 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:12.509 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:12.509+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:12.599 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.994052167999996, 2024-04-26T12:32:12.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:32:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:32:12.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:32:12.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.605 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.993994106000002, 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.606 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:32:12.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:32:12.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.993965552999995, 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.612 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.613 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:12.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.993946077999993, 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:12.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:32:12.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.624 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.993926033999998, 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:12.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.630 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.993902736999999, 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:32:12.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:12.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:12.636 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.993882295000006, 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:32:12.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:32:12.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:32:12.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:32:12.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.993861749000004, 2024-04-26T12:32:12.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:32:12.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:32:12.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:32:12.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.993829754999993, 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:32:12.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.992422778999995, 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082046250000000001, 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604825+0000", 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604824+0000", 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604830+0000", 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5130000000000004e-06 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604839+0000", 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7559999999999994e-06 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.604849+0000", 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4050000000000006e-06 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605824+0000", 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00097535899999999997 2024-04-26T12:32:12.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605842+0000", 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8264999999999999e-05 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612920+0000", 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070775480000000003 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613029+0000", 2024-04-26T12:32:12.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000109146 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 4 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.991769101000003, 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080735389999999994, 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605478+0000", 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605477+0000", 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605495+0000", 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7402999999999999e-05 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605524+0000", 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9485999999999999e-05 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605543+0000", 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8308000000000002e-05 2024-04-26T12:32:12.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606236+0000", 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069336799999999998 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613552+0000", 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073156890000000002 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.991547045000004, 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073950919999999998, 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605700+0000", 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605720+0000", 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9786999999999999e-05 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605730+0000", 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0831e-05 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605741+0000", 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.026e-05 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606345+0000", 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060401200000000002 2024-04-26T12:32:12.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606359+0000", 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4388e-05 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613044+0000", 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066851990000000002 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613095+0000", 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1140000000000002e-05 2024-04-26T12:32:12.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:2 3.f e14/12 3:f1f69726:::400.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 99.987093827999999, 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0066399270000000003, 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610153+0000", 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610160+0000", 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1289999999999998e-06 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610170+0000", 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0572e-05 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610177+0000", 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6719999999999998e-06 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610213+0000", 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5581999999999999e-05 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.610228+0000", 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616724+0000", 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064961749999999999 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616793+0000", 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9270999999999995e-05 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:11 4.37 e50/13 4:eff9002a:::100000001f8.00000003:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:11.271542+0000", 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.3257050079999999, 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072600049999999999, 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.271542+0000", 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.271542+0000", 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.271541+0000", 2024-04-26T12:32:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.275172+0000", 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036307890000000002 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.275184+0000", 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2225999999999999e-05 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.275191+0000", 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.275268+0000", 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6388000000000001e-05 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.275291+0000", 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3862999999999998e-05 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.278769+0000", 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034777050000000002 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.278802+0000", 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3204999999999998e-05 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:12 4.e e50/13 4:73e84e43:::100000001f8.00000004:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:11.402225+0000", 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.195022523, 2024-04-26T12:32:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0073403160000000004, 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.402225+0000", 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.402225+0000", 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.402223+0000", 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.406798+0000", 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045753870000000002 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.406811+0000", 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2279000000000001e-05 2024-04-26T12:32:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.406834+0000", 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3411e-05 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.406898+0000", 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4257000000000005e-05 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.406913+0000", 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4602e-05 2024-04-26T12:32:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.409536+0000", 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026225889999999998 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.409565+0000", 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9468e-05 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15 4.2f e50/13 4:f59f865b:::100000001f8.00000007:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:11.767122+0000", 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.83012505199999997, 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0065084419999999997, 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.767122+0000", 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.767122+0000", 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.767120+0000", 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.770773+0000", 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003652771 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.770786+0000", 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3004e-05 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.770793+0000", 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0720000000000002e-06 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.770868+0000", 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4443999999999994e-05 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.770888+0000", 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0180999999999999e-05 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.773598+0000", 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027098669999999999 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:11.773631+0000", 2024-04-26T12:32:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2929999999999998e-05 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:17 4.3d e50/13 4:bd3afb9d:::100000001f8.00000009:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.010326+0000", 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58692175499999999, 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0071152000000000003, 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.010326+0000", 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.010326+0000", 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.010325+0000", 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.014250+0000", 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039257800000000002 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.014264+0000", 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3484e-05 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.014289+0000", 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5624999999999999e-05 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.014338+0000", 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8646999999999997e-05 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.014357+0000", 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8712999999999999e-05 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.017405+0000", 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030486110000000001 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.017441+0000", 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5278999999999999e-05 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.46804722599999998, 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013138092000000001, 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 18 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129198+0000", 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133886+0000", 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046879779999999998 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133913+0000", 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-05 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133924+0000", 2024-04-26T12:32:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1629e-05 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133975+0000", 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1056e-05 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134116+0000", 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014008799999999999 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134222+0000", 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106283 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.140668+0000", 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064464539999999999 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142263+0000", 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001595162 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142302+0000", 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8331000000000003e-05 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142338+0000", 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6405999999999997e-05 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:19 4.12 e50/13 4:4be51a30:::100000001f8.0000000b:head v 50'3, mlcod=49'1)", 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.252436+0000", 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.34481115600000001, 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069147519999999997, 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.252436+0000", 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.252436+0000", 2024-04-26T12:32:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.252435+0000", 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.256184+0000", 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003749882 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.256204+0000", 2024-04-26T12:32:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9372999999999999e-05 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.256213+0000", 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5019999999999998e-06 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.256277+0000", 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4134000000000006e-05 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.256297+0000", 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.912e-05 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.259306+0000", 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030097539999999999 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.259351+0000", 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4589999999999998e-05 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:20 4.3d e50/13 4:bfffac44:::100000001f8.0000000c:head v 50'2, mlcod=0'0)", 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.367328+0000", 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.229918805, 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0078424110000000005, 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.367328+0000", 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.367328+0000", 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.367327+0000", 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.372253+0000", 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049257229999999999 2024-04-26T12:32:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.372272+0000", 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9599e-05 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.372300+0000", 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7334e-05 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.372347+0000", 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7389000000000003e-05 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.372367+0000", 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9519000000000001e-05 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.375123+0000", 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027568089999999998 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.375171+0000", 2024-04-26T12:32:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7530000000000001e-05 2024-04-26T12:32:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:12.703 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:12.704 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:12.704+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:12.705 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:12.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:32:12.805 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:12.805+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:12.848 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:12.848 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:12.848 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:32:12.848 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:12.858 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:12.907 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:12.906+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:13.007 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:13.007+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:13.026 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:13.027 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:13.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:13.109 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:13.108+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.604243088, 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.209 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:13.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:32:13.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:32:13.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:32:13.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:32:13.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.604201409, 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:13.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:32:13.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:32:13.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.220 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.60417262999999, 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:32:13.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:13.226 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.604142982, 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:32:13.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.60410416800001, 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.232 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.60407538, 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.238 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:32:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.60404823899999, 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:32:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.604006519, 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:32:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:32:13.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.603944716, 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:32:13.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:32:13.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:32:13.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:32:13.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.603921847, 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:13.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:32:13.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:32:13.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.60389096500001, 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.268 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:32:13.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.603850759, 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.274 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:32:13.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:32:13.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.603821217, 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.280 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:32:13.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:32:13.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:32:13.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.60379577499999, 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:32:13.286 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.287 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:32:13.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:32:13.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:32:13.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.603752684, 2024-04-26T12:32:13.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:32:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:32:13.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:13.301 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 100.603735349, 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.304 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:12 4.e 4:73e84e43:::100000001f8.00000004:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.8193008929999999, 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.02230445, 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.306 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 12 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387479+0000", 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401598+0000", 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01411946 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401621+0000", 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2921e-05 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401632+0000", 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0957e-05 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401696+0000", 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3910000000000003e-05 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401842+0000", 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014598500000000001 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401993+0000", 2024-04-26T12:32:13.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000150679 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.407007+0000", 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050141669999999999 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409718+0000", 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002711293 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.310 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409755+0000", 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6906999999999997e-05 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409784+0000", 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9533e-05 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:16 4.2c 4:36128e15:::100000001f8.00000008:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.3229257569999999, 2024-04-26T12:32:13.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019061136999999999, 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 16 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883854+0000", 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893062+0000", 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0092075000000000004 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893075+0000", 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3726e-05 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893100+0000", 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4997000000000001e-05 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893146+0000", 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5364000000000001e-05 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893250+0000", 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103892 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893345+0000", 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5696e-05 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.896800+0000", 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003454225 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902845+0000", 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0060457669999999996 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902881+0000", 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5830000000000001e-05 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902916+0000", 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5110000000000001e-05 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:23 4.24 e50/13 4:27adda6e:::100000001f8.0000000f:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.48436201400000001, 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016826893999999998, 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722417+0000", 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735064+0000", 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012646924 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735091+0000", 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7265999999999999e-05 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735103+0000", 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1812e-05 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735158+0000", 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4620000000000002e-05 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735179+0000", 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0879000000000001e-05 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.739192+0000", 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040138220000000002 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.739246+0000", 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3429e-05 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.320 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:26 4.32 4:4f726a0c:::100000001f8.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.12668949299999999, 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017624955000000001, 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 26 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.321 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080088+0000", 2024-04-26T12:32:13.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087471+0000", 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00738253 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087494+0000", 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3088999999999999e-05 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087507+0000", 2024-04-26T12:32:13.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3226e-05 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087574+0000", 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7070000000000007e-05 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087741+0000", 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016635900000000001 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087861+0000", 2024-04-26T12:32:13.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000120114 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.091238+0000", 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003377634 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097648+0000", 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0064094399999999998 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097686+0000", 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7682000000000003e-05 2024-04-26T12:32:13.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097716+0000", 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0901000000000001e-05 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:13.326 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:13.327 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:13.328 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:13.327+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:13.329 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:13.429 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:13.428+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:13.466 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:32:13.466 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:13.477 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:13.529 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:13.529+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:13.533 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:13.563 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:13.591 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:13.593 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:13.604 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:13.604 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:13.617 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:13.631 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:13.630+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:13.731 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:13.731+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:13.786 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:13.786 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:13.796 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:13.832 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:13.831+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:13.927 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:13.928 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:13.933 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:13.932+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:13.938 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:14.034 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:14.033+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:14.066 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:14.066 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:14.075 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:32:14.076 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:14.135 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:14.134+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:14.203 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:14.203 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:14.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:14.236 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:14.235+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:14.337 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:14.336+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:14.353 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:14.354 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:14.364 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:14.438 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:14.437+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:14.453 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:32:14.453 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:32:14.453 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T12:32:14.453 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.059954 2024-04-26T12:32:14.453 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.05995444212802037 2024-04-26T12:32:14.531 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:14.531 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:14.540 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:14.539+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:14.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:14.640 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:14.639+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:14.708 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:14.709 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:14.719 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:14.741 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:14.740+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:14.842 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:14.841+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:14.858 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:14.858 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:14.868 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:14.952 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:14.951+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:15.035 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:15.035 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:15.043 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:15.043+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:15.045 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:15.072 INFO:teuthology.orchestra.run.smithi038.stderr:set osd.1 primary-affinity to 0.0599544 (839292) 2024-04-26T12:32:15.145 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:15.144+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:15.213 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:15.213 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:15.223 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:15.267 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:15.266+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:15.346 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:15.345+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:15.352 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:15.352 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:15.362 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:15.447 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:15.446+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:15.531 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:15.531 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:15.541 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:15.582 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:15.581+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:15.606 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:15.648 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:15.647+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:15.708 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:15.709 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:15.718 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:15.750 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:15.750+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:15.799 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:15.824 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:15.846 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:15.847 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:15.847 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:15.847 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:32:15.847 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:15.848 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:15.848 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:15.848 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:15.851 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:15.851+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:15.858 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:15.955 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:15.954+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:16.025 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:16.025 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:16.025 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:16.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:16.080 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:16.079+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:16.090 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:32:16.158 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:16.157+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:16.173 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567496197, 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:32:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.56745451800001, 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:32:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567425739, 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:32:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:32:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:32:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.56739609100001, 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567357277, 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:32:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:32:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:32:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567328489, 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:32:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:32:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567301348, 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:32:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:32:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:32:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:16.250 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567259628, 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:32:16.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.56719782499999, 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:32:16.256 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567174956, 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.267 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567144074, 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:32:16.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.273 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567103868, 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:32:16.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:32:16.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:32:16.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:32:16.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567074326, 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:32:16.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:32:16.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.285 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.567048884, 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:16.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.287 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.287 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:16.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.289 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:32:16.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:32:16.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.56700579300001, 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.299 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 103.566988458, 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:32:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:32:16.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:16.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:12 4.e 4:73e84e43:::100000001f8.00000004:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.7825540020000004, 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.02230445, 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:16.304 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 12 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387479+0000", 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401598+0000", 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01411946 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401621+0000", 2024-04-26T12:32:16.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2921e-05 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401632+0000", 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0957e-05 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401696+0000", 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3910000000000003e-05 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401842+0000", 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014598500000000001 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401993+0000", 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000150679 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.407007+0000", 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050141669999999999 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409718+0000", 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002711293 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409755+0000", 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6906999999999997e-05 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409784+0000", 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9533e-05 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.309 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:16 4.2c 4:36128e15:::100000001f8.00000008:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.2861788660000002, 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019061136999999999, 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 16 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883854+0000", 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893062+0000", 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0092075000000000004 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893075+0000", 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3726e-05 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893100+0000", 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4997000000000001e-05 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893146+0000", 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5364000000000001e-05 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893250+0000", 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103892 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893345+0000", 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5696e-05 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.896800+0000", 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003454225 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902845+0000", 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0060457669999999996 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902881+0000", 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5830000000000001e-05 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902916+0000", 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5110000000000001e-05 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:23 4.24 e50/13 4:27adda6e:::100000001f8.0000000f:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 3.4476151229999998, 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016826893999999998, 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.315 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722417+0000", 2024-04-26T12:32:16.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735064+0000", 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012646924 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735091+0000", 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7265999999999999e-05 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735103+0000", 2024-04-26T12:32:16.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1812e-05 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735158+0000", 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4620000000000002e-05 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735179+0000", 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0879000000000001e-05 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.739192+0000", 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040138220000000002 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.739246+0000", 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3429e-05 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:26 4.32 4:4f726a0c:::100000001f8.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:16.319 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 3.0899426019999998, 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017624955000000001, 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 26 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080088+0000", 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087471+0000", 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00738253 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087494+0000", 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3088999999999999e-05 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087507+0000", 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3226e-05 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087574+0000", 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7070000000000007e-05 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087741+0000", 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016635900000000001 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087861+0000", 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000120114 2024-04-26T12:32:16.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.091238+0000", 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003377634 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097648+0000", 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0064094399999999998 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097686+0000", 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7682000000000003e-05 2024-04-26T12:32:16.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097716+0000", 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0901000000000001e-05 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:16.325 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:16.326 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:16.326+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:16.327 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:16.427 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:16.426+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:16.458 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:32:16.459 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:16.470 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:16.554 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:16.553+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:16.628 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:16.628+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:16.639 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:16.639 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:16.640 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:32:16.640 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:32:16.640 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:16.650 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:16.729 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:16.728+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 104.21528598099999, 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010198749, 2024-04-26T12:32:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602666+0000", 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602665+0000", 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602671+0000", 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602680+0000", 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602689+0000", 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1810000000000007e-06 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603388+0000", 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069847900000000001 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603461+0000", 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3165999999999997e-05 2024-04-26T12:32:16.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603567+0000", 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105956 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605594+0000", 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020274970000000001 2024-04-26T12:32:16.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612779+0000", 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071843769999999996 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612827+0000", 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8851999999999999e-05 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.612864+0000", 2024-04-26T12:32:16.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6848999999999999e-05 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 104.21525266099999, 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01165773, 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602699+0000", 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602698+0000", 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4939999999999992e-06 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602716+0000", 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602723+0000", 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:32:16.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603373+0000", 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064944199999999997 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603462+0000", 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8789999999999995e-05 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603585+0000", 2024-04-26T12:32:16.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012286099999999999 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.605628+0000", 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020434429999999998 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614273+0000", 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008644713 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614320+0000", 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614357+0000", 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6186000000000002e-05 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:16.831 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 104.21522287000001, 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011785811, 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602729+0000", 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602728+0000", 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.551e-06 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1659999999999996e-06 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602739+0000", 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.151e-06 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604062+0000", 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001323189 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604215+0000", 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152786 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604355+0000", 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014048199999999999 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607017+0000", 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026613370000000002 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614430+0000", 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074136080000000004 2024-04-26T12:32:16.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614477+0000", 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7066e-05 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614514+0000", 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7033999999999998e-05 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 104.215209556, 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701927999999999, 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602742+0000", 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602745+0000", 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7800000000000001e-06 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602748+0000", 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.337e-06 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602756+0000", 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8390000000000007e-06 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603904+0000", 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011480240000000001 2024-04-26T12:32:16.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604039+0000", 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135623 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604178+0000", 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013871200000000001 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.607512+0000", 2024-04-26T12:32:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033336770000000002 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613350+0000", 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058383890000000003 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613404+0000", 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3390999999999998e-05 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613444+0000", 2024-04-26T12:32:16.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0358000000000002e-05 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 104.21512549099999, 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 104.215095111, 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715003000000001, 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:16.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602856+0000", 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:16.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.529e-06 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602866+0000", 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6490000000000002e-06 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602872+0000", 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1890000000000004e-06 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604562+0000", 2024-04-26T12:32:16.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001689795 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604673+0000", 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110964 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.613571+0000", 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088983759999999995 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:16.849 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 104.215072373, 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011929481, 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:16.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602878+0000", 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602882+0000", 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1140000000000002e-06 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602891+0000", 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:32:16.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603829+0000", 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00092084100000000004 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:16.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011653 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.614809+0000", 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010862757000000001 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:10 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.157638+0000", 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.6603131869999999, 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011620188, 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.853 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 10 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.157638+0000", 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.157638+0000", 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.157637+0000", 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.161873+0000", 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042356670000000003 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.161888+0000", 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.469e-05 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.161913+0000", 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5619e-05 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.161953+0000", 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9994999999999999e-05 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.162064+0000", 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110603 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.162162+0000", 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8166999999999997e-05 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.165478+0000", 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033158139999999998 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.169188+0000", 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037099580000000002 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.169226+0000", 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8003000000000002e-05 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.169259+0000", 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2731999999999998e-05 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.858 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:11 4.37 4:eff9002a:::100000001f8.00000003:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.267034+0000", 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5509172810000003, 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012053753, 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 11 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.267034+0000", 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.267034+0000", 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.267032+0000", 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271024+0000", 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039922810000000003 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271038+0000", 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4122e-05 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271064+0000", 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5568999999999999e-05 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271108+0000", 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3982e-05 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271213+0000", 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105486 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.271310+0000", 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6546999999999996e-05 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.276749+0000", 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054389110000000003 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.279023+0000", 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022739050000000001 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.279059+0000", 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6498000000000002e-05 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.279088+0000", 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8878999999999999e-05 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13 4.11 4:8be3ecac:::100000001f8.00000005:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.512505+0000", 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3054462940000002, 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012436967, 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.864 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.512505+0000", 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.512505+0000", 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.512503+0000", 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517050+0000", 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045478560000000003 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517068+0000", 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7829000000000002e-05 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517076+0000", 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0320000000000003e-06 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517167+0000", 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1182999999999998e-05 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517333+0000", 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016567099999999999 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:16.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.517495+0000", 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016232400000000001 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.523470+0000", 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059745420000000002 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.524866+0000", 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00139583 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.524909+0000", 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3554999999999999e-05 2024-04-26T12:32:16.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.524942+0000", 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2802000000000002e-05 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:14 4.29 4:94178d8a:::100000001f8.00000006:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.636716+0000", 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1812353389999997, 2024-04-26T12:32:16.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011170441, 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 14 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.636716+0000", 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.636716+0000", 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.636690+0000", 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999743 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640499+0000", 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038082950000000002 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640526+0000", 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7254e-05 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640539+0000", 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2607e-05 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640600+0000", 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1032000000000001e-05 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640774+0000", 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174303 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.640929+0000", 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000155308 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.644600+0000", 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036711199999999999 2024-04-26T12:32:16.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.647801+0000", 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032002329999999998 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.647848+0000", 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7067999999999997e-05 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.647887+0000", 2024-04-26T12:32:16.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8982e-05 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:15 4.2f 4:f59f865b:::100000001f8.00000007:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.762792+0000", 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.0551598000000002, 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011049458999999999, 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.762792+0000", 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.762792+0000", 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.762789+0000", 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766583+0000", 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037935849999999999 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766607+0000", 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3674999999999999e-05 2024-04-26T12:32:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766620+0000", 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3175e-05 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766671+0000", 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.126e-05 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766780+0000", 2024-04-26T12:32:16.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109478 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.766879+0000", 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.878e-05 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.770860+0000", 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039805209999999999 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.773782+0000", 2024-04-26T12:32:16.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029219599999999999 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.773815+0000", 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3028999999999998e-05 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.773841+0000", 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6461e-05 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.880 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:16 4.2c e50/13 4:36128e15:::100000001f8.00000008:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:11.893498+0000", 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.9244531580000004, 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091450980000000008, 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.893498+0000", 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.893498+0000", 2024-04-26T12:32:16.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.893497+0000", 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.899620+0000", 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061231200000000001 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.899644+0000", 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4256e-05 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.899658+0000", 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.342e-05 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.899709+0000", 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1329000000000003e-05 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.899734+0000", 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5009999999999999e-05 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.902589+0000", 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028551430000000001 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:11.902643+0000", 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4409e-05 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:19 4.12 4:4be51a30:::100000001f8.0000000b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:12.247713+0000", 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.5702386710000003, 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012199748999999999, 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 19 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.247713+0000", 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.247713+0000", 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.247711+0000", 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:16.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.251982+0000", 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042706360000000004 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.251998+0000", 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5806000000000001e-05 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.252030+0000", 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2302999999999999e-05 2024-04-26T12:32:16.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.252075+0000", 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4734000000000002e-05 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.252191+0000", 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116507 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.252294+0000", 2024-04-26T12:32:16.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010312200000000001 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.257037+0000", 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004742947 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.259671+0000", 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026338860000000002 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.259817+0000", 2024-04-26T12:32:16.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000146148 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.259913+0000", 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5260999999999995e-05 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:12.600685+0000", 2024-04-26T12:32:16.890 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2172664800000002, 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011607755000000001, 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 22 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.600685+0000", 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.600685+0000", 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.600682+0000", 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.604482+0000", 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037991750000000001 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.604496+0000", 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4290999999999999e-05 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.604520+0000", 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3655999999999998e-05 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.604559+0000", 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9490000000000003e-05 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.604659+0000", 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9513999999999996e-05 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.604756+0000", 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7806999999999994e-05 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.607912+0000", 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031560849999999999 2024-04-26T12:32:16.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.612196+0000", 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042839820000000004 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.612249+0000", 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2639999999999997e-05 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:12.612293+0000", 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3785000000000002e-05 2024-04-26T12:32:16.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:28 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:13.300550+0000", 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.5174010660000001, 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014307429, 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.896 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.300550+0000", 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.300550+0000", 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.300548+0000", 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.305944+0000", 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053957120000000004 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.305964+0000", 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0397000000000001e-05 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.305976+0000", 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1362999999999999e-05 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.306080+0000", 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104017 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.306216+0000", 2024-04-26T12:32:16.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013630900000000001 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.306339+0000", 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012262500000000001 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.312030+0000", 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056913770000000001 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.314786+0000", 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027561199999999999 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.314826+0000", 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0138000000000001e-05 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.314858+0000", 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1655000000000001e-05 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.901 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:13.429149+0000", 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3888022659999999, 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011721817000000001, 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.902 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 29 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.429149+0000", 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.429149+0000", 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.429147+0000", 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.433340+0000", 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041931060000000003 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.433365+0000", 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4678e-05 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.433376+0000", 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1027e-05 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.433433+0000", 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7553000000000003e-05 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.433588+0000", 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015508399999999999 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.433747+0000", 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015846400000000001 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.437867+0000", 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004120177 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.440778+0000", 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029114089999999998 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.440828+0000", 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0059999999999998e-05 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.440871+0000", 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2719999999999998e-05 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:49 4.1c 4:39b842ef:::100000001f8.00000029:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:32:16.907 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 1.0196178739999999, 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.31553130400000001, 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798333+0000", 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802052+0000", 2024-04-26T12:32:16.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037186889999999998 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802065+0000", 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.393e-05 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802090+0000", 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5028000000000002e-05 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802171+0000", 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0267999999999998e-05 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802183+0000", 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2612999999999999e-05 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103759+0000", 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.30157593799999999 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103871+0000", 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112215 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104010+0000", 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013841799999999999 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.109832+0000", 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058224430000000001 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113792+0000", 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039597809999999999 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113833+0000", 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1162000000000003e-05 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113865+0000", 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1664e-05 2024-04-26T12:32:16.913 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:50 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.90654585899999995, 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.211685075, 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.914 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911403+0000", 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915165+0000", 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037618870000000002 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915180+0000", 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5130000000000001e-05 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915206+0000", 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6248e-05 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915253+0000", 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6387000000000002e-05 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915262+0000", 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9239999999999996e-06 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103986+0000", 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.188724843 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104199+0000", 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021283900000000001 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104324+0000", 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012447599999999999 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.115992+0000", 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011668286 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123002+0000", 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070100400000000004 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123053+0000", 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1427000000000001e-05 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123091+0000", 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271000000000003e-05 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:52 4.11 4:8b544b63:::100000001f8.0000002c:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:16.156856+0000", 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.66109539900000003, 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011042596, 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:16.920 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 52 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.156856+0000", 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.156856+0000", 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.156854+0000", 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.160747+0000", 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038938179999999998 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.160760+0000", 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2337000000000001e-05 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.160767+0000", 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4059999999999999e-06 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.160809+0000", 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1936e-05 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.160958+0000", 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014882099999999999 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.161120+0000", 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016223499999999999 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.164540+0000", 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034196819999999998 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.167840+0000", 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032997109999999999 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.167872+0000", 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2017999999999997e-05 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.167899+0000", 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7095000000000001e-05 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:16.925 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:16.927 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:16.927 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:16.926+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:17.027 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:17.027+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:17.065 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:32:17.065 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:17.075 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:17.128 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:17.127+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:17.134 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:32:17.202 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:17.202 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:17.214 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:17.229 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:17.229+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:17.330 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:17.329+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 104.738676793, 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:32:17.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:32:17.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:32:17.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 104.738618731, 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:32:17.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 104.738590178, 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.356 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:32:17.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 104.73857070299999, 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:32:17.362 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:32:17.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:17.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:17.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:17.368 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 104.738550659, 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:32:17.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:32:17.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:32:17.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 104.738527362, 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.374 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:32:17.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 104.73850692000001, 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.380 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:32:17.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:32:17.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:32:17.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.386 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 104.738486374, 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:17.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:32:17.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:32:17.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:32:17.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 104.73845437999999, 2024-04-26T12:32:17.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0089529250000000005, 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603418+0000", 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603417+0000", 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603420+0000", 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603427+0000", 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3869999999999997e-06 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603433+0000", 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2639999999999999e-06 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603616+0000", 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018380600000000001 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603622+0000", 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7379999999999999e-06 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605121+0000", 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014992569999999999 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605616+0000", 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00049477699999999996 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.612370+0000", 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006754258 2024-04-26T12:32:17.395 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 5.2126718509999996, 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013138092000000001, 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:17.396 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 18 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129198+0000", 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133886+0000", 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046879779999999998 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133913+0000", 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-05 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133924+0000", 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1629e-05 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133975+0000", 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1056e-05 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134116+0000", 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014008799999999999 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134222+0000", 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106283 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.140668+0000", 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064464539999999999 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142263+0000", 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001595162 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142302+0000", 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8331000000000003e-05 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142338+0000", 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6405999999999997e-05 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.401 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.6236550630000002, 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021336570999999999, 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 23 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.402 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718215+0000", 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:17.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722001+0000", 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037856769999999999 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722016+0000", 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5123000000000001e-05 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722024+0000", 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6799999999999993e-06 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722085+0000", 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1277000000000003e-05 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722183+0000", 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7922000000000002e-05 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722284+0000", 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100985 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.726784+0000", 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045004479999999998 2024-04-26T12:32:17.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739478+0000", 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012693594000000001 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739511+0000", 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3322999999999999e-05 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739553+0000", 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2250999999999999e-05 2024-04-26T12:32:17.407 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.848145+0000", 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4937267280000004, 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011274011, 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:17.408 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.848145+0000", 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.848145+0000", 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.848143+0000", 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851754+0000", 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003611342 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851767+0000", 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2639999999999999e-05 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851774+0000", 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3980000000000002e-06 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851850+0000", 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6083999999999999e-05 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851951+0000", 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010090399999999999 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.852046+0000", 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4489999999999998e-05 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.856295+0000", 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004249315 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.859357+0000", 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030619549999999999 2024-04-26T12:32:17.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.859394+0000", 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6591999999999998e-05 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.859419+0000", 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5667999999999999e-05 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.413 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:25 4.2a 4:57147dc3:::100000001f8.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.3717124329999999, 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013954156000000001, 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 25 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970158+0000", 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973845+0000", 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036870309999999999 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973859+0000", 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3431999999999999e-05 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973867+0000", 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7940000000000003e-06 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973931+0000", 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4793000000000001e-05 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974029+0000", 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7404000000000005e-05 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974117+0000", 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8641999999999996e-05 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.976886+0000", 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027684480000000002 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984047+0000", 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.007161059 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984086+0000", 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9490000000000003e-05 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984114+0000", 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.73e-05 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:26 4.32 e50/13 4:4f726a0c:::100000001f8.00000012:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:13.088115+0000", 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2537564899999998, 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0093757189999999994, 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.419 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.088115+0000", 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.088115+0000", 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.088114+0000", 2024-04-26T12:32:17.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092393+0000", 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042795819999999997 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092405+0000", 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092415+0000", 2024-04-26T12:32:17.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0045e-05 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092472+0000", 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6993999999999997e-05 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092487+0000", 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5099000000000001e-05 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.097460+0000", 2024-04-26T12:32:17.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049726950000000001 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.097491+0000", 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1331999999999997e-05 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.1568024860000001, 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012144647, 2024-04-26T12:32:17.423 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 27 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185068+0000", 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188763+0000", 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036955120000000002 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188778+0000", 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4295e-05 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188785+0000", 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4699999999999996e-06 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188863+0000", 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7713999999999995e-05 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188978+0000", 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115073 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.189082+0000", 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010394400000000001 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.191988+0000", 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029058840000000001 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197152+0000", 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0051638999999999999 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197184+0000", 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2756999999999998e-05 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197214+0000", 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9575999999999999e-05 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.428 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:30 4.14 4:2b28d75f:::100000001f8.00000016:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:13.546628+0000", 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.7952434610000001, 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011409976, 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 30 2024-04-26T12:32:17.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.546628+0000", 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.546628+0000", 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.546627+0000", 2024-04-26T12:32:17.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550609+0000", 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039817749999999999 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550625+0000", 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5917e-05 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550634+0000", 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5620000000000004e-06 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550699+0000", 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5440999999999999e-05 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550805+0000", 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105727 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:17.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550905+0000", 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9679999999999994e-05 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.554552+0000", 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003647118 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.557966+0000", 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003414448 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.558000+0000", 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3677000000000003e-05 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.558038+0000", 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8588999999999999e-05 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:49 4.1c e53/52 4:39b842ef:::100000001f8.00000029:head v 53'1, mlcod=0'0)", 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:16.104382+0000", 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.237489515, 2024-04-26T12:32:17.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877350000000001, 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.104382+0000", 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.104382+0000", 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.104382+0000", 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109301+0000", 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049190470000000002 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109312+0000", 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.043e-05 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109319+0000", 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6899999999999992e-06 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109348+0000", 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8282000000000001e-05 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109362+0000", 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4778e-05 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.113631+0000", 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042684869999999996 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.113670+0000", 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9303e-05 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.438 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:45 4.22 e53/52 4:47e99c31:::100000001f8.00000025:head v 53'1, mlcod=0'0)", 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:16.107582+0000", 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.234289959, 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011326898, 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.107582+0000", 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.107582+0000", 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.107581+0000", 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.114983+0000", 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074014279999999998 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.114996+0000", 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2621e-05 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.115008+0000", 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2461e-05 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.115042+0000", 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4032999999999998e-05 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.115058+0000", 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6277e-05 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.118861+0000", 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003802405 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.118909+0000", 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8148e-05 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:48 4.15 e53/52 4:aada5e43:::100000001f8.00000028:head v 53'1, mlcod=0'0)", 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:16.109920+0000", 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.23195225, 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010177617, 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109920+0000", 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109920+0000", 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109919+0000", 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116068+0000", 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006148227 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116077+0000", 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6090000000000007e-06 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116086+0000", 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5290000000000008e-06 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116133+0000", 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7250999999999999e-05 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116151+0000", 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8128e-05 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.120069+0000", 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039181069999999997 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.120097+0000", 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8084000000000001e-05 2024-04-26T12:32:17.446 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:58 4.28 e53/52 4:15eeb89b:::100000001f8.00000032:head v 53'1, mlcod=0'0)", 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:16.848027+0000", 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.49384461400000002, 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0090447819999999995, 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.848027+0000", 2024-04-26T12:32:17.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.848027+0000", 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.848026+0000", 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853658+0000", 2024-04-26T12:32:17.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056316789999999997 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853672+0000", 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4632e-05 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853680+0000", 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8639999999999996e-06 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853771+0000", 2024-04-26T12:32:17.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1071999999999998e-05 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853791+0000", 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9958000000000001e-05 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.857023+0000", 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0032314399999999999 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.857072+0000", 2024-04-26T12:32:17.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.939e-05 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:17.451 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:17.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:17.453 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:17.451+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:17.553 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:17.552+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:32:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:17.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:17.655 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:17.654+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:17.731 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:17.731 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:17.731 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:17.731 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:17.731 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:17.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:17.755 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:17.755+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:17.856 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:17.856+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:17.862 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:17.872 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.267997549, 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:32:17.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:32:17.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:32:17.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.878 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.26795586999999, 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:17.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:32:17.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:32:17.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.267927091, 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:32:17.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:32:17.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:32:17.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:32:17.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:32:17.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.267897443, 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:32:17.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.267858629, 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:32:17.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:32:17.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:32:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:32:17.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.26782984099999, 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.2678027, 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.915 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.26776098000001, 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:32:17.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:17.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:32:17.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:32:17.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.267699177, 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:32:17.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.927 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.26767630800001, 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:32:17.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:17.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:32:17.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:32:17.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.267645426, 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.937 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.26760521999999, 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.940 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.942 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.943 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:17.945 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.267575678, 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015251145000000001, 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602960+0000", 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.946 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602959+0000", 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602963+0000", 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.693e-06 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602970+0000", 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0330000000000003e-06 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602975+0000", 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5459999999999999e-06 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603006+0000", 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0679999999999998e-05 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603009+0000", 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.056e-06 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.608849+0000", 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058397190000000002 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609009+0000", 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016000699999999999 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.609960+0000", 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00095126900000000003 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615156+0000", 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051958810000000003 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618107+0000", 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029507499999999998 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618164+0000", 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7055000000000002e-05 2024-04-26T12:32:17.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618211+0000", 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6964e-05 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.26755023600001, 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.951 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:32:17.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.267507145, 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.957 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:32:17.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 105.26748981, 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.963 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.965 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.966 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.967 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:12 4.e 4:73e84e43:::100000001f8.00000004:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 6.4830553540000002, 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.02230445, 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 12 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387479+0000", 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:17.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401598+0000", 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01411946 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401621+0000", 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2921e-05 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401632+0000", 2024-04-26T12:32:17.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0957e-05 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401696+0000", 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3910000000000003e-05 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401842+0000", 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014598500000000001 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401993+0000", 2024-04-26T12:32:17.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000150679 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.407007+0000", 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050141669999999999 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409718+0000", 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002711293 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409755+0000", 2024-04-26T12:32:17.972 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6906999999999997e-05 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409784+0000", 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9533e-05 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:16 4.2c 4:36128e15:::100000001f8.00000008:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.9866802180000001, 2024-04-26T12:32:17.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019061136999999999, 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 16 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883854+0000", 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893062+0000", 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0092075000000000004 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893075+0000", 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3726e-05 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893100+0000", 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4997000000000001e-05 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893146+0000", 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5364000000000001e-05 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893250+0000", 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103892 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893345+0000", 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5696e-05 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.896800+0000", 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003454225 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902845+0000", 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0060457669999999996 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902881+0000", 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5830000000000001e-05 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902916+0000", 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5110000000000001e-05 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:23 4.24 e50/13 4:27adda6e:::100000001f8.0000000f:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.1481164750000001, 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016826893999999998, 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722417+0000", 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735064+0000", 2024-04-26T12:32:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012646924 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735091+0000", 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7265999999999999e-05 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735103+0000", 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1812e-05 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735158+0000", 2024-04-26T12:32:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4620000000000002e-05 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735179+0000", 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0879000000000001e-05 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.739192+0000", 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040138220000000002 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.739246+0000", 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3429e-05 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:26 4.32 4:4f726a0c:::100000001f8.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.7904439539999997, 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017624955000000001, 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 26 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080088+0000", 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087471+0000", 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00738253 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087494+0000", 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3088999999999999e-05 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087507+0000", 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3226e-05 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087574+0000", 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7070000000000007e-05 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087741+0000", 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016635900000000001 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087861+0000", 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000120114 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.091238+0000", 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003377634 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097648+0000", 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0064094399999999998 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097686+0000", 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7682000000000003e-05 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097716+0000", 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0901000000000001e-05 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:17.988 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:17.990 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:17.990 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:17.989+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:18.036 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:18.057 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:18.080 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:18.082 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:18.082 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:18.082 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:18.090 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:18.090+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:18.137 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:18.191 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:18.190+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:18.277 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:18.292 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:18.291+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:18.393 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:18.392+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:18.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:18.494 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:18.494+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:18.550 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:18.562 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:18.595 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:18.594+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:18.696 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:18.695+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:18.709 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:18.709 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:18.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:18.797 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:18.796+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:18.871 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:18.871 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:18.884 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:18.925 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:18.924+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:19.000 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:18.999+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:19.035 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:19.036 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:19.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:19.100 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:19.099+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:19.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:32:19.201 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:19.200+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:19.230 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:19.230 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:19.241 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:19.325 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:19.324+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:19.404 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:19.403+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:19.438 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:19.439 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:19.453 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:19.505 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:19.504+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:19.605 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:19.604+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:19.628 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:19.628 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:19.642 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:19.707 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:19.706+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:19.808 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:19.807+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:19.848 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:19.861 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:19.908 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:19.907+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:20.009 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:20.008+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:20.085 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:20.085 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:20.087 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:32:20.088 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:32:20.088 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T12:32:20.088 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:32:20.095 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:20.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:20.139 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:20.138+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:20.153 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:32:20.210 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:20.209+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:20.251 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:20.251 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:20.264 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:20.311 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:20.310+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:20.330 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:20.353 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:20.380 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:20.382 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:20.382 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:20.383 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:20.408 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:20.409 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:20.409 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:20.412 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:20.411+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:20.421 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:20.513 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:20.512+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:20.555 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:32:20.556 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-26T12:32:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 55, 2024-04-26T12:32:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "fsid": "64cc8c72-72d6-4335-8e3d-3304aaa6cad9", 2024-04-26T12:32:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "created": "2024-04-26T12:30:16.108777+0000", 2024-04-26T12:32:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "modified": "2024-04-26T12:32:20.134570+0000", 2024-04-26T12:32:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "last_up_change": "2024-04-26T12:30:24.744360+0000", 2024-04-26T12:32:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "last_in_change": "2024-04-26T12:30:17.865270+0000", 2024-04-26T12:32:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:32:20.556 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_num": 5806080, 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_set": [ 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "nodeep-scrub", 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "noscrub", 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "pglog_hardlimit", 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "purged_snapdirs", 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_deletes", 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "sortbitwise" 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_version": 4, 2024-04-26T12:32:20.557 INFO:teuthology.orchestra.run.smithi038.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:32:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:32:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:32:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_snapshot": "", 2024-04-26T12:32:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_max": 4, 2024-04-26T12:32:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd": 3, 2024-04-26T12:32:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:32:20.558 INFO:teuthology.orchestra.run.smithi038.stdout: "min_compat_client": "jewel", 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "require_osd_release": "reef", 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_crimson": false, 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "pools": [ 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 1, 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": ".mgr", 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:25.029168+0000", 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:32:20.559 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 1, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 1, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 1, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 1, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 1, 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:32:20.560 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "11", 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:32:20.561 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:32:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:32:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:32:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:32:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:32:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:32:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:32:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:32:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:32:20.562 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:32:20.563 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_max": 32, 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 1 2024-04-26T12:32:20.564 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr": {} 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 2, 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 2, 2024-04-26T12:32:20.565 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 0.6326751708984375, 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 0.62999999523162842, 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 0.62999999523162842 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 2, 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "rbd", 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:25.763407+0000", 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:32:20.566 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 8, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 8, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 8, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 8, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 8, 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "11", 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:32:20.569 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:32:20.570 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "options": {}, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd": {} 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.5, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.5, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2024-04-26T12:32:20.571 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.5, 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.5, 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 0.6326751708984375, 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 0.62999999523162842, 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 0.62999999523162842 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 3, 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:30.379996+0000", 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:32:20.572 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 32, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 32, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 32, 2024-04-26T12:32:20.573 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 32, 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 32, 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "14", 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:32:20.574 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:32:20.575 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:32:20.576 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 16, 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_priority": 5 2024-04-26T12:32:20.577 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:32:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2024-04-26T12:32:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": "cephfs" 2024-04-26T12:32:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:32:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.4099999666213989, 2024-04-26T12:32:20.578 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.4099999666213989, 2024-04-26T12:32:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2024-04-26T12:32:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.4099999666213989, 2024-04-26T12:32:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.4099999666213989, 2024-04-26T12:32:20.579 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 0.6326751708984375, 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 0.62999999523162842, 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 0.62999999523162842 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "pool": 4, 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": "cephfs_data", 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "create_time": "2024-04-26T12:30:31.544710+0000", 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "flags_names": "hashpspool", 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "type": 1, 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "size": 2, 2024-04-26T12:32:20.580 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": 1, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_rule": 0, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "object_hash": 2, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": 64, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num": 64, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_placement_num_target": 64, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_target": 64, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_pending": 64, 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "last_pg_merge_meta": { 2024-04-26T12:32:20.581 INFO:teuthology.orchestra.run.smithi038.stdout: "source_pgid": "0.0", 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "ready_epoch": 0, 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_started": 0, 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "last_epoch_clean": 0, 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "source_version": "0'0", 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "target_version": "0'0" 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "last_change": "15", 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend": "0", 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "auid": 0, 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:32:20.582 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_seq": 0, 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "snap_epoch": 0, 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_snaps": [], 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps": "[]", 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_bytes": 0, 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "quota_max_objects": 0, 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "tiers": [], 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "tier_of": -1, 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "read_tier": -1, 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "write_tier": -1, 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_mode": "none", 2024-04-26T12:32:20.583 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_bytes": 0, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "target_max_objects": 0, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_flush_age": 0, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "cache_min_evict_age": 0, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profile": "", 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_params": { 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "none" 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_period": 0, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_count": 0, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "use_gmt_hitset": true, 2024-04-26T12:32:20.584 INFO:teuthology.orchestra.run.smithi038.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "grade_table": [], 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "stripe_width": 0, 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "expected_num_objects": 0, 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "fast_read": false, 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "options": { 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num_min": 64, 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "application_metadata": { 2024-04-26T12:32:20.585 INFO:teuthology.orchestra.run.smithi038.stdout: "cephfs": { 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "data": "cephfs" 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "read_balance": { 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "score_acting": 1.6399999856948853, 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "score_stable": 1.6399999856948853, 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "optimal_score": 1, 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_acting": 1.6399999856948853, 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "raw_score_stable": 1.6399999856948853, 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity_weighted": 0.6326751708984375, 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity": 0.62999999523162842, 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: "average_primary_affinity_weighted": 0.62999999523162842 2024-04-26T12:32:20.586 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "osds": [ 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "25a1a54a-7d63-4c77-a385-f8147232ba3f", 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 1, 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 8, 2024-04-26T12:32:20.587 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 52, 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6800", 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6801", 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:32:20.588 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2024-04-26T12:32:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6802", 2024-04-26T12:32:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:32:20.589 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6803", 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6806", 2024-04-26T12:32:20.590 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6807", 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.591 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6804", 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.98:6805", 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40381 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.98:6801/40381", 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.98:6803/40381", 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.98:6807/40381", 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.98:6805/40381", 2024-04-26T12:32:20.592 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc", 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 0.0599517822265625, 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2024-04-26T12:32:20.593 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 8, 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 23, 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6800", 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:32:20.594 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6801", 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6802", 2024-04-26T12:32:20.595 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6803", 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.596 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6806", 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6807", 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.597 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6804", 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.116:6805", 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40366 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.116:6801/40366", 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.116:6803/40366", 2024-04-26T12:32:20.598 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.116:6807/40366", 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.116:6805/40366", 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "uuid": "0ddc67e1-ee46-4691-bc16-6366296d9929", 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "up": 1, 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "in": 1, 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "weight": 1, 2024-04-26T12:32:20.599 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_affinity": 0.83807373046875, 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_begin": 0, 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "last_clean_end": 0, 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "up_from": 8, 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "up_thru": 52, 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "down_at": 0, 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "lost_at": 0, 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addrs": { 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6800", 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.600 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6801", 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addrs": { 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6802", 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.601 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6803", 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addrs": { 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6806", 2024-04-26T12:32:20.602 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6807", 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addrs": { 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6804", 2024-04-26T12:32:20.603 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.133:6805", 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 40554 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "public_addr": "172.21.15.133:6801/40554", 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_addr": "172.21.15.133:6803/40554", 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40554", 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40554", 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "state": [ 2024-04-26T12:32:20.604 INFO:teuthology.orchestra.run.smithi038.stdout: "exists", 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "up" 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_xinfo": [ 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 0, 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2024-04-26T12:32:20.605 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2024-04-26T12:30:22.897372+0000", 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 1, 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2024-04-26T12:32:20.606 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2024-04-26T12:30:22.974464+0000", 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: { 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "osd": 2, 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "down_stamp": "0.000000", 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_probability": 0, 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "laggy_interval": 0, 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "features": 4540138322906710015, 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "old_weight": 0, 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "last_purged_snaps_scrub": "2024-04-26T12:30:22.873008+0000", 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "dead_epoch": 0 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2024-04-26T12:32:20.607 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap": [], 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_items": [], 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_upmap_primaries": [], 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_temp": [], 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "primary_temp": [], 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklist": {}, 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "range_blocklist": {}, 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "erasure_code_profiles": { 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "default": { 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-failure-domain": "osd", 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "k": "2", 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "m": "1", 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "plugin": "jerasure", 2024-04-26T12:32:20.608 INFO:teuthology.orchestra.run.smithi038.stdout: "technique": "reed_sol_van" 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "removed_snaps_queue": [], 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "new_removed_snaps": [], 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "new_purged_snaps": [], 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_node_flags": {}, 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "device_class_flags": {}, 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode": { 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_enabled": false, 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_bucket_count": 0, 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: "stretch_mode_bucket": 0 2024-04-26T12:32:20.609 INFO:teuthology.orchestra.run.smithi038.stdout: } 2024-04-26T12:32:20.610 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-26T12:32:20.613 INFO:tasks.thrashosds.thrasher:j is {'epoch': 55, 'fsid': '64cc8c72-72d6-4335-8e3d-3304aaa6cad9', 'created': '2024-04-26T12:30:16.108777+0000', 'modified': '2024-04-26T12:32:20.134570+0000', 'last_up_change': '2024-04-26T12:30:24.744360+0000', 'last_in_change': '2024-04-26T12:30:17.865270+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:30:25.029168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:30:25.763407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:30:30.379996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.409999966621399, 'score_stable': 1.409999966621399, 'optimal_score': 1, 'raw_score_acting': 1.409999966621399, 'raw_score_stable': 1.409999966621399, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:30:31.544710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6399999856948853, 'score_stable': 1.6399999856948853, 'optimal_score': 1, 'raw_score_acting': 1.6399999856948853, 'raw_score_stable': 1.6399999856948853, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}], 'osds': [{'osd': 0, 'uuid': '25a1a54a-7d63-4c77-a385-f8147232ba3f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 40381}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 40381}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 40381}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 40381}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 40381}]}, 'public_addr': '172.21.15.98:6801/40381', 'cluster_addr': '172.21.15.98:6803/40381', 'heartbeat_back_addr': '172.21.15.98:6807/40381', 'heartbeat_front_addr': '172.21.15.98:6805/40381', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.0599517822265625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6800', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6801', 'nonce': 40366}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6802', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6803', 'nonce': 40366}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6806', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6807', 'nonce': 40366}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6804', 'nonce': 40366}, {'type': 'v1', 'addr': '172.21.15.116:6805', 'nonce': 40366}]}, 'public_addr': '172.21.15.116:6801/40366', 'cluster_addr': '172.21.15.116:6803/40366', 'heartbeat_back_addr': '172.21.15.116:6807/40366', 'heartbeat_front_addr': '172.21.15.116:6805/40366', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '0ddc67e1-ee46-4691-bc16-6366296d9929', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.83807373046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6800', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6801', 'nonce': 40554}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6802', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6803', 'nonce': 40554}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6806', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6807', 'nonce': 40554}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6804', 'nonce': 40554}, {'type': 'v1', 'addr': '172.21.15.133:6805', 'nonce': 40554}]}, 'public_addr': '172.21.15.133:6801/40554', 'cluster_addr': '172.21.15.133:6803/40554', 'heartbeat_back_addr': '172.21.15.133:6807/40554', 'heartbeat_front_addr': '172.21.15.133:6805/40554', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:30:22.897372+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:30:22.974464+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:30:22.873008+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:32:20.613 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:32:20.613 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.980626965, 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:32:20.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:32:20.620 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.98056890300001, 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:32:20.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:32:20.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:20.627 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.98054035, 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:32:20.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.633 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.980520875, 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:32:20.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.639 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.980500831, 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010743182, 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:20.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603321+0000", 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603327+0000", 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603333+0000", 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7290000000000003e-06 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603338+0000", 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0880000000000002e-06 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603729+0000", 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000390348 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603734+0000", 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605575+0000", 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001841484 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605765+0000", 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000189746 2024-04-26T12:32:20.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605900+0000", 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013482699999999999 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613538+0000", 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076379530000000003 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613960+0000", 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000421789 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614026+0000", 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6126999999999999e-05 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614064+0000", 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8515e-05 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.645 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.980477534, 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011497057999999999, 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603345+0000", 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603344+0000", 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603347+0000", 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1920000000000001e-06 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603353+0000", 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:32:20.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603359+0000", 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9830000000000001e-06 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603763+0000", 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040399000000000001 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:20.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603768+0000", 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6909999999999996e-06 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606259+0000", 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024908669999999999 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606353+0000", 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3630999999999999e-05 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606496+0000", 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014355800000000001 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613558+0000", 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070622640000000004 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614710+0000", 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00115197 2024-04-26T12:32:20.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614757+0000", 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6573999999999998e-05 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614842+0000", 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4716999999999995e-05 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.98045709199999, 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:32:20.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:20.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:32:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:20.659 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 107.98043654599999, 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011571424, 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603386+0000", 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603385+0000", 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603387+0000", 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.137e-06 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603394+0000", 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603400+0000", 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6350000000000003e-06 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603556+0000", 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015545399999999999 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603562+0000", 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.511e-06 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605031+0000", 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001469295 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605479+0000", 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00044777899999999998 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.614957+0000", 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094777920000000005 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.4546220230000007, 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013138092000000001, 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:20.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 18 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129198+0000", 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133886+0000", 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046879779999999998 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133913+0000", 2024-04-26T12:32:20.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-05 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133924+0000", 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1629e-05 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133975+0000", 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1056e-05 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134116+0000", 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014008799999999999 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134222+0000", 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106283 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.140668+0000", 2024-04-26T12:32:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064464539999999999 2024-04-26T12:32:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142263+0000", 2024-04-26T12:32:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001595162 2024-04-26T12:32:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142302+0000", 2024-04-26T12:32:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8331000000000003e-05 2024-04-26T12:32:20.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142338+0000", 2024-04-26T12:32:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6405999999999997e-05 2024-04-26T12:32:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.674 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:20.675 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.8656052350000003, 2024-04-26T12:32:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021336570999999999, 2024-04-26T12:32:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:20.676 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 23 2024-04-26T12:32:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:20.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718215+0000", 2024-04-26T12:32:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:20.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722001+0000", 2024-04-26T12:32:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037856769999999999 2024-04-26T12:32:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722016+0000", 2024-04-26T12:32:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5123000000000001e-05 2024-04-26T12:32:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722024+0000", 2024-04-26T12:32:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6799999999999993e-06 2024-04-26T12:32:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722085+0000", 2024-04-26T12:32:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1277000000000003e-05 2024-04-26T12:32:20.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722183+0000", 2024-04-26T12:32:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7922000000000002e-05 2024-04-26T12:32:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722284+0000", 2024-04-26T12:32:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100985 2024-04-26T12:32:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.726784+0000", 2024-04-26T12:32:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045004479999999998 2024-04-26T12:32:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739478+0000", 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012693594000000001 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739511+0000", 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3322999999999999e-05 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739553+0000", 2024-04-26T12:32:20.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2250999999999999e-05 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.848145+0000", 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.7356768999999996, 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011274011, 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:20.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 24 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.848145+0000", 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.848145+0000", 2024-04-26T12:32:20.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.848143+0000", 2024-04-26T12:32:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851754+0000", 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003611342 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851767+0000", 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2639999999999999e-05 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851774+0000", 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3980000000000002e-06 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851850+0000", 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6083999999999999e-05 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.851951+0000", 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010090399999999999 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.852046+0000", 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4489999999999998e-05 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.856295+0000", 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004249315 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.859357+0000", 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030619549999999999 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.859394+0000", 2024-04-26T12:32:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6591999999999998e-05 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.859419+0000", 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5667999999999999e-05 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:25 4.2a 4:57147dc3:::100000001f8.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:20.692 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.613662605, 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013954156000000001, 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 25 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970158+0000", 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973845+0000", 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036870309999999999 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973859+0000", 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3431999999999999e-05 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973867+0000", 2024-04-26T12:32:20.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7940000000000003e-06 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973931+0000", 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4793000000000001e-05 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974029+0000", 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7404000000000005e-05 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974117+0000", 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8641999999999996e-05 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.976886+0000", 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027684480000000002 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984047+0000", 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.007161059 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984086+0000", 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9490000000000003e-05 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984114+0000", 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.73e-05 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:26 4.32 e50/13 4:4f726a0c:::100000001f8.00000012:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:20.698 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:13.088115+0000", 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.4957066619999999, 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0093757189999999994, 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.088115+0000", 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.088115+0000", 2024-04-26T12:32:20.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.088114+0000", 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092393+0000", 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042795819999999997 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092405+0000", 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1671999999999999e-05 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092415+0000", 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0045e-05 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092472+0000", 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6993999999999997e-05 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.092487+0000", 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5099000000000001e-05 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.097460+0000", 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049726950000000001 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.097491+0000", 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1331999999999997e-05 2024-04-26T12:32:20.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.3987526580000003, 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012144647, 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:20.703 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 27 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185068+0000", 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188763+0000", 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036955120000000002 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188778+0000", 2024-04-26T12:32:20.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4295e-05 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188785+0000", 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4699999999999996e-06 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188863+0000", 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7713999999999995e-05 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188978+0000", 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115073 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.189082+0000", 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010394400000000001 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.191988+0000", 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029058840000000001 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197152+0000", 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0051638999999999999 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197184+0000", 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2756999999999998e-05 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197214+0000", 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9575999999999999e-05 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:30 4.14 4:2b28d75f:::100000001f8.00000016:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:13.546628+0000", 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 7.0371936330000002, 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011409976, 2024-04-26T12:32:20.709 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 30 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.546628+0000", 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.546628+0000", 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.546627+0000", 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550609+0000", 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039817749999999999 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550625+0000", 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5917e-05 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550634+0000", 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5620000000000004e-06 2024-04-26T12:32:20.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550699+0000", 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5440999999999999e-05 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550805+0000", 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000105727 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.550905+0000", 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9679999999999994e-05 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.554552+0000", 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003647118 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.557966+0000", 2024-04-26T12:32:20.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003414448 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.558000+0000", 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3677000000000003e-05 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.558038+0000", 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8588999999999999e-05 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.715 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:49 4.1c e53/52 4:39b842ef:::100000001f8.00000029:head v 53'1, mlcod=0'0)", 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:16.104382+0000", 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4794396870000002, 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092877350000000001, 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.104382+0000", 2024-04-26T12:32:20.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.104382+0000", 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.104382+0000", 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109301+0000", 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049190470000000002 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109312+0000", 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.043e-05 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109319+0000", 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6899999999999992e-06 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109348+0000", 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8282000000000001e-05 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109362+0000", 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4778e-05 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.113631+0000", 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042684869999999996 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.113670+0000", 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9303e-05 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:45 4.22 e53/52 4:47e99c31:::100000001f8.00000025:head v 53'1, mlcod=0'0)", 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:16.107582+0000", 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.476240131, 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011326898, 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.107582+0000", 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.107582+0000", 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.107581+0000", 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.114983+0000", 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0074014279999999998 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.114996+0000", 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2621e-05 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.115008+0000", 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2461e-05 2024-04-26T12:32:20.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.115042+0000", 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4032999999999998e-05 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.115058+0000", 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6277e-05 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.118861+0000", 2024-04-26T12:32:20.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003802405 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.118909+0000", 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8148e-05 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:48 4.15 e53/52 4:aada5e43:::100000001f8.00000028:head v 53'1, mlcod=0'0)", 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:16.109920+0000", 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.4739024220000001, 2024-04-26T12:32:20.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010177617, 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109920+0000", 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109920+0000", 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.109919+0000", 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116068+0000", 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006148227 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116077+0000", 2024-04-26T12:32:20.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6090000000000007e-06 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116086+0000", 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5290000000000008e-06 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116133+0000", 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7250999999999999e-05 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.116151+0000", 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8128e-05 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.120069+0000", 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0039181069999999997 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.120097+0000", 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8084000000000001e-05 2024-04-26T12:32:20.728 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:58 4.28 e53/52 4:15eeb89b:::100000001f8.00000032:head v 53'1, mlcod=0'0)", 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:16.848027+0000", 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.735794786, 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0090447819999999995, 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.848027+0000", 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.848027+0000", 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.848026+0000", 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853658+0000", 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056316789999999997 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853672+0000", 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4632e-05 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853680+0000", 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8639999999999996e-06 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853771+0000", 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1071999999999998e-05 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.853791+0000", 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9958000000000001e-05 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.857023+0000", 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0032314399999999999 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:16.857072+0000", 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.939e-05 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:4087 4.24 4:27adda6e:::100000001f8.0000000f:head [write 1507328~8192,write 1519616~4096,write 2240512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:20.529330+0000", 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.054492329999999999, 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0091969219999999997, 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:20.733 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 4087 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.529330+0000", 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.529330+0000", 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.529329+0000", 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.529337+0000", 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0320000000000003e-06 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.529343+0000", 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8159999999999999e-06 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.529348+0000", 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.169e-06 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.529373+0000", 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4488999999999999e-05 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.529422+0000", 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9815999999999999e-05 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.529518+0000", 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5543000000000003e-05 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.535422+0000", 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005904131 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.538474+0000", 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00305201 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.538505+0000", 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0976000000000003e-05 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:20.538527+0000", 2024-04-26T12:32:20.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.156e-05 2024-04-26T12:32:20.739 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.739 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.739 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.739 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:20.739 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:20.739 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:20.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:20.741 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:20.739+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:20.842 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:20.841+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:20.898 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:20.898 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:20.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.898 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:4911 4.34 4:2d2c9530:::100000001f8.00000036:head [write 2899968~4096 in=4096b,write 2973696~4096 in=4096b,write 2994176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:20.896558+0000", 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00141446, 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001436079, 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 4911 2024-04-26T12:32:20.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.896558+0000", 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.896558+0000", 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:20.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.896558+0000", 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.896598+0000", 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0525999999999998e-05 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.896608+0000", 2024-04-26T12:32:20.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.896615+0000", 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0230000000000004e-06 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.896657+0000", 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1754e-05 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.896744+0000", 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7740999999999999e-05 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.896898+0000", 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000153509 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897609+0000", 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00071092799999999999 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897942+0000", 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000333271 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897975+0000", 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2821999999999998e-05 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897994+0000", 2024-04-26T12:32:20.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9409e-05 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop_reply(client.4532.0:4911 4.34 e55/52 ondisk, result = 0)", 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:20.897888+0000", 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 8.4605999999999996e-05, 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017489299999999999, 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:20.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897888+0000", 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897888+0000", 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897888+0000", 2024-04-26T12:32:20.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897891+0000", 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5750000000000001e-06 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897900+0000", 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5089999999999993e-06 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897906+0000", 2024-04-26T12:32:20.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.784e-06 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897934+0000", 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8087000000000001e-05 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.897939+0000", 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5809999999999996e-06 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:20.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:20.898064+0000", 2024-04-26T12:32:20.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012464099999999999 2024-04-26T12:32:20.909 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:20.909 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:20.909 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:20.909 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:20.909 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:20.909 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 2 2024-04-26T12:32:20.909 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:20.911 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:20.943 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:20.942+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:21.044 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:21.043+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:21.106 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:21.106 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:21.106 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:21.106 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:21.106 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:21.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:21.159 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:21.158+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:21.185 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:32:21.187 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:32:21.201 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-04-26T12:32:20.991268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":270162069,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":9039,"num_write_kb":304462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3228,"ondisk_log_size":3228,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":186348,"kb_used_data":84804,"kb_used_omap":4,"kb_used_meta":101499,"kb_avail":282929172,"statfs":{"total":289910292480,"available":289719472128,"internally_reserved":0,"allocated":86839296,"data_stored":540949998,"data_compressed":334609,"data_compressed_allocated":36384768,"data_compressed_original":491286528,"omap_allocated":4782,"internal_metadata":103935314},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":122697592,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8726,"num_write_kb":157548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.927027"},"pg_stats":[{"pgid":"4.3f","version":"54'48","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.011471+0000","last_change":"2024-04-26T12:32:16.107541+0000","last_active":"2024-04-26T12:32:20.011471+0000","last_peered":"2024-04-26T12:32:20.011471+0000","last_clean":"2024-04-26T12:32:20.011471+0000","last_became_active":"2024-04-26T12:32:16.104202+0000","last_became_peered":"2024-04-26T12:32:16.104202+0000","last_unstale":"2024-04-26T12:32:20.011471+0000","last_undegraded":"2024-04-26T12:32:20.011471+0000","last_fullsized":"2024-04-26T12:32:20.011471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.129211+0000","last_change":"2024-04-26T12:32:16.104740+0000","last_active":"2024-04-26T12:32:17.129211+0000","last_peered":"2024-04-26T12:32:17.129211+0000","last_clean":"2024-04-26T12:32:17.129211+0000","last_became_active":"2024-04-26T12:32:16.103985+0000","last_became_peered":"2024-04-26T12:32:16.103985+0000","last_unstale":"2024-04-26T12:32:17.129211+0000","last_undegraded":"2024-04-26T12:32:17.129211+0000","last_fullsized":"2024-04-26T12:32:17.129211+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:34.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"54'102","reported_seq":151,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.008027+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:32:20.008027+0000","last_peered":"2024-04-26T12:32:20.008027+0000","last_clean":"2024-04-26T12:32:20.008027+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:32:20.008027+0000","last_undegraded":"2024-04-26T12:32:20.008027+0000","last_fullsized":"2024-04-26T12:32:20.008027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":9400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105448+0000","last_change":"2024-04-26T12:30:32.620237+0000","last_active":"2024-04-26T12:32:16.105448+0000","last_peered":"2024-04-26T12:32:16.105448+0000","last_clean":"2024-04-26T12:32:16.105448+0000","last_became_active":"2024-04-26T12:30:32.619081+0000","last_became_peered":"2024-04-26T12:30:32.619081+0000","last_unstale":"2024-04-26T12:32:16.105448+0000","last_undegraded":"2024-04-26T12:32:16.105448+0000","last_fullsized":"2024-04-26T12:32:16.105448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:10.010232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"54'45","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.006232+0000","last_change":"2024-04-26T12:32:16.104691+0000","last_active":"2024-04-26T12:32:20.006232+0000","last_peered":"2024-04-26T12:32:20.006232+0000","last_clean":"2024-04-26T12:32:20.006232+0000","last_became_active":"2024-04-26T12:32:16.103552+0000","last_became_peered":"2024-04-26T12:32:16.103552+0000","last_unstale":"2024-04-26T12:32:20.006232+0000","last_undegraded":"2024-04-26T12:32:20.006232+0000","last_fullsized":"2024-04-26T12:32:20.006232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:27.473419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":4620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.099618+0000","last_change":"2024-04-26T12:31:07.232711+0000","last_active":"2024-04-26T12:32:16.099618+0000","last_peered":"2024-04-26T12:32:16.099618+0000","last_clean":"2024-04-26T12:32:16.099618+0000","last_became_active":"2024-04-26T12:31:07.232528+0000","last_became_peered":"2024-04-26T12:31:07.232528+0000","last_unstale":"2024-04-26T12:32:16.099618+0000","last_undegraded":"2024-04-26T12:32:16.099618+0000","last_fullsized":"2024-04-26T12:32:16.099618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:16.731908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.099457+0000","last_change":"2024-04-26T12:31:07.231727+0000","last_active":"2024-04-26T12:32:16.099457+0000","last_peered":"2024-04-26T12:32:16.099457+0000","last_clean":"2024-04-26T12:32:16.099457+0000","last_became_active":"2024-04-26T12:31:07.231554+0000","last_became_peered":"2024-04-26T12:31:07.231554+0000","last_unstale":"2024-04-26T12:32:16.099457+0000","last_undegraded":"2024-04-26T12:32:16.099457+0000","last_fullsized":"2024-04-26T12:32:16.099457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:12.093722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"54'187","reported_seq":236,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.007348+0000","last_change":"2024-04-26T12:30:32.616700+0000","last_active":"2024-04-26T12:32:20.007348+0000","last_peered":"2024-04-26T12:32:20.007348+0000","last_clean":"2024-04-26T12:32:20.007348+0000","last_became_active":"2024-04-26T12:30:32.615284+0000","last_became_peered":"2024-04-26T12:30:32.615284+0000","last_unstale":"2024-04-26T12:32:20.007348+0000","last_undegraded":"2024-04-26T12:32:20.007348+0000","last_fullsized":"2024-04-26T12:32:20.007348+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:48.294616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":567,"num_write_kb":18760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"54'138","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.997773+0000","last_change":"2024-04-26T12:30:32.615754+0000","last_active":"2024-04-26T12:32:19.997773+0000","last_peered":"2024-04-26T12:32:19.997773+0000","last_clean":"2024-04-26T12:32:19.997773+0000","last_became_active":"2024-04-26T12:30:32.615320+0000","last_became_peered":"2024-04-26T12:30:32.615320+0000","last_unstale":"2024-04-26T12:32:19.997773+0000","last_undegraded":"2024-04-26T12:32:19.997773+0000","last_fullsized":"2024-04-26T12:32:19.997773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":393,"num_write_kb":13912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"54'143","reported_seq":195,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.000493+0000","last_change":"2024-04-26T12:32:16.105139+0000","last_active":"2024-04-26T12:32:20.000493+0000","last_peered":"2024-04-26T12:32:20.000493+0000","last_clean":"2024-04-26T12:32:20.000493+0000","last_became_active":"2024-04-26T12:32:16.104391+0000","last_became_peered":"2024-04-26T12:32:16.104391+0000","last_unstale":"2024-04-26T12:32:20.000493+0000","last_undegraded":"2024-04-26T12:32:20.000493+0000","last_fullsized":"2024-04-26T12:32:20.000493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:29.556319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13657920,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":16003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"54'91","reported_seq":131,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.984806+0000","last_change":"2024-04-26T12:31:07.232741+0000","last_active":"2024-04-26T12:32:19.984806+0000","last_peered":"2024-04-26T12:32:19.984806+0000","last_clean":"2024-04-26T12:32:19.984806+0000","last_became_active":"2024-04-26T12:31:07.232521+0000","last_became_peered":"2024-04-26T12:31:07.232521+0000","last_unstale":"2024-04-26T12:32:19.984806+0000","last_undegraded":"2024-04-26T12:32:19.984806+0000","last_fullsized":"2024-04-26T12:32:19.984806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:11.363233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":9260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"54'53","reported_seq":65,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.013958+0000","last_change":"2024-04-26T12:32:16.107668+0000","last_active":"2024-04-26T12:32:20.013958+0000","last_peered":"2024-04-26T12:32:20.013958+0000","last_clean":"2024-04-26T12:32:20.013958+0000","last_became_active":"2024-04-26T12:32:16.107458+0000","last_became_peered":"2024-04-26T12:32:16.107458+0000","last_unstale":"2024-04-26T12:32:20.013958+0000","last_undegraded":"2024-04-26T12:32:20.013958+0000","last_fullsized":"2024-04-26T12:32:20.013958+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.458028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":4724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"54'39","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.993487+0000","last_change":"2024-04-26T12:32:16.104975+0000","last_active":"2024-04-26T12:32:19.993487+0000","last_peered":"2024-04-26T12:32:19.993487+0000","last_clean":"2024-04-26T12:32:19.993487+0000","last_became_active":"2024-04-26T12:32:16.104424+0000","last_became_peered":"2024-04-26T12:32:16.104424+0000","last_unstale":"2024-04-26T12:32:19.993487+0000","last_undegraded":"2024-04-26T12:32:19.993487+0000","last_fullsized":"2024-04-26T12:32:19.993487+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:35.303426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"54'49","reported_seq":98,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.936058+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:32:19.936058+0000","last_peered":"2024-04-26T12:32:19.936058+0000","last_clean":"2024-04-26T12:32:19.936058+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:32:19.936058+0000","last_undegraded":"2024-04-26T12:32:19.936058+0000","last_fullsized":"2024-04-26T12:32:19.936058+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"54'48","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.994696+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:32:19.994696+0000","last_peered":"2024-04-26T12:32:19.994696+0000","last_clean":"2024-04-26T12:32:19.994696+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:32:19.994696+0000","last_undegraded":"2024-04-26T12:32:19.994696+0000","last_fullsized":"2024-04-26T12:32:19.994696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":4660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"54'44","reported_seq":84,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.971811+0000","last_change":"2024-04-26T12:31:07.233006+0000","last_active":"2024-04-26T12:32:19.971811+0000","last_peered":"2024-04-26T12:32:19.971811+0000","last_clean":"2024-04-26T12:32:19.971811+0000","last_became_active":"2024-04-26T12:31:07.232842+0000","last_became_peered":"2024-04-26T12:31:07.232842+0000","last_unstale":"2024-04-26T12:32:19.971811+0000","last_undegraded":"2024-04-26T12:32:19.971811+0000","last_fullsized":"2024-04-26T12:32:19.971811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:39.359074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":4640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"54'50","reported_seq":97,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.993783+0000","last_change":"2024-04-26T12:30:32.613001+0000","last_active":"2024-04-26T12:32:19.993783+0000","last_peered":"2024-04-26T12:32:19.993783+0000","last_clean":"2024-04-26T12:32:19.993783+0000","last_became_active":"2024-04-26T12:30:32.612491+0000","last_became_peered":"2024-04-26T12:30:32.612491+0000","last_unstale":"2024-04-26T12:32:19.993783+0000","last_undegraded":"2024-04-26T12:32:19.993783+0000","last_fullsized":"2024-04-26T12:32:19.993783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.761517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":4700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"54'52","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.999056+0000","last_change":"2024-04-26T12:32:16.105812+0000","last_active":"2024-04-26T12:32:19.999056+0000","last_peered":"2024-04-26T12:32:19.999056+0000","last_clean":"2024-04-26T12:32:19.999056+0000","last_became_active":"2024-04-26T12:32:16.105526+0000","last_became_peered":"2024-04-26T12:32:16.105526+0000","last_unstale":"2024-04-26T12:32:19.999056+0000","last_undegraded":"2024-04-26T12:32:19.999056+0000","last_fullsized":"2024-04-26T12:32:19.999056+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:00.241055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":4708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"54'98","reported_seq":145,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.987418+0000","last_change":"2024-04-26T12:30:32.613258+0000","last_active":"2024-04-26T12:32:19.987418+0000","last_peered":"2024-04-26T12:32:19.987418+0000","last_clean":"2024-04-26T12:32:19.987418+0000","last_became_active":"2024-04-26T12:30:32.612676+0000","last_became_peered":"2024-04-26T12:30:32.612676+0000","last_unstale":"2024-04-26T12:32:19.987418+0000","last_undegraded":"2024-04-26T12:32:19.987418+0000","last_fullsized":"2024-04-26T12:32:19.987418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":9340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"54'93","reported_seq":142,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.010458+0000","last_change":"2024-04-26T12:30:32.619960+0000","last_active":"2024-04-26T12:32:20.010458+0000","last_peered":"2024-04-26T12:32:20.010458+0000","last_clean":"2024-04-26T12:32:20.010458+0000","last_became_active":"2024-04-26T12:30:32.618958+0000","last_became_peered":"2024-04-26T12:30:32.618958+0000","last_unstale":"2024-04-26T12:32:20.010458+0000","last_undegraded":"2024-04-26T12:32:20.010458+0000","last_fullsized":"2024-04-26T12:32:20.010458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:06.107807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":9276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105589+0000","last_change":"2024-04-26T12:30:32.614379+0000","last_active":"2024-04-26T12:32:16.105589+0000","last_peered":"2024-04-26T12:32:16.105589+0000","last_clean":"2024-04-26T12:32:16.105589+0000","last_became_active":"2024-04-26T12:30:32.613971+0000","last_became_peered":"2024-04-26T12:30:32.613971+0000","last_unstale":"2024-04-26T12:32:16.105589+0000","last_undegraded":"2024-04-26T12:32:16.105589+0000","last_fullsized":"2024-04-26T12:32:16.105589+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:14.147040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"54'44","reported_seq":91,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.987442+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:32:19.987442+0000","last_peered":"2024-04-26T12:32:19.987442+0000","last_clean":"2024-04-26T12:32:19.987442+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:32:19.987442+0000","last_undegraded":"2024-04-26T12:32:19.987442+0000","last_fullsized":"2024-04-26T12:32:19.987442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"54'45","reported_seq":92,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.949319+0000","last_change":"2024-04-26T12:30:32.613467+0000","last_active":"2024-04-26T12:32:19.949319+0000","last_peered":"2024-04-26T12:32:19.949319+0000","last_clean":"2024-04-26T12:32:19.949319+0000","last_became_active":"2024-04-26T12:30:32.613159+0000","last_became_peered":"2024-04-26T12:30:32.613159+0000","last_unstale":"2024-04-26T12:32:19.949319+0000","last_undegraded":"2024-04-26T12:32:19.949319+0000","last_fullsized":"2024-04-26T12:32:19.949319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":4640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"54'90","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.998723+0000","last_change":"2024-04-26T12:32:16.107598+0000","last_active":"2024-04-26T12:32:19.998723+0000","last_peered":"2024-04-26T12:32:19.998723+0000","last_clean":"2024-04-26T12:32:19.998723+0000","last_became_active":"2024-04-26T12:32:16.104536+0000","last_became_peered":"2024-04-26T12:32:16.104536+0000","last_unstale":"2024-04-26T12:32:19.998723+0000","last_undegraded":"2024-04-26T12:32:19.998723+0000","last_fullsized":"2024-04-26T12:32:19.998723+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:33.467447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":9300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"54'46","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.985414+0000","last_change":"2024-04-26T12:32:16.109558+0000","last_active":"2024-04-26T12:32:19.985414+0000","last_peered":"2024-04-26T12:32:19.985414+0000","last_clean":"2024-04-26T12:32:19.985414+0000","last_became_active":"2024-04-26T12:32:16.109196+0000","last_became_peered":"2024-04-26T12:32:16.109196+0000","last_unstale":"2024-04-26T12:32:19.985414+0000","last_undegraded":"2024-04-26T12:32:19.985414+0000","last_fullsized":"2024-04-26T12:32:19.985414+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:25.423545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":4644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.101284+0000","last_change":"2024-04-26T12:30:32.613564+0000","last_active":"2024-04-26T12:32:16.101284+0000","last_peered":"2024-04-26T12:32:16.101284+0000","last_clean":"2024-04-26T12:32:16.101284+0000","last_became_active":"2024-04-26T12:30:32.613227+0000","last_became_peered":"2024-04-26T12:30:32.613227+0000","last_unstale":"2024-04-26T12:32:16.101284+0000","last_undegraded":"2024-04-26T12:32:16.101284+0000","last_fullsized":"2024-04-26T12:32:16.101284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:18.566433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"54'47","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.962985+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:32:19.962985+0000","last_peered":"2024-04-26T12:32:19.962985+0000","last_clean":"2024-04-26T12:32:19.962985+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:32:19.962985+0000","last_undegraded":"2024-04-26T12:32:19.962985+0000","last_fullsized":"2024-04-26T12:32:19.962985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":4676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.129308+0000","last_change":"2024-04-26T12:32:16.102923+0000","last_active":"2024-04-26T12:32:17.129308+0000","last_peered":"2024-04-26T12:32:17.129308+0000","last_clean":"2024-04-26T12:32:17.129308+0000","last_became_active":"2024-04-26T12:32:16.102697+0000","last_became_peered":"2024-04-26T12:32:16.102697+0000","last_unstale":"2024-04-26T12:32:17.129308+0000","last_undegraded":"2024-04-26T12:32:17.129308+0000","last_fullsized":"2024-04-26T12:32:17.129308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:07.340477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.129999+0000","last_change":"2024-04-26T12:32:16.110135+0000","last_active":"2024-04-26T12:32:17.129999+0000","last_peered":"2024-04-26T12:32:17.129999+0000","last_clean":"2024-04-26T12:32:17.129999+0000","last_became_active":"2024-04-26T12:32:16.109837+0000","last_became_peered":"2024-04-26T12:32:16.109837+0000","last_unstale":"2024-04-26T12:32:17.129999+0000","last_undegraded":"2024-04-26T12:32:17.129999+0000","last_fullsized":"2024-04-26T12:32:17.129999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:19.898367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100167+0000","last_change":"2024-04-26T12:30:32.150769+0000","last_active":"2024-04-26T12:32:16.100167+0000","last_peered":"2024-04-26T12:32:16.100167+0000","last_clean":"2024-04-26T12:32:16.100167+0000","last_became_active":"2024-04-26T12:30:32.150540+0000","last_became_peered":"2024-04-26T12:30:32.150540+0000","last_unstale":"2024-04-26T12:32:16.100167+0000","last_undegraded":"2024-04-26T12:32:16.100167+0000","last_fullsized":"2024-04-26T12:32:16.100167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.101795+0000","last_change":"2024-04-26T12:30:32.611431+0000","last_active":"2024-04-26T12:32:16.101795+0000","last_peered":"2024-04-26T12:32:16.101795+0000","last_clean":"2024-04-26T12:32:16.101795+0000","last_became_active":"2024-04-26T12:30:32.611141+0000","last_became_peered":"2024-04-26T12:30:32.611141+0000","last_unstale":"2024-04-26T12:32:16.101795+0000","last_undegraded":"2024-04-26T12:32:16.101795+0000","last_fullsized":"2024-04-26T12:32:16.101795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.099526+0000","last_change":"2024-04-26T12:30:32.154617+0000","last_active":"2024-04-26T12:32:16.099526+0000","last_peered":"2024-04-26T12:32:16.099526+0000","last_clean":"2024-04-26T12:32:16.099526+0000","last_became_active":"2024-04-26T12:30:32.153959+0000","last_became_peered":"2024-04-26T12:30:32.153959+0000","last_unstale":"2024-04-26T12:32:16.099526+0000","last_undegraded":"2024-04-26T12:32:16.099526+0000","last_fullsized":"2024-04-26T12:32:16.099526+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:03.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.130791+0000","last_change":"2024-04-26T12:32:16.109433+0000","last_active":"2024-04-26T12:32:17.130791+0000","last_peered":"2024-04-26T12:32:17.130791+0000","last_clean":"2024-04-26T12:32:17.130791+0000","last_became_active":"2024-04-26T12:32:16.109171+0000","last_became_peered":"2024-04-26T12:32:16.109171+0000","last_unstale":"2024-04-26T12:32:17.130791+0000","last_undegraded":"2024-04-26T12:32:17.130791+0000","last_fullsized":"2024-04-26T12:32:17.130791+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100916+0000","last_change":"2024-04-26T12:30:32.156280+0000","last_active":"2024-04-26T12:32:16.100916+0000","last_peered":"2024-04-26T12:32:16.100916+0000","last_clean":"2024-04-26T12:32:16.100916+0000","last_became_active":"2024-04-26T12:30:32.155665+0000","last_became_peered":"2024-04-26T12:30:32.155665+0000","last_unstale":"2024-04-26T12:32:16.100916+0000","last_undegraded":"2024-04-26T12:32:16.100916+0000","last_fullsized":"2024-04-26T12:32:16.100916+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:37.767104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.099603+0000","last_change":"2024-04-26T12:30:32.612456+0000","last_active":"2024-04-26T12:32:16.099603+0000","last_peered":"2024-04-26T12:32:16.099603+0000","last_clean":"2024-04-26T12:32:16.099603+0000","last_became_active":"2024-04-26T12:30:32.612111+0000","last_became_peered":"2024-04-26T12:30:32.612111+0000","last_unstale":"2024-04-26T12:32:16.099603+0000","last_undegraded":"2024-04-26T12:32:16.099603+0000","last_fullsized":"2024-04-26T12:32:16.099603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.101643+0000","last_change":"2024-04-26T12:31:07.233093+0000","last_active":"2024-04-26T12:32:16.101643+0000","last_peered":"2024-04-26T12:32:16.101643+0000","last_clean":"2024-04-26T12:32:16.101643+0000","last_became_active":"2024-04-26T12:31:07.232858+0000","last_became_peered":"2024-04-26T12:31:07.232858+0000","last_unstale":"2024-04-26T12:32:16.101643+0000","last_undegraded":"2024-04-26T12:32:16.101643+0000","last_fullsized":"2024-04-26T12:32:16.101643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:42.889139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"54'138","reported_seq":185,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.006820+0000","last_change":"2024-04-26T12:30:32.613069+0000","last_active":"2024-04-26T12:32:20.006820+0000","last_peered":"2024-04-26T12:32:20.006820+0000","last_clean":"2024-04-26T12:32:20.006820+0000","last_became_active":"2024-04-26T12:30:32.612744+0000","last_became_peered":"2024-04-26T12:30:32.612744+0000","last_unstale":"2024-04-26T12:32:20.006820+0000","last_undegraded":"2024-04-26T12:32:20.006820+0000","last_fullsized":"2024-04-26T12:32:20.006820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:42.575341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":14048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.130197+0000","last_change":"2024-04-26T12:32:16.109604+0000","last_active":"2024-04-26T12:32:17.130197+0000","last_peered":"2024-04-26T12:32:17.130197+0000","last_clean":"2024-04-26T12:32:17.130197+0000","last_became_active":"2024-04-26T12:32:16.109232+0000","last_became_peered":"2024-04-26T12:32:16.109232+0000","last_unstale":"2024-04-26T12:32:17.130197+0000","last_undegraded":"2024-04-26T12:32:17.130197+0000","last_fullsized":"2024-04-26T12:32:17.130197+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:08.819922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"54'96","reported_seq":143,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.006399+0000","last_change":"2024-04-26T12:30:32.613309+0000","last_active":"2024-04-26T12:32:20.006399+0000","last_peered":"2024-04-26T12:32:20.006399+0000","last_clean":"2024-04-26T12:32:20.006399+0000","last_became_active":"2024-04-26T12:30:32.612108+0000","last_became_peered":"2024-04-26T12:30:32.612108+0000","last_unstale":"2024-04-26T12:32:20.006399+0000","last_undegraded":"2024-04-26T12:32:20.006399+0000","last_fullsized":"2024-04-26T12:32:20.006399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8391632,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":9291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"54'24","reported_seq":74,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:18.265727+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:32:18.265727+0000","last_peered":"2024-04-26T12:32:18.265727+0000","last_clean":"2024-04-26T12:32:18.265727+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:32:18.265727+0000","last_undegraded":"2024-04-26T12:32:18.265727+0000","last_fullsized":"2024-04-26T12:32:18.265727+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57415,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"54'91","reported_seq":140,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.976847+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:32:19.976847+0000","last_peered":"2024-04-26T12:32:19.976847+0000","last_clean":"2024-04-26T12:32:19.976847+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:32:19.976847+0000","last_undegraded":"2024-04-26T12:32:19.976847+0000","last_fullsized":"2024-04-26T12:32:19.976847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":9392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105765+0000","last_change":"2024-04-26T12:30:32.163457+0000","last_active":"2024-04-26T12:32:16.105765+0000","last_peered":"2024-04-26T12:32:16.105765+0000","last_clean":"2024-04-26T12:32:16.105765+0000","last_became_active":"2024-04-26T12:30:32.163083+0000","last_became_peered":"2024-04-26T12:30:32.163083+0000","last_unstale":"2024-04-26T12:32:16.105765+0000","last_undegraded":"2024-04-26T12:32:16.105765+0000","last_fullsized":"2024-04-26T12:32:16.105765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:47.302913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"54'49","reported_seq":102,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.006703+0000","last_change":"2024-04-26T12:32:16.103999+0000","last_active":"2024-04-26T12:32:20.006703+0000","last_peered":"2024-04-26T12:32:20.006703+0000","last_clean":"2024-04-26T12:32:20.006703+0000","last_became_active":"2024-04-26T12:32:16.103567+0000","last_became_peered":"2024-04-26T12:32:16.103567+0000","last_unstale":"2024-04-26T12:32:20.006703+0000","last_undegraded":"2024-04-26T12:32:20.006703+0000","last_fullsized":"2024-04-26T12:32:20.006703+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:59.736253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":4684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.099811+0000","last_change":"2024-04-26T12:30:32.155965+0000","last_active":"2024-04-26T12:32:16.099811+0000","last_peered":"2024-04-26T12:32:16.099811+0000","last_clean":"2024-04-26T12:32:16.099811+0000","last_became_active":"2024-04-26T12:30:32.154438+0000","last_became_peered":"2024-04-26T12:30:32.154438+0000","last_unstale":"2024-04-26T12:32:16.099811+0000","last_undegraded":"2024-04-26T12:32:16.099811+0000","last_fullsized":"2024-04-26T12:32:16.099811+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:51.915443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"54'52","reported_seq":64,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.990844+0000","last_change":"2024-04-26T12:32:16.110288+0000","last_active":"2024-04-26T12:32:19.990844+0000","last_peered":"2024-04-26T12:32:19.990844+0000","last_clean":"2024-04-26T12:32:19.990844+0000","last_became_active":"2024-04-26T12:32:16.103433+0000","last_became_peered":"2024-04-26T12:32:16.103433+0000","last_unstale":"2024-04-26T12:32:19.990844+0000","last_undegraded":"2024-04-26T12:32:19.990844+0000","last_fullsized":"2024-04-26T12:32:19.990844+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:51.085464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":4712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.129624+0000","last_change":"2024-04-26T12:32:16.107025+0000","last_active":"2024-04-26T12:32:17.129624+0000","last_peered":"2024-04-26T12:32:17.129624+0000","last_clean":"2024-04-26T12:32:17.129624+0000","last_became_active":"2024-04-26T12:32:16.106307+0000","last_became_peered":"2024-04-26T12:32:16.106307+0000","last_unstale":"2024-04-26T12:32:17.129624+0000","last_undegraded":"2024-04-26T12:32:17.129624+0000","last_fullsized":"2024-04-26T12:32:17.129624+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:31.214495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.101716+0000","last_change":"2024-04-26T12:30:32.611084+0000","last_active":"2024-04-26T12:32:16.101716+0000","last_peered":"2024-04-26T12:32:16.101716+0000","last_clean":"2024-04-26T12:32:16.101716+0000","last_became_active":"2024-04-26T12:30:32.610731+0000","last_became_peered":"2024-04-26T12:30:32.610731+0000","last_unstale":"2024-04-26T12:32:16.101716+0000","last_undegraded":"2024-04-26T12:32:16.101716+0000","last_fullsized":"2024-04-26T12:32:16.101716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105048+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:32:16.105048+0000","last_peered":"2024-04-26T12:32:16.105048+0000","last_clean":"2024-04-26T12:32:16.105048+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:32:16.105048+0000","last_undegraded":"2024-04-26T12:32:16.105048+0000","last_fullsized":"2024-04-26T12:32:16.105048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"54'53","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.931379+0000","last_change":"2024-04-26T12:30:32.613572+0000","last_active":"2024-04-26T12:32:19.931379+0000","last_peered":"2024-04-26T12:32:19.931379+0000","last_clean":"2024-04-26T12:32:19.931379+0000","last_became_active":"2024-04-26T12:30:32.613081+0000","last_became_peered":"2024-04-26T12:30:32.613081+0000","last_unstale":"2024-04-26T12:32:19.931379+0000","last_undegraded":"2024-04-26T12:32:19.931379+0000","last_fullsized":"2024-04-26T12:32:19.931379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":4724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105338+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:32:16.105338+0000","last_peered":"2024-04-26T12:32:16.105338+0000","last_clean":"2024-04-26T12:32:16.105338+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:32:16.105338+0000","last_undegraded":"2024-04-26T12:32:16.105338+0000","last_fullsized":"2024-04-26T12:32:16.105338+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"54'47","reported_seq":59,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.005224+0000","last_change":"2024-04-26T12:32:16.109694+0000","last_active":"2024-04-26T12:32:20.005224+0000","last_peered":"2024-04-26T12:32:20.005224+0000","last_clean":"2024-04-26T12:32:20.005224+0000","last_became_active":"2024-04-26T12:32:16.109070+0000","last_became_peered":"2024-04-26T12:32:16.109070+0000","last_unstale":"2024-04-26T12:32:20.005224+0000","last_undegraded":"2024-04-26T12:32:20.005224+0000","last_fullsized":"2024-04-26T12:32:20.005224+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:54.733914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":4652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":50,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.102483+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:32:16.102483+0000","last_peered":"2024-04-26T12:32:16.102483+0000","last_clean":"2024-04-26T12:32:16.102483+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:32:16.102483+0000","last_undegraded":"2024-04-26T12:32:16.102483+0000","last_fullsized":"2024-04-26T12:32:16.102483+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.128818+0000","last_change":"2024-04-26T12:32:16.105174+0000","last_active":"2024-04-26T12:32:17.128818+0000","last_peered":"2024-04-26T12:32:17.128818+0000","last_clean":"2024-04-26T12:32:17.128818+0000","last_became_active":"2024-04-26T12:32:16.103868+0000","last_became_peered":"2024-04-26T12:32:16.103868+0000","last_unstale":"2024-04-26T12:32:17.128818+0000","last_undegraded":"2024-04-26T12:32:17.128818+0000","last_fullsized":"2024-04-26T12:32:17.128818+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:13.330711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.102963+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:32:16.102963+0000","last_peered":"2024-04-26T12:32:16.102963+0000","last_clean":"2024-04-26T12:32:16.102963+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:32:16.102963+0000","last_undegraded":"2024-04-26T12:32:16.102963+0000","last_fullsized":"2024-04-26T12:32:16.102963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"54'46","reported_seq":95,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.905369+0000","last_change":"2024-04-26T12:30:32.616983+0000","last_active":"2024-04-26T12:32:19.905369+0000","last_peered":"2024-04-26T12:32:19.905369+0000","last_clean":"2024-04-26T12:32:19.905369+0000","last_became_active":"2024-04-26T12:30:32.615825+0000","last_became_peered":"2024-04-26T12:30:32.615825+0000","last_unstale":"2024-04-26T12:32:19.905369+0000","last_undegraded":"2024-04-26T12:32:19.905369+0000","last_fullsized":"2024-04-26T12:32:19.905369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:20.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":4652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":50,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105078+0000","last_change":"2024-04-26T12:30:32.163506+0000","last_active":"2024-04-26T12:32:16.105078+0000","last_peered":"2024-04-26T12:32:16.105078+0000","last_clean":"2024-04-26T12:32:16.105078+0000","last_became_active":"2024-04-26T12:30:32.163080+0000","last_became_peered":"2024-04-26T12:30:32.163080+0000","last_unstale":"2024-04-26T12:32:16.105078+0000","last_undegraded":"2024-04-26T12:32:16.105078+0000","last_fullsized":"2024-04-26T12:32:16.105078+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:48.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100948+0000","last_change":"2024-04-26T12:30:32.616350+0000","last_active":"2024-04-26T12:32:16.100948+0000","last_peered":"2024-04-26T12:32:16.100948+0000","last_clean":"2024-04-26T12:32:16.100948+0000","last_became_active":"2024-04-26T12:30:32.616046+0000","last_became_peered":"2024-04-26T12:30:32.616046+0000","last_unstale":"2024-04-26T12:32:16.100948+0000","last_undegraded":"2024-04-26T12:32:16.100948+0000","last_fullsized":"2024-04-26T12:32:16.100948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":50,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100896+0000","last_change":"2024-04-26T12:30:32.157727+0000","last_active":"2024-04-26T12:32:16.100896+0000","last_peered":"2024-04-26T12:32:16.100896+0000","last_clean":"2024-04-26T12:32:16.100896+0000","last_became_active":"2024-04-26T12:30:32.155229+0000","last_became_peered":"2024-04-26T12:30:32.155229+0000","last_unstale":"2024-04-26T12:32:16.100896+0000","last_undegraded":"2024-04-26T12:32:16.100896+0000","last_fullsized":"2024-04-26T12:32:16.100896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:05.208774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"54'47","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.992655+0000","last_change":"2024-04-26T12:30:32.619977+0000","last_active":"2024-04-26T12:32:19.992655+0000","last_peered":"2024-04-26T12:32:19.992655+0000","last_clean":"2024-04-26T12:32:19.992655+0000","last_became_active":"2024-04-26T12:30:32.618249+0000","last_became_peered":"2024-04-26T12:30:32.618249+0000","last_unstale":"2024-04-26T12:32:19.992655+0000","last_undegraded":"2024-04-26T12:32:19.992655+0000","last_fullsized":"2024-04-26T12:32:19.992655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:21.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":4668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":50,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105105+0000","last_change":"2024-04-26T12:30:32.162784+0000","last_active":"2024-04-26T12:32:16.105105+0000","last_peered":"2024-04-26T12:32:16.105105+0000","last_clean":"2024-04-26T12:32:16.105105+0000","last_became_active":"2024-04-26T12:30:32.162503+0000","last_became_peered":"2024-04-26T12:30:32.162503+0000","last_unstale":"2024-04-26T12:32:16.105105+0000","last_undegraded":"2024-04-26T12:32:16.105105+0000","last_fullsized":"2024-04-26T12:32:16.105105+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"54'47","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.965445+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:32:19.965445+0000","last_peered":"2024-04-26T12:32:19.965445+0000","last_clean":"2024-04-26T12:32:19.965445+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:32:19.965445+0000","last_undegraded":"2024-04-26T12:32:19.965445+0000","last_fullsized":"2024-04-26T12:32:19.965445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.129984+0000","last_change":"2024-04-26T12:32:16.109449+0000","last_active":"2024-04-26T12:32:17.129984+0000","last_peered":"2024-04-26T12:32:17.129984+0000","last_clean":"2024-04-26T12:32:17.129984+0000","last_became_active":"2024-04-26T12:32:16.109131+0000","last_became_peered":"2024-04-26T12:32:16.109131+0000","last_unstale":"2024-04-26T12:32:17.129984+0000","last_undegraded":"2024-04-26T12:32:17.129984+0000","last_fullsized":"2024-04-26T12:32:17.129984+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:47.757728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"54'50","reported_seq":99,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.968762+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:32:19.968762+0000","last_peered":"2024-04-26T12:32:19.968762+0000","last_clean":"2024-04-26T12:32:19.968762+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:32:19.968762+0000","last_undegraded":"2024-04-26T12:32:19.968762+0000","last_fullsized":"2024-04-26T12:32:19.968762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":4692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.128962+0000","last_change":"2024-04-26T12:32:16.104785+0000","last_active":"2024-04-26T12:32:17.128962+0000","last_peered":"2024-04-26T12:32:17.128962+0000","last_clean":"2024-04-26T12:32:17.128962+0000","last_became_active":"2024-04-26T12:32:16.104255+0000","last_became_peered":"2024-04-26T12:32:16.104255+0000","last_unstale":"2024-04-26T12:32:17.128962+0000","last_undegraded":"2024-04-26T12:32:17.128962+0000","last_fullsized":"2024-04-26T12:32:17.128962+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:54.507373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"54'139","reported_seq":186,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.999349+0000","last_change":"2024-04-26T12:30:32.615411+0000","last_active":"2024-04-26T12:32:19.999349+0000","last_peered":"2024-04-26T12:32:19.999349+0000","last_clean":"2024-04-26T12:32:19.999349+0000","last_became_active":"2024-04-26T12:30:32.614811+0000","last_became_peered":"2024-04-26T12:30:32.614811+0000","last_unstale":"2024-04-26T12:32:19.999349+0000","last_undegraded":"2024-04-26T12:32:19.999349+0000","last_fullsized":"2024-04-26T12:32:19.999349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:41.894585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":14072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100831+0000","last_change":"2024-04-26T12:30:26.796425+0000","last_active":"2024-04-26T12:32:16.100831+0000","last_peered":"2024-04-26T12:32:16.100831+0000","last_clean":"2024-04-26T12:32:16.100831+0000","last_became_active":"2024-04-26T12:30:26.796142+0000","last_became_peered":"2024-04-26T12:30:26.796142+0000","last_unstale":"2024-04-26T12:32:16.100831+0000","last_undegraded":"2024-04-26T12:32:16.100831+0000","last_fullsized":"2024-04-26T12:32:16.100831+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:52.342003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":50,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105447+0000","last_change":"2024-04-26T12:30:32.163523+0000","last_active":"2024-04-26T12:32:16.105447+0000","last_peered":"2024-04-26T12:32:16.105447+0000","last_clean":"2024-04-26T12:32:16.105447+0000","last_became_active":"2024-04-26T12:30:32.163032+0000","last_became_peered":"2024-04-26T12:30:32.163032+0000","last_unstale":"2024-04-26T12:32:16.105447+0000","last_undegraded":"2024-04-26T12:32:16.105447+0000","last_fullsized":"2024-04-26T12:32:16.105447+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.129606+0000","last_change":"2024-04-26T12:32:16.107013+0000","last_active":"2024-04-26T12:32:17.129606+0000","last_peered":"2024-04-26T12:32:17.129606+0000","last_clean":"2024-04-26T12:32:17.129606+0000","last_became_active":"2024-04-26T12:32:16.106306+0000","last_became_peered":"2024-04-26T12:32:16.106306+0000","last_unstale":"2024-04-26T12:32:17.129606+0000","last_undegraded":"2024-04-26T12:32:17.129606+0000","last_fullsized":"2024-04-26T12:32:17.129606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:34.079328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105291+0000","last_change":"2024-04-26T12:30:26.802787+0000","last_active":"2024-04-26T12:32:16.105291+0000","last_peered":"2024-04-26T12:32:16.105291+0000","last_clean":"2024-04-26T12:32:16.105291+0000","last_became_active":"2024-04-26T12:30:26.802392+0000","last_became_peered":"2024-04-26T12:30:26.802392+0000","last_unstale":"2024-04-26T12:32:16.105291+0000","last_undegraded":"2024-04-26T12:32:16.105291+0000","last_fullsized":"2024-04-26T12:32:16.105291+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:21.151983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":50,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105675+0000","last_change":"2024-04-26T12:30:32.163476+0000","last_active":"2024-04-26T12:32:16.105675+0000","last_peered":"2024-04-26T12:32:16.105675+0000","last_clean":"2024-04-26T12:32:16.105675+0000","last_became_active":"2024-04-26T12:30:32.162992+0000","last_became_peered":"2024-04-26T12:30:32.162992+0000","last_unstale":"2024-04-26T12:32:16.105675+0000","last_undegraded":"2024-04-26T12:32:16.105675+0000","last_fullsized":"2024-04-26T12:32:16.105675+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.434738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100796+0000","last_change":"2024-04-26T12:30:32.614747+0000","last_active":"2024-04-26T12:32:16.100796+0000","last_peered":"2024-04-26T12:32:16.100796+0000","last_clean":"2024-04-26T12:32:16.100796+0000","last_became_active":"2024-04-26T12:30:32.614230+0000","last_became_peered":"2024-04-26T12:30:32.614230+0000","last_unstale":"2024-04-26T12:32:16.100796+0000","last_undegraded":"2024-04-26T12:32:16.100796+0000","last_fullsized":"2024-04-26T12:32:16.100796+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.729754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100057+0000","last_change":"2024-04-26T12:30:26.796504+0000","last_active":"2024-04-26T12:32:16.100057+0000","last_peered":"2024-04-26T12:32:16.100057+0000","last_clean":"2024-04-26T12:32:16.100057+0000","last_became_active":"2024-04-26T12:30:26.796175+0000","last_became_peered":"2024-04-26T12:30:26.796175+0000","last_unstale":"2024-04-26T12:32:16.100057+0000","last_undegraded":"2024-04-26T12:32:16.100057+0000","last_fullsized":"2024-04-26T12:32:16.100057+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:01.603592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.102229+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:32:16.102229+0000","last_peered":"2024-04-26T12:32:16.102229+0000","last_clean":"2024-04-26T12:32:16.102229+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:32:16.102229+0000","last_undegraded":"2024-04-26T12:32:16.102229+0000","last_fullsized":"2024-04-26T12:32:16.102229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.101001+0000","last_change":"2024-04-26T12:30:32.615541+0000","last_active":"2024-04-26T12:32:16.101001+0000","last_peered":"2024-04-26T12:32:16.101001+0000","last_clean":"2024-04-26T12:32:16.101001+0000","last_became_active":"2024-04-26T12:30:32.614786+0000","last_became_peered":"2024-04-26T12:30:32.614786+0000","last_unstale":"2024-04-26T12:32:16.101001+0000","last_undegraded":"2024-04-26T12:32:16.101001+0000","last_fullsized":"2024-04-26T12:32:16.101001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:51.823060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105709+0000","last_change":"2024-04-26T12:30:26.802789+0000","last_active":"2024-04-26T12:32:16.105709+0000","last_peered":"2024-04-26T12:32:16.105709+0000","last_clean":"2024-04-26T12:32:16.105709+0000","last_became_active":"2024-04-26T12:30:26.802475+0000","last_became_peered":"2024-04-26T12:30:26.802475+0000","last_unstale":"2024-04-26T12:32:16.105709+0000","last_undegraded":"2024-04-26T12:32:16.105709+0000","last_fullsized":"2024-04-26T12:32:16.105709+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:40.093193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":249,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.104889+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:32:16.104889+0000","last_peered":"2024-04-26T12:32:16.104889+0000","last_clean":"2024-04-26T12:32:16.104889+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:32:16.104889+0000","last_undegraded":"2024-04-26T12:32:16.104889+0000","last_fullsized":"2024-04-26T12:32:16.104889+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.099699+0000","last_change":"2024-04-26T12:30:32.154321+0000","last_active":"2024-04-26T12:32:16.099699+0000","last_peered":"2024-04-26T12:32:16.099699+0000","last_clean":"2024-04-26T12:32:16.099699+0000","last_became_active":"2024-04-26T12:30:32.153635+0000","last_became_peered":"2024-04-26T12:30:32.153635+0000","last_unstale":"2024-04-26T12:32:16.099699+0000","last_undegraded":"2024-04-26T12:32:16.099699+0000","last_fullsized":"2024-04-26T12:32:16.099699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.111607+0000","last_change":"2024-04-26T12:32:16.106958+0000","last_active":"2024-04-26T12:32:16.111607+0000","last_peered":"2024-04-26T12:32:16.111607+0000","last_clean":"2024-04-26T12:32:16.111607+0000","last_became_active":"2024-04-26T12:32:16.106262+0000","last_became_peered":"2024-04-26T12:32:16.106262+0000","last_unstale":"2024-04-26T12:32:16.111607+0000","last_undegraded":"2024-04-26T12:32:16.111607+0000","last_fullsized":"2024-04-26T12:32:16.111607+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:33.467447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.104882+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:32:16.104882+0000","last_peered":"2024-04-26T12:32:16.104882+0000","last_clean":"2024-04-26T12:32:16.104882+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:32:16.104882+0000","last_undegraded":"2024-04-26T12:32:16.104882+0000","last_fullsized":"2024-04-26T12:32:16.104882+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100068+0000","last_change":"2024-04-26T12:30:32.156315+0000","last_active":"2024-04-26T12:32:16.100068+0000","last_peered":"2024-04-26T12:32:16.100068+0000","last_clean":"2024-04-26T12:32:16.100068+0000","last_became_active":"2024-04-26T12:30:32.155709+0000","last_became_peered":"2024-04-26T12:30:32.155709+0000","last_unstale":"2024-04-26T12:32:16.100068+0000","last_undegraded":"2024-04-26T12:32:16.100068+0000","last_fullsized":"2024-04-26T12:32:16.100068+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.873623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"54'177","reported_seq":231,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.006659+0000","last_change":"2024-04-26T12:32:16.104477+0000","last_active":"2024-04-26T12:32:20.006659+0000","last_peered":"2024-04-26T12:32:20.006659+0000","last_clean":"2024-04-26T12:32:20.006659+0000","last_became_active":"2024-04-26T12:32:16.103515+0000","last_became_peered":"2024-04-26T12:32:16.103515+0000","last_unstale":"2024-04-26T12:32:20.006659+0000","last_undegraded":"2024-04-26T12:32:20.006659+0000","last_fullsized":"2024-04-26T12:32:20.006659+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.146898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":18604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.129299+0000","last_change":"2024-04-26T12:32:16.110788+0000","last_active":"2024-04-26T12:32:17.129299+0000","last_peered":"2024-04-26T12:32:17.129299+0000","last_clean":"2024-04-26T12:32:17.129299+0000","last_became_active":"2024-04-26T12:32:16.110540+0000","last_became_peered":"2024-04-26T12:32:16.110540+0000","last_unstale":"2024-04-26T12:32:17.129299+0000","last_undegraded":"2024-04-26T12:32:17.129299+0000","last_fullsized":"2024-04-26T12:32:17.129299+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:24.906021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100565+0000","last_change":"2024-04-26T12:30:32.154741+0000","last_active":"2024-04-26T12:32:16.100565+0000","last_peered":"2024-04-26T12:32:16.100565+0000","last_clean":"2024-04-26T12:32:16.100565+0000","last_became_active":"2024-04-26T12:30:32.154369+0000","last_became_peered":"2024-04-26T12:30:32.154369+0000","last_unstale":"2024-04-26T12:32:16.100565+0000","last_undegraded":"2024-04-26T12:32:16.100565+0000","last_fullsized":"2024-04-26T12:32:16.100565+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"54'33","reported_seq":87,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.008266+0000","last_change":"2024-04-26T12:32:16.109669+0000","last_active":"2024-04-26T12:32:20.008266+0000","last_peered":"2024-04-26T12:32:20.008266+0000","last_clean":"2024-04-26T12:32:20.008266+0000","last_became_active":"2024-04-26T12:32:16.109328+0000","last_became_peered":"2024-04-26T12:32:16.109328+0000","last_unstale":"2024-04-26T12:32:20.008266+0000","last_undegraded":"2024-04-26T12:32:20.008266+0000","last_fullsized":"2024-04-26T12:32:20.008266+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:32.967100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":4596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":50,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100852+0000","last_change":"2024-04-26T12:30:32.154394+0000","last_active":"2024-04-26T12:32:16.100852+0000","last_peered":"2024-04-26T12:32:16.100852+0000","last_clean":"2024-04-26T12:32:16.100852+0000","last_became_active":"2024-04-26T12:30:32.153845+0000","last_became_peered":"2024-04-26T12:30:32.153845+0000","last_unstale":"2024-04-26T12:32:16.100852+0000","last_undegraded":"2024-04-26T12:32:16.100852+0000","last_fullsized":"2024-04-26T12:32:16.100852+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:47.595640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.101663+0000","last_change":"2024-04-26T12:30:26.795164+0000","last_active":"2024-04-26T12:32:16.101663+0000","last_peered":"2024-04-26T12:32:16.101663+0000","last_clean":"2024-04-26T12:32:16.101663+0000","last_became_active":"2024-04-26T12:30:26.794912+0000","last_became_peered":"2024-04-26T12:30:26.794912+0000","last_unstale":"2024-04-26T12:32:16.101663+0000","last_undegraded":"2024-04-26T12:32:16.101663+0000","last_fullsized":"2024-04-26T12:32:16.101663+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:03.771153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.099696+0000","last_change":"2024-04-26T12:30:32.607196+0000","last_active":"2024-04-26T12:32:16.099696+0000","last_peered":"2024-04-26T12:32:16.099696+0000","last_clean":"2024-04-26T12:32:16.099696+0000","last_became_active":"2024-04-26T12:30:32.606825+0000","last_became_peered":"2024-04-26T12:30:32.606825+0000","last_unstale":"2024-04-26T12:32:16.099696+0000","last_undegraded":"2024-04-26T12:32:16.099696+0000","last_fullsized":"2024-04-26T12:32:16.099696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105381+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:32:16.105381+0000","last_peered":"2024-04-26T12:32:16.105381+0000","last_clean":"2024-04-26T12:32:16.105381+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:32:16.105381+0000","last_undegraded":"2024-04-26T12:32:16.105381+0000","last_fullsized":"2024-04-26T12:32:16.105381+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"50'4","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.101750+0000","last_change":"2024-04-26T12:30:32.157135+0000","last_active":"2024-04-26T12:32:16.101750+0000","last_peered":"2024-04-26T12:32:16.101750+0000","last_clean":"2024-04-26T12:32:16.101750+0000","last_became_active":"2024-04-26T12:30:32.154655+0000","last_became_peered":"2024-04-26T12:30:32.154655+0000","last_unstale":"2024-04-26T12:32:16.101750+0000","last_undegraded":"2024-04-26T12:32:16.101750+0000","last_fullsized":"2024-04-26T12:32:16.101750+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.344633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.102718+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:32:16.102718+0000","last_peered":"2024-04-26T12:32:16.102718+0000","last_clean":"2024-04-26T12:32:16.102718+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:32:16.102718+0000","last_undegraded":"2024-04-26T12:32:16.102718+0000","last_fullsized":"2024-04-26T12:32:16.102718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.129966+0000","last_change":"2024-04-26T12:32:16.110117+0000","last_active":"2024-04-26T12:32:17.129966+0000","last_peered":"2024-04-26T12:32:17.129966+0000","last_clean":"2024-04-26T12:32:17.129966+0000","last_became_active":"2024-04-26T12:32:16.109893+0000","last_became_peered":"2024-04-26T12:32:16.109893+0000","last_unstale":"2024-04-26T12:32:17.129966+0000","last_undegraded":"2024-04-26T12:32:17.129966+0000","last_fullsized":"2024-04-26T12:32:17.129966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:18.025832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"54'48","reported_seq":60,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.977239+0000","last_change":"2024-04-26T12:32:16.103513+0000","last_active":"2024-04-26T12:32:19.977239+0000","last_peered":"2024-04-26T12:32:19.977239+0000","last_clean":"2024-04-26T12:32:19.977239+0000","last_became_active":"2024-04-26T12:32:16.103233+0000","last_became_peered":"2024-04-26T12:32:16.103233+0000","last_unstale":"2024-04-26T12:32:19.977239+0000","last_undegraded":"2024-04-26T12:32:19.977239+0000","last_fullsized":"2024-04-26T12:32:19.977239+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:11.295543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":4668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105182+0000","last_change":"2024-04-26T12:30:32.162739+0000","last_active":"2024-04-26T12:32:16.105182+0000","last_peered":"2024-04-26T12:32:16.105182+0000","last_clean":"2024-04-26T12:32:16.105182+0000","last_became_active":"2024-04-26T12:30:32.162500+0000","last_became_peered":"2024-04-26T12:30:32.162500+0000","last_unstale":"2024-04-26T12:32:16.105182+0000","last_undegraded":"2024-04-26T12:32:16.105182+0000","last_fullsized":"2024-04-26T12:32:16.105182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:12.872800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"54'39","reported_seq":88,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.973864+0000","last_change":"2024-04-26T12:30:32.615884+0000","last_active":"2024-04-26T12:32:19.973864+0000","last_peered":"2024-04-26T12:32:19.973864+0000","last_clean":"2024-04-26T12:32:19.973864+0000","last_became_active":"2024-04-26T12:30:32.615111+0000","last_became_peered":"2024-04-26T12:30:32.615111+0000","last_unstale":"2024-04-26T12:32:19.973864+0000","last_undegraded":"2024-04-26T12:32:19.973864+0000","last_fullsized":"2024-04-26T12:32:19.973864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:49.836324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":20,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:17.130269+0000","last_change":"2024-04-26T12:32:16.110008+0000","last_active":"2024-04-26T12:32:17.130269+0000","last_peered":"2024-04-26T12:32:17.130269+0000","last_clean":"2024-04-26T12:32:17.130269+0000","last_became_active":"2024-04-26T12:32:16.109548+0000","last_became_peered":"2024-04-26T12:32:16.109548+0000","last_unstale":"2024-04-26T12:32:17.130269+0000","last_undegraded":"2024-04-26T12:32:17.130269+0000","last_fullsized":"2024-04-26T12:32:17.130269+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:54.045578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105178+0000","last_change":"2024-04-26T12:30:32.614309+0000","last_active":"2024-04-26T12:32:16.105178+0000","last_peered":"2024-04-26T12:32:16.105178+0000","last_clean":"2024-04-26T12:32:16.105178+0000","last_became_active":"2024-04-26T12:30:32.613915+0000","last_became_peered":"2024-04-26T12:30:32.613915+0000","last_unstale":"2024-04-26T12:32:16.105178+0000","last_undegraded":"2024-04-26T12:32:16.105178+0000","last_fullsized":"2024-04-26T12:32:16.105178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:56:47.316450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.101815+0000","last_change":"2024-04-26T12:30:32.153907+0000","last_active":"2024-04-26T12:32:16.101815+0000","last_peered":"2024-04-26T12:32:16.101815+0000","last_clean":"2024-04-26T12:32:16.101815+0000","last_became_active":"2024-04-26T12:30:32.153547+0000","last_became_peered":"2024-04-26T12:30:32.153547+0000","last_unstale":"2024-04-26T12:32:16.101815+0000","last_undegraded":"2024-04-26T12:32:16.101815+0000","last_fullsized":"2024-04-26T12:32:16.101815+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"54'103","reported_seq":156,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:20.008131+0000","last_change":"2024-04-26T12:32:16.103889+0000","last_active":"2024-04-26T12:32:20.008131+0000","last_peered":"2024-04-26T12:32:20.008131+0000","last_clean":"2024-04-26T12:32:20.008131+0000","last_became_active":"2024-04-26T12:32:16.103554+0000","last_became_peered":"2024-04-26T12:32:16.103554+0000","last_unstale":"2024-04-26T12:32:20.008131+0000","last_undegraded":"2024-04-26T12:32:20.008131+0000","last_fullsized":"2024-04-26T12:32:20.008131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:55.731876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":9440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.100907+0000","last_change":"2024-04-26T12:30:32.155718+0000","last_active":"2024-04-26T12:32:16.100907+0000","last_peered":"2024-04-26T12:32:16.100907+0000","last_clean":"2024-04-26T12:32:16.100907+0000","last_became_active":"2024-04-26T12:30:32.154179+0000","last_became_peered":"2024-04-26T12:30:32.154179+0000","last_unstale":"2024-04-26T12:32:16.100907+0000","last_undegraded":"2024-04-26T12:32:16.100907+0000","last_fullsized":"2024-04-26T12:32:16.100907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:17.342885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"54'52","reported_seq":101,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.980256+0000","last_change":"2024-04-26T12:30:32.620419+0000","last_active":"2024-04-26T12:32:19.980256+0000","last_peered":"2024-04-26T12:32:19.980256+0000","last_clean":"2024-04-26T12:32:19.980256+0000","last_became_active":"2024-04-26T12:30:32.618796+0000","last_became_peered":"2024-04-26T12:30:32.618796+0000","last_unstale":"2024-04-26T12:32:19.980256+0000","last_undegraded":"2024-04-26T12:32:19.980256+0000","last_fullsized":"2024-04-26T12:32:19.980256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:16.811324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":4688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.105057+0000","last_change":"2024-04-26T12:30:32.620177+0000","last_active":"2024-04-26T12:32:16.105057+0000","last_peered":"2024-04-26T12:32:16.105057+0000","last_clean":"2024-04-26T12:32:16.105057+0000","last_became_active":"2024-04-26T12:30:32.617717+0000","last_became_peered":"2024-04-26T12:30:32.617717+0000","last_unstale":"2024-04-26T12:32:16.105057+0000","last_undegraded":"2024-04-26T12:32:16.105057+0000","last_fullsized":"2024-04-26T12:32:16.105057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:42.229049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-26T12:32:16.099954+0000","last_change":"2024-04-26T12:30:32.615057+0000","last_active":"2024-04-26T12:32:16.099954+0000","last_peered":"2024-04-26T12:32:16.099954+0000","last_clean":"2024-04-26T12:32:16.099954+0000","last_became_active":"2024-04-26T12:30:32.614612+0000","last_became_peered":"2024-04-26T12:30:32.614612+0000","last_unstale":"2024-04-26T12:32:16.099954+0000","last_undegraded":"2024-04-26T12:32:16.099954+0000","last_fullsized":"2024-04-26T12:32:16.099954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:24.492054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"54'50","reported_seq":62,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.989997+0000","last_change":"2024-04-26T12:32:16.107224+0000","last_active":"2024-04-26T12:32:19.989997+0000","last_peered":"2024-04-26T12:32:19.989997+0000","last_clean":"2024-04-26T12:32:19.989997+0000","last_became_active":"2024-04-26T12:32:16.106255+0000","last_became_peered":"2024-04-26T12:32:16.106255+0000","last_unstale":"2024-04-26T12:32:19.989997+0000","last_undegraded":"2024-04-26T12:32:19.989997+0000","last_fullsized":"2024-04-26T12:32:19.989997+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:01.140990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"54'49","reported_seq":96,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.974401+0000","last_change":"2024-04-26T12:30:32.613127+0000","last_active":"2024-04-26T12:32:19.974401+0000","last_peered":"2024-04-26T12:32:19.974401+0000","last_clean":"2024-04-26T12:32:19.974401+0000","last_became_active":"2024-04-26T12:30:32.612123+0000","last_became_peered":"2024-04-26T12:30:32.612123+0000","last_unstale":"2024-04-26T12:32:19.974401+0000","last_undegraded":"2024-04-26T12:32:19.974401+0000","last_fullsized":"2024-04-26T12:32:19.974401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":4700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"54'53","reported_seq":100,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T12:32:19.974276+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:32:19.974276+0000","last_peered":"2024-04-26T12:32:19.974276+0000","last_clean":"2024-04-26T12:32:19.974276+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:32:19.974276+0000","last_undegraded":"2024-04-26T12:32:19.974276+0000","last_fullsized":"2024-04-26T12:32:19.974276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":4740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":269513488,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8767,"num_write_kb":300922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101945344,"data_stored":539021490,"data_compressed":326192,"data_compressed_allocated":37027840,"data_compressed_original":474116096,"omap_allocated":0,"internal_metadata":0},"log_size":3011,"ondisk_log_size":3011,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":58213,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":116426,"data_compressed":2492,"data_compressed_allocated":8192,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738393,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51140,"kb_used_data":20012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94320700,"statfs":{"total":96636764160,"available":96584396800,"internally_reserved":0,"allocated":20492288,"data_stored":143465736,"data_compressed":90367,"data_compressed_allocated":9506816,"data_compressed_original":132751360,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.183}]},{"osd":1,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.23799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69656,"kb_used_data":34448,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94302184,"statfs":{"total":96636764160,"available":96565436416,"internally_reserved":0,"allocated":35274752,"data_stored":202612205,"data_compressed":121192,"data_compressed_allocated":13729792,"data_compressed_original":181317632,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:31:30 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.67500000000000004}]},{"osd":2,"last update":"Fri Apr 26 12:31:30 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.44},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.48399999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738394,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65552,"kb_used_data":30344,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94306288,"statfs":{"total":96636764160,"available":96569638912,"internally_reserved":0,"allocated":31072256,"data_stored":194872057,"data_compressed":123050,"data_compressed_allocated":13148160,"data_compressed_original":177217536,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.156},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.185}]},{"osd":2,"last update":"Fri Apr 26 12:31:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.22600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":57597,"data_compressed":1246,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":58213,"data_compressed":1246,"data_compressed_allocated":4096,"data_compressed_original":12288,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38150144,"data_stored":202401881,"data_compressed":122522,"data_compressed_allocated":13885440,"data_compressed_original":178143232,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36679680,"data_stored":194013273,"data_compressed":117879,"data_compressed_allocated":13357056,"data_compressed_original":170696704,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27115520,"data_stored":142606336,"data_compressed":85791,"data_compressed_allocated":9785344,"data_compressed_original":125276160,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:32:21.207 INFO:tasks.thrashosds.thrasher:Setting 4.18 to [1, 2] 2024-04-26T12:32:21.207 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.18', '1', '2'] 2024-04-26T12:32:21.208 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.18 1 2 2024-04-26T12:32:21.246 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:21.245+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.70852912399999, 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017470640999999999, 2024-04-26T12:32:21.314 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602538+0000", 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602536+0000", 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.316 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602545+0000", 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4670000000000004e-06 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602555+0000", 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0203e-05 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602566+0000", 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1364e-05 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602615+0000", 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8714000000000001e-05 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602622+0000", 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3590000000000002e-06 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610074+0000", 2024-04-26T12:32:21.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0074516929999999997 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610187+0000", 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011284 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.610365+0000", 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017819600000000001 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616569+0000", 2024-04-26T12:32:21.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062034810000000003 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619315+0000", 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027465359999999999 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619489+0000", 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000174246 2024-04-26T12:32:21.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620008+0000", 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00051905099999999997 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708487445, 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017658410999999999, 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.321 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602580+0000", 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602579+0000", 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602584+0000", 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602594+0000", 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0411000000000001e-05 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602601+0000", 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9090000000000003e-06 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602697+0000", 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5789000000000001e-05 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602702+0000", 2024-04-26T12:32:21.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:21.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611522+0000", 2024-04-26T12:32:21.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088197840000000007 2024-04-26T12:32:21.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611621+0000", 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.611860+0000", 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023895700000000001 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617185+0000", 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0053247490000000001 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.327 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.327 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620107+0000", 2024-04-26T12:32:21.327 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029223750000000001 2024-04-26T12:32:21.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.327 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.327 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.327 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620192+0000", 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4734000000000006e-05 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620238+0000", 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6001999999999998e-05 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:21.328 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708458666, 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017819710999999998, 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:21.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602608+0000", 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602618+0000", 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.04e-05 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602625+0000", 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3170000000000004e-06 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602632+0000", 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5570000000000001e-06 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602736+0000", 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104368 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602740+0000", 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.219e-06 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613045+0000", 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01030557 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613234+0000", 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000188498 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614023+0000", 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00078907599999999999 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620022+0000", 2024-04-26T12:32:21.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059996320000000004 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620314+0000", 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00029192699999999999 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7134e-05 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.334 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620428+0000", 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6563999999999995e-05 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708429018, 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019922693000000002, 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.335 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602638+0000", 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602637+0000", 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602641+0000", 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602647+0000", 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6980000000000003e-06 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602653+0000", 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602780+0000", 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012707199999999999 2024-04-26T12:32:21.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615109+0000", 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012324382 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615199+0000", 2024-04-26T12:32:21.339 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0548000000000001e-05 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615417+0000", 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000217753 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620069+0000", 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046519049999999996 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.340 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622500+0000", 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002430948 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622529+0000", 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9526000000000002e-05 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622561+0000", 2024-04-26T12:32:21.341 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1472e-05 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708390204, 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.022866127999999999, 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.342 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602677+0000", 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602676+0000", 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.343 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602683+0000", 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602693+0000", 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0006e-05 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602700+0000", 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602829+0000", 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012903799999999999 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602833+0000", 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5809999999999998e-06 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620572+0000", 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017738869000000001 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.345 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620706+0000", 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013398699999999999 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620861+0000", 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015509599999999999 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.623690+0000", 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028288279999999998 2024-04-26T12:32:21.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625486+0000", 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0017959860000000001 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625519+0000", 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3225000000000001e-05 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.625543+0000", 2024-04-26T12:32:21.347 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3600000000000001e-05 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708361416, 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025610984999999999, 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.348 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602706+0000", 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602705+0000", 2024-04-26T12:32:21.349 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602708+0000", 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4199999999999999e-06 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602720+0000", 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1685000000000001e-05 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.350 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602727+0000", 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0570000000000004e-06 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602870+0000", 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000142733 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602879+0000", 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.351 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621406+0000", 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018527166000000001 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621485+0000", 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8992000000000005e-05 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621568+0000", 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3065000000000005e-05 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.352 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626674+0000", 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051059349999999998 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628247+0000", 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015731530000000001 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628280+0000", 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3073e-05 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.353 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628317+0000", 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6458999999999998e-05 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708334275, 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025684208, 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.354 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602733+0000", 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602732+0000", 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.355 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602735+0000", 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8200000000000001e-06 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602741+0000", 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4090000000000002e-06 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602746+0000", 2024-04-26T12:32:21.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0660000000000003e-06 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602919+0000", 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000173246 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602924+0000", 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0180000000000001e-06 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.357 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621793+0000", 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018868803 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621883+0000", 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0012000000000005e-05 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621968+0000", 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5591000000000001e-05 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.358 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626679+0000", 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047109810000000004 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628360+0000", 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001680312 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628392+0000", 2024-04-26T12:32:21.359 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2428000000000002e-05 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628417+0000", 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4788000000000001e-05 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708292555, 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.025736309999999998, 2024-04-26T12:32:21.360 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602774+0000", 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602777+0000", 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1269999999999999e-06 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602784+0000", 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5239999999999997e-06 2024-04-26T12:32:21.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602792+0000", 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3410000000000003e-06 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000170104 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602968+0000", 2024-04-26T12:32:21.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0129999999999999e-06 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622139+0000", 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019171134999999999 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622209+0000", 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9577000000000001e-05 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.364 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622321+0000", 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000112086 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.626696+0000", 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043747990000000004 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628448+0000", 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001752268 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.365 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628477+0000", 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9232999999999999e-05 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.628511+0000", 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3547000000000003e-05 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.366 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.70823075200001, 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017553150999999999, 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:21.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602836+0000", 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602839+0000", 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602845+0000", 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602853+0000", 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7729999999999999e-06 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602897+0000", 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3519000000000001e-05 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602902+0000", 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.395e-06 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612295+0000", 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0093930249999999993 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612685+0000", 2024-04-26T12:32:21.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000390021 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.612851+0000", 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000166472 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618761+0000", 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059090790000000002 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620288+0000", 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015270940000000001 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620342+0000", 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620389+0000", 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7852999999999997e-05 2024-04-26T12:32:21.372 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708207883, 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018358507999999999, 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:21.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602859+0000", 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602868+0000", 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0000000000000002e-06 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602876+0000", 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602883+0000", 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602909+0000", 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6256000000000001e-05 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602913+0000", 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999997e-06 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615872+0000", 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012958488000000001 2024-04-26T12:32:21.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617031+0000", 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001159558 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.617153+0000", 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000122259 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620558+0000", 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034045640000000001 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620907+0000", 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00034929399999999999 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621176+0000", 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00026832599999999999 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621218+0000", 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2026e-05 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708177001, 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018526154, 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.379 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602890+0000", 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602889+0000", 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602893+0000", 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4640000000000002e-06 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602899+0000", 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602903+0000", 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4379999999999997e-06 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602962+0000", 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8615e-05 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602969+0000", 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.25e-06 2024-04-26T12:32:21.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618140+0000", 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015170428999999999 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618226+0000", 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6175999999999996e-05 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.618364+0000", 2024-04-26T12:32:21.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013791300000000001 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621278+0000", 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029140669999999998 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621331+0000", 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2778000000000002e-05 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621379+0000", 2024-04-26T12:32:21.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8337999999999997e-05 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.621416+0000", 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7211e-05 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708136795, 2024-04-26T12:32:21.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01925377, 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602930+0000", 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602933+0000", 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.897e-06 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602939+0000", 2024-04-26T12:32:21.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6429999999999998e-06 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602945+0000", 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5169999999999999e-06 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602981+0000", 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5725000000000001e-05 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4939999999999997e-06 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613443+0000", 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010458327 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.613941+0000", 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00049769899999999999 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614092+0000", 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015105000000000001 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.619227+0000", 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051344820000000001 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622094+0000", 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028677949999999998 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622145+0000", 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0206e-05 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622184+0000", 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9381999999999997e-05 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:21.391 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708081811, 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019309638, 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602985+0000", 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.602999+0000", 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.38e-05 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603004+0000", 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9490000000000001e-06 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603008+0000", 2024-04-26T12:32:21.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0060000000000003e-06 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603049+0000", 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0099999999999999e-05 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603053+0000", 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999996e-06 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.614601+0000", 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011547951000000001 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615231+0000", 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00062997499999999996 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615386+0000", 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000155253 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620092+0000", 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047055780000000002 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622225+0000", 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002133397 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622255+0000", 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.991e-05 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622295+0000", 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9925999999999997e-05 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:30 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.70803872, 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019263103, 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.397 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603028+0000", 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603030+0000", 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1600000000000001e-06 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603034+0000", 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.45e-06 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603036+0000", 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8339999999999999e-06 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603076+0000", 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9922999999999997e-05 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op must wait for map", 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603083+0000", 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2179999999999996e-06 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615218+0000", 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012135353 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615351+0000", 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013313100000000001 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.615595+0000", 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000243613 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.620733+0000", 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051380829999999999 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622224+0000", 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001491395 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622264+0000", 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0249e-05 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622291+0000", 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6903999999999999e-05 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 108.708021385, 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019375172999999999, 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603046+0000", 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603045+0000", 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603047+0000", 2024-04-26T12:32:21.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3309999999999998e-06 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603055+0000", 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2590000000000003e-06 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603061+0000", 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4019999999999999e-06 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603091+0000", 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9594000000000002e-05 2024-04-26T12:32:21.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.603097+0000", 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616368+0000", 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013270865999999999 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.616522+0000", 2024-04-26T12:32:21.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:30:32.622421+0000", 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0058992180000000003 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:12 4.e 4:73e84e43:::100000001f8.00000004:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.9235869290000007, 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.02230445, 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.407 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 12 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387480+0000", 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.387479+0000", 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401598+0000", 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01411946 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401621+0000", 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2921e-05 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401632+0000", 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0957e-05 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401696+0000", 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3910000000000003e-05 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401842+0000", 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014598500000000001 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.401993+0000", 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000150679 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.407007+0000", 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050141669999999999 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409718+0000", 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002711293 2024-04-26T12:32:21.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409755+0000", 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6906999999999997e-05 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.409784+0000", 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9533e-05 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:16 4.2c 4:36128e15:::100000001f8.00000008:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.4272117929999997, 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019061136999999999, 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 16 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883855+0000", 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.883854+0000", 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:21.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893062+0000", 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0092075000000000004 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893075+0000", 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3726e-05 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893100+0000", 2024-04-26T12:32:21.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4997000000000001e-05 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893146+0000", 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5364000000000001e-05 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893250+0000", 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103892 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.893345+0000", 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5696e-05 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.896800+0000", 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003454225 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902845+0000", 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0060457669999999996 2024-04-26T12:32:21.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902881+0000", 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5830000000000001e-05 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:11.902916+0000", 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5110000000000001e-05 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:23 4.24 e50/13 4:27adda6e:::100000001f8.0000000f:head v 50'1, mlcod=0'0)", 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 8.5886480499999998, 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016826893999999998, 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722419+0000", 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.722417+0000", 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735064+0000", 2024-04-26T12:32:21.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012646924 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735091+0000", 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7265999999999999e-05 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735103+0000", 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1812e-05 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735158+0000", 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4620000000000002e-05 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.735179+0000", 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0879000000000001e-05 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.739192+0000", 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040138220000000002 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:12.739246+0000", 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3429e-05 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:26 4.32 4:4f726a0c:::100000001f8.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 8.2309755290000002, 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017624955000000001, 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.423 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 26 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080091+0000", 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.080088+0000", 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087471+0000", 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00738253 2024-04-26T12:32:21.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087494+0000", 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3088999999999999e-05 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087507+0000", 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3226e-05 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087574+0000", 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7070000000000007e-05 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087741+0000", 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016635900000000001 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.087861+0000", 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000120114 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.091238+0000", 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003377634 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097648+0000", 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0064094399999999998 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097686+0000", 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7682000000000003e-05 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:13.097716+0000", 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0901000000000001e-05 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:66 4.c 4:33b8095f:::100000001f8.0000003a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:17.798051+0000", 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 3.5130158709999999, 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020312229000000001, 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:21.429 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 66 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.798051+0000", 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.798051+0000", 2024-04-26T12:32:21.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.798049+0000", 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.801912+0000", 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0038632950000000001 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:21.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.801937+0000", 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4511e-05 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.801952+0000", 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5313000000000001e-05 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.801998+0000", 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6354999999999999e-05 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.802105+0000", 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000106205 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.802203+0000", 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8000999999999999e-05 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.805512+0000", 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00330927 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.818263+0000", 2024-04-26T12:32:21.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012751228 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.818319+0000", 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6350000000000001e-05 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:17.818363+0000", 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3896000000000001e-05 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.434 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:21.435 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:21.435 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:21.436 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:21.435+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:21.437 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:21.536 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:21.535+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:21.601 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:21.601 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:21.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.601 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:6479 4.a e55/13 4:50194ce5:::100000001f8.00000027:head v 55'94, mlcod=55'92)", 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.596355+0000", 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.004062253, 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040860769999999996, 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596355+0000", 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.602 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596355+0000", 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596354+0000", 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596365+0000", 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.136e-05 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596373+0000", 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4340000000000003e-06 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596377+0000", 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4100000000000001e-06 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596411+0000", 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3602000000000001e-05 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596431+0000", 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9707e-05 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6481 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1257472~4096 in=4096b,write 1265664~4096 in=4096b,write 1306624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.596795+0000", 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.003621478, 2024-04-26T12:32:21.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037185450000000002, 2024-04-26T12:32:21.606 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:21.606 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:21.606 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:21.606 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.606 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6481 2024-04-26T12:32:21.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.606 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596795+0000", 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596795+0000", 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596795+0000", 2024-04-26T12:32:21.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596808+0000", 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3077e-05 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596817+0000", 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4620000000000002e-06 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596823+0000", 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9340000000000003e-06 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596851+0000", 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8425999999999999e-05 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.609 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596898+0000", 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6300000000000001e-05 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.596981+0000", 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3338999999999996e-05 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600438+0000", 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003457318 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.610 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6482 4.30 4:0c89e311:::100000001f8.00000017:head [write 786432~4096 in=4096b,write 847872~4096 in=4096b,write 901120~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.597152+0000", 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0032645840000000001, 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034316889999999999, 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6482 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.611 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.597152+0000", 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.597152+0000", 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.597152+0000", 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.597171+0000", 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9139000000000001e-05 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.597177+0000", 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9270000000000002e-06 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.597184+0000", 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.973e-06 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.597220+0000", 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5886000000000002e-05 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.597307+0000", 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6788999999999999e-05 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.597463+0000", 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015629500000000001 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598660+0000", 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011973699999999999 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.615 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6485 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3477504~4096 in=4096b,write 3530752~4096 in=4096b,write 3616768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.598100+0000", 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002317164, 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025309019999999998, 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6485 2024-04-26T12:32:21.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598100+0000", 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598100+0000", 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598099+0000", 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598110+0000", 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0885e-05 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598117+0000", 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2629999999999997e-06 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598121+0000", 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2050000000000004e-06 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598154+0000", 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2892999999999998e-05 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598205+0000", 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0852e-05 2024-04-26T12:32:21.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598294+0000", 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8844999999999994e-05 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600406+0000", 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021124300000000002 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6486 4.29 4:94178d8a:::100000001f8.00000006:head [write 3846144~4096 in=4096b,write 4063232~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.598392+0000", 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00202535, 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022843970000000001, 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6486 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.621 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598392+0000", 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598392+0000", 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598391+0000", 2024-04-26T12:32:21.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598410+0000", 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8617000000000001e-05 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598416+0000", 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2160000000000003e-06 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598423+0000", 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6640000000000001e-06 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598461+0000", 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8303999999999998e-05 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598551+0000", 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0364000000000004e-05 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598690+0000", 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013834700000000001 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599777+0000", 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010871469999999999 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6487 4.12 4:48ab9bde:::100000001f8.00000015:head [write 1777664~4096 in=4096b,write 1822720~4096 in=4096b,write 2105344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.598697+0000", 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0017195940000000001, 2024-04-26T12:32:21.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020234580000000001, 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6487 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598697+0000", 2024-04-26T12:32:21.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598697+0000", 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598697+0000", 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598708+0000", 2024-04-26T12:32:21.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1005000000000001e-05 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598715+0000", 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7030000000000006e-06 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598719+0000", 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.985e-06 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598750+0000", 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1012000000000001e-05 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598807+0000", 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6993999999999997e-05 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.598895+0000", 2024-04-26T12:32:21.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7381999999999998e-05 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:6488 4.38 e55/13 4:1d13bf87:::100000001f8.00000030:head v 55'423, mlcod=55'421)", 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.599263+0000", 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0011543689999999999, 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001499123, 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599263+0000", 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599263+0000", 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599262+0000", 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599277+0000", 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4874e-05 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599288+0000", 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1496e-05 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599295+0000", 2024-04-26T12:32:21.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1770000000000001e-06 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599325+0000", 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9453000000000001e-05 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599337+0000", 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.167e-05 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6489 4.11 4:893be98d:::100000001f8.00000001:head [write 983040~4096 in=4096b,write 1224704~4096 in=4096b,write 1343488~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.599365+0000", 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0010523380000000001, 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014315420000000001, 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6489 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.634 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599365+0000", 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599365+0000", 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599364+0000", 2024-04-26T12:32:21.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599377+0000", 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3169999999999999e-05 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599394+0000", 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6597999999999999e-05 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599402+0000", 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8619999999999992e-06 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599439+0000", 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6922000000000003e-05 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599525+0000", 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5169999999999999e-05 2024-04-26T12:32:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599722+0000", 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019734799999999999 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6490 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1859584~4096 in=4096b,write 1949696~4096 in=4096b,write 2473984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.599706+0000", 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00071074300000000001, 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011320379999999999, 2024-04-26T12:32:21.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6490 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599706+0000", 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599706+0000", 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599705+0000", 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599718+0000", 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2778e-05 2024-04-26T12:32:21.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599728+0000", 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.025e-05 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599737+0000", 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2519999999999999e-06 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599784+0000", 2024-04-26T12:32:21.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7620000000000001e-05 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599853+0000", 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8813000000000007e-05 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.599942+0000", 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8863999999999995e-05 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.642 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:6491 4.18 e55/13 4:1a1c818c:::100000001f8.0000000d:head v 55'111, mlcod=55'109)", 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.600303+0000", 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.000114011, 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00058551199999999995, 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600303+0000", 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600303+0000", 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600302+0000", 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600317+0000", 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4854e-05 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:21.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600326+0000", 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4449999999999996e-06 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600332+0000", 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600366+0000", 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3699999999999999e-05 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:21.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:21.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.600390+0000", 2024-04-26T12:32:21.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3932999999999999e-05 2024-04-26T12:32:21.646 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.646 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:21.646 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.646 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:21.646 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-04-26T12:32:21.646 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 10 2024-04-26T12:32:21.646 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:21.647 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:21.646+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:21.648 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:21.748 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:21.748+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:21.826 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:21.826 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:21.826 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:32:21.826 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:32:21.826 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:21.839 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:21.850 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:21.849+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:21.951 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:21.950+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:22.053 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:22.053 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:32:22.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:32:22.053 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 109.44742467499999, 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:32:22.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:32:22.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:32:22.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:32:22.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:28 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:13.300550+0000", 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7497002500000001, 2024-04-26T12:32:22.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014307429, 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.300550+0000", 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.300550+0000", 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.300548+0000", 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.305944+0000", 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053957120000000004 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.305964+0000", 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0397000000000001e-05 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.305976+0000", 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1362999999999999e-05 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.306080+0000", 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104017 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.306216+0000", 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013630900000000001 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.306339+0000", 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012262500000000001 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.312030+0000", 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056913770000000001 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.314786+0000", 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027561199999999999 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.314826+0000", 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0138000000000001e-05 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.314858+0000", 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1655000000000001e-05 2024-04-26T12:32:22.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:49 4.1c 4:39b842ef:::100000001f8.00000029:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.2519170580000001, 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.31553130400000001, 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49 2024-04-26T12:32:22.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798333+0000", 2024-04-26T12:32:22.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802052+0000", 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037186889999999998 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802065+0000", 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.393e-05 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802090+0000", 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5028000000000002e-05 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802171+0000", 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0267999999999998e-05 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802183+0000", 2024-04-26T12:32:22.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2612999999999999e-05 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103759+0000", 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.30157593799999999 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103871+0000", 2024-04-26T12:32:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112215 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104010+0000", 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013841799999999999 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.109832+0000", 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058224430000000001 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113792+0000", 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039597809999999999 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113833+0000", 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1162000000000003e-05 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113865+0000", 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1664e-05 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:50 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1388450429999999, 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.211685075, 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.071 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:22.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911403+0000", 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915165+0000", 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037618870000000002 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915180+0000", 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5130000000000001e-05 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915206+0000", 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6248e-05 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915253+0000", 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6387000000000002e-05 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915262+0000", 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9239999999999996e-06 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103986+0000", 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.188724843 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104199+0000", 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021283900000000001 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104324+0000", 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012447599999999999 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.115992+0000", 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011668286 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123002+0000", 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070100400000000004 2024-04-26T12:32:22.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123053+0000", 2024-04-26T12:32:22.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1427000000000001e-05 2024-04-26T12:32:22.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123091+0000", 2024-04-26T12:32:22.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271000000000003e-05 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:58 4.28 4:15eeb89b:::100000001f8.00000032:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:16.843596+0000", 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2066546520000001, 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013750413, 2024-04-26T12:32:22.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 58 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.843596+0000", 2024-04-26T12:32:22.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.843596+0000", 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.843593+0000", 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847507+0000", 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039135569999999998 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847530+0000", 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3078000000000002e-05 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847542+0000", 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.221e-05 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847613+0000", 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0729999999999995e-05 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847724+0000", 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111736 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847819+0000", 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4413000000000006e-05 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.852150+0000", 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043307989999999998 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.857286+0000", 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051360420000000004 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.857320+0000", 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4484999999999999e-05 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.857346+0000", 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6282999999999999e-05 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:66 4.c e54/13 4:33b8095f:::100000001f8.0000003a:head v 54'1, mlcod=0'0)", 2024-04-26T12:32:22.084 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:17.802479+0000", 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.24777205, 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015632038000000001, 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.802479+0000", 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.802479+0000", 2024-04-26T12:32:22.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.802477+0000", 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814418+0000", 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011941475999999999 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814434+0000", 2024-04-26T12:32:22.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5107e-05 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814442+0000", 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814532+0000", 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0367999999999999e-05 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814554+0000", 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1965999999999999e-05 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.818063+0000", 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035086459999999998 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.818111+0000", 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7856999999999999e-05 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5297 4.30 4:0c89e311:::100000001f8.00000017:head [write 299008~4096,write 327680~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.056909+0000", 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.99334213100000002, 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0130286, 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.089 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5297 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056909+0000", 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056909+0000", 2024-04-26T12:32:22.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056908+0000", 2024-04-26T12:32:22.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056930+0000", 2024-04-26T12:32:22.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2396e-05 2024-04-26T12:32:22.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056939+0000", 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4300000000000006e-06 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056945+0000", 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.241e-06 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056974+0000", 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9079000000000001e-05 2024-04-26T12:32:22.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.057046+0000", 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1596999999999999e-05 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.057143+0000", 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7369999999999998e-05 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.058276+0000", 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001132632 2024-04-26T12:32:22.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.069862+0000", 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011586358 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.069912+0000", 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0148999999999997e-05 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.069937+0000", 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5001999999999999e-05 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5834 4.35 4:af28909f:::100000001f8.0000001b:head [write 2560000~4096,write 2605056~4096,write 2613248~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.286157+0000", 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.76409365299999998, 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014257870000000001, 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.098 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5834 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286157+0000", 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286157+0000", 2024-04-26T12:32:22.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286156+0000", 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286168+0000", 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1637000000000001e-05 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286178+0000", 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8709999999999992e-06 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286183+0000", 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.062e-06 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286220+0000", 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7178999999999998e-05 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286299+0000", 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9091000000000006e-05 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286417+0000", 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011814 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.287337+0000", 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00091955599999999998 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.300361+0000", 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013024321 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.300394+0000", 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2258999999999997e-05 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.300415+0000", 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1373e-05 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.103 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5877 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1519616~4096,write 1609728~4096,write 1675264~4096,write 1814528~4096,write 1851392~4096,write 1957888~4096,write 1994752~4096,write 2064384~4096,write 2084864~4096,write 2220032~4096,write 2408448~4096,write 2445312~8192,write 2498560~4096,write 2510848~4096,write 2727936~4096,write 2768896~4096,write 2879488~4096,write 3043328~4096,write 3100672~4096,write 3223552~4096,write 3350528~4096,write 3362816~4096,write 3395584~4096,write 3428352~4096,write 3469312~4096,write 3538944~4096,write 3608576~4096,write 3674112~4096,write 3944448~4096,write 3964928~4096,write 4030464~4096,write 4038656~4096,write 4087808~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.303431+0000", 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74681958100000001, 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016850225, 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5877 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.104 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303431+0000", 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303431+0000", 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303431+0000", 2024-04-26T12:32:22.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303565+0000", 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013472199999999999 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303572+0000", 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6780000000000003e-06 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303576+0000", 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9199999999999997e-06 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303602+0000", 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5962e-05 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303675+0000", 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3505999999999997e-05 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304040+0000", 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036495100000000002 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317607+0000", 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013567002999999999 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320197+0000", 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025896299999999999 2024-04-26T12:32:22.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320246+0000", 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9237000000000003e-05 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320281+0000", 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5088e-05 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5878 4.15 4:aada5e43:::100000001f8.00000028:head [write 135168~4096,write 155648~4096,write 290816~4096,write 319488~4096,write 430080~4096,write 815104~4096,write 835584~4096,write 864256~4096,write 880640~4096,write 913408~4096,write 1048576~4096,write 1085440~4096,write 2461696~4096,write 2617344~4096,write 2768896~4096,write 2793472~4096,write 3100672~4096,write 3108864~4096,write 3276800~4096,write 3289088~4096,write 3436544~4096,write 3645440~4096,write 3895296~4096,write 3932160~4096,write 4009984~4096,write 4079616~4096,write 4177920~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.303583+0000", 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74666782200000004, 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016171478, 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5878 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303583+0000", 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303583+0000", 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303582+0000", 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303669+0000", 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6623000000000001e-05 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303674+0000", 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3489999999999999e-06 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303679+0000", 2024-04-26T12:32:22.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7079999999999996e-06 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303713+0000", 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3912999999999999e-05 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303782+0000", 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8787000000000004e-05 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304147+0000", 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036504799999999998 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.316525+0000", 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012378062 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319679+0000", 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031538429999999999 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319726+0000", 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7364999999999998e-05 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319754+0000", 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8360999999999998e-05 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5879 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 1548288~4096,write 1556480~4096,write 1658880~4096,write 1667072~4096,write 1679360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.115 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.303685+0000", 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74656556399999996, 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012896047000000001, 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5879 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303685+0000", 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303685+0000", 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303685+0000", 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303697+0000", 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2574e-05 2024-04-26T12:32:22.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303703+0000", 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2419999999999997e-06 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303709+0000", 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5369999999999997e-06 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303744+0000", 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4468999999999998e-05 2024-04-26T12:32:22.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303794+0000", 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303900+0000", 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106047 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.313825+0000", 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099253250000000005 2024-04-26T12:32:22.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.316507+0000", 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026819700000000001 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.316559+0000", 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1724000000000001e-05 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.316581+0000", 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2631000000000001e-05 2024-04-26T12:32:22.120 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5882 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 114688~4096,write 344064~4096,write 589824~4096,write 712704~4096,write 757760~4096,write 1892352~4096,write 2052096~4096,write 2215936~4096,write 2232320~4096,write 2342912~4096,write 2514944~4096,write 2547712~4096,write 2641920~4096,write 2748416~4096,write 2838528~4096,write 2908160~4096,write 3059712~4096,write 3600384~4096,write 3686400~4096,write 4096000~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.303996+0000", 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74625485599999997, 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013307235000000001, 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5882 2024-04-26T12:32:22.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303996+0000", 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303996+0000", 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303995+0000", 2024-04-26T12:32:22.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304103+0000", 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108093 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304112+0000", 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8799999999999997e-06 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304119+0000", 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9569999999999996e-06 2024-04-26T12:32:22.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304399+0000", 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279926 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304452+0000", 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3251000000000002e-05 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304821+0000", 2024-04-26T12:32:22.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036832100000000001 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.313853+0000", 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090322279999999998 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317222+0000", 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033689129999999999 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317269+0000", 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6882999999999998e-05 2024-04-26T12:32:22.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317303+0000", 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4453999999999999e-05 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5884 4.19 4:997b7129:::100000001f8.00000000:head [write 28672~4096,write 69632~4096,write 94208~4096,write 421888~4096,write 999424~4096,write 1290240~4096,write 2383872~4096,write 2510848~4096,write 2592768~8192,write 2965504~4096,write 3145728~4096,write 3190784~4096,write 3383296~4096,write 3506176~8192,write 3670016~4096,write 3743744~4096,write 3756032~4096,write 3768320~4096,write 3784704~4096,write 3919872~4096,write 3940352~4096,write 4005888~4096,write 4026368~4096,write 4145152~4096,write 4161536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.304197+0000", 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74605387199999995, 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015648957000000002, 2024-04-26T12:32:22.126 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5884 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304197+0000", 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304197+0000", 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304196+0000", 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304641+0000", 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044442 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304651+0000", 2024-04-26T12:32:22.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0079e-05 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304673+0000", 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2314999999999999e-05 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.305229+0000", 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055571699999999995 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.305343+0000", 2024-04-26T12:32:22.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114145 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.305784+0000", 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044109599999999998 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317601+0000", 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011816929 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319780+0000", 2024-04-26T12:32:22.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002178939 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319822+0000", 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1897000000000002e-05 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319846+0000", 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4029e-05 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:5880 4.c e55/13 4:33b8095f:::100000001f8.0000003a:head v 55'92, mlcod=55'90)", 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.304595+0000", 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74565611499999995, 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015576405999999999, 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304595+0000", 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304595+0000", 2024-04-26T12:32:22.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304594+0000", 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304841+0000", 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024755799999999999 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304851+0000", 2024-04-26T12:32:22.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0450000000000006e-06 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304857+0000", 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304909+0000", 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1687000000000002e-05 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304924+0000", 2024-04-26T12:32:22.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5353e-05 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320145+0000", 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015220638999999999 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320171+0000", 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6308999999999998e-05 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6438 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1445888~4096,write 1560576~4096,write 1572864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.579547+0000", 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.47070368600000001, 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013460306999999999, 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6438 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.136 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579547+0000", 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579547+0000", 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579546+0000", 2024-04-26T12:32:22.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579561+0000", 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4839e-05 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579572+0000", 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0729e-05 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579580+0000", 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3049999999999993e-06 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579615+0000", 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4465000000000003e-05 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579688+0000", 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3561999999999998e-05 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579847+0000", 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015918900000000001 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580829+0000", 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098204799999999991 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.592920+0000", 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012090314 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.592967+0000", 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7083000000000003e-05 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.593007+0000", 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0626e-05 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6439 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1851392~4096,write 1912832~4096,write 1966080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.580063+0000", 2024-04-26T12:32:22.141 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.47018786200000001, 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013067944999999999, 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6439 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580063+0000", 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580063+0000", 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580062+0000", 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580078+0000", 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5233e-05 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580086+0000", 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9670000000000001e-06 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580092+0000", 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5529999999999998e-06 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580134+0000", 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1535999999999997e-05 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580192+0000", 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7874000000000002e-05 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580337+0000", 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145105 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.583757+0000", 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034202799999999999 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.593041+0000", 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092844769999999993 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.593086+0000", 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4591e-05 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.593131+0000", 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4844e-05 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.146 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6440 4.35 4:af28909f:::100000001f8.0000001b:head [write 1519616~4096,write 1658880~4096,write 1699840~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.580374+0000", 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.46987630000000002, 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012613098, 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6440 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.147 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580374+0000", 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580374+0000", 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580374+0000", 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:22.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580398+0000", 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4748000000000001e-05 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580406+0000", 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8909999999999995e-06 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580413+0000", 2024-04-26T12:32:22.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1809999999999998e-06 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580449+0000", 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6757000000000001e-05 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580506+0000", 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7127999999999999e-05 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:22.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580615+0000", 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108694 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.586950+0000", 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063351329999999997 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.592887+0000", 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059370209999999998 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.592945+0000", 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.817e-05 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.592988+0000", 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2070999999999998e-05 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6656 4.23 4:c6f90462:::100000001f8.00000037:head [write 3768320~4096,write 3878912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.670809+0000", 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.37944199699999998, 2024-04-26T12:32:22.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012593618000000001, 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6656 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.670809+0000", 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.670809+0000", 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.670808+0000", 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.670817+0000", 2024-04-26T12:32:22.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9039999999999998e-06 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.670824+0000", 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3320000000000003e-06 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.670830+0000", 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.670858+0000", 2024-04-26T12:32:22.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7847e-05 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.670908+0000", 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0615999999999998e-05 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671047+0000", 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.672182+0000", 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011349419999999999 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.683343+0000", 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011160978 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.683373+0000", 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9901999999999999e-05 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.683402+0000", 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9779000000000001e-05 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6658 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3649536~4096,write 4145152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.671234+0000", 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.37901656, 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013155567999999999, 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.158 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6658 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671234+0000", 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671234+0000", 2024-04-26T12:32:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671233+0000", 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671244+0000", 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0896999999999999e-05 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671255+0000", 2024-04-26T12:32:22.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0458e-05 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671260+0000", 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.259e-06 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671303+0000", 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2910000000000001e-05 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671379+0000", 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6291999999999994e-05 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671511+0000", 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013184000000000001 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.679009+0000", 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074976840000000001 2024-04-26T12:32:22.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.684308+0000", 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052990060000000002 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.684364+0000", 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6153000000000003e-05 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.684390+0000", 2024-04-26T12:32:22.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5865000000000001e-05 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6665 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2031616~4096,write 2236416~4096,write 2260992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.674017+0000", 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.37623356000000002, 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012636455, 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:22.164 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6665 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674017+0000", 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674017+0000", 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674016+0000", 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674032+0000", 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5681000000000001e-05 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674042+0000", 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5359999999999998e-06 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674047+0000", 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4920000000000001e-06 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674077+0000", 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0094999999999999e-05 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674156+0000", 2024-04-26T12:32:22.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9252999999999995e-05 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674309+0000", 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015275099999999999 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.680917+0000", 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066073709999999999 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:22.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.686571+0000", 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056549089999999996 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.686617+0000", 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5494000000000002e-05 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.686654+0000", 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6683000000000001e-05 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.169 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:22.170 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:22.170 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:22.171 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:22.051+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:22.171 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:22.170+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:22.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:22.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:32:22.206 INFO:teuthology.orchestra.run.smithi038.stderr:set 4.18 pg_upmap mapping to [1,2] 2024-04-26T12:32:22.272 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:22.271+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:22.328 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 0 2024-04-26T12:32:22.328 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:22.340 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:22.372 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:22.372+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:22.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:22.473 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:22.472+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:22.492 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:22.492 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:22.493 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:22.493 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:22.505 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:22.574 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:22.573+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:22.598 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:22.623 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:22.646 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:22.648 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:22.648 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:22.648 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:22.675 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:22.674+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:22.701 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:22.701 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:22.714 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:22.775 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:22.774+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:22.866 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:22.866 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:22.876 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:22.875+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:22.878 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:22.977 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:22.976+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:23.027 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:23.027 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:23.039 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:23.078 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:23.077+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:23.179 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:23.178+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:23.192 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:23.192 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:23.204 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:23.223 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:32:23.280 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:23.279+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:23.367 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:23.367 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:23.377 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:23.421 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:23.420+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:23.481 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:23.480+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:23.545 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:23.545 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:23.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:23.582 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:23.581+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:23.682 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:23.682+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:23.757 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:23.758 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:23.771 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:23.814 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:23.813+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:23.884 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:23.883+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:23.922 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:23.923 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:23.934 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:24.018 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:24.017+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:24.086 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:24.085+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:24.126 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:24.126 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:24.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:24.186 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:24.186+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:24.287 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:24.286+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:24.339 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:24.339 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:24.352 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:24.388 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:24.387+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:24.489 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:24.488+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:24.511 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:24.511 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:24.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:24.590 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:24.589+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:24.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:24.691 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:24.691+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:24.718 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:24.718 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:24.731 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:24.792 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:24.791+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:24.854 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:24.877 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:24.887 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:24.887 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:24.892 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:24.892+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:24.899 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:24.904 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:24.906 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:24.906 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:24.906 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:24.994 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:24.993+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4532.0:13736 4.37 e58/13 ondisk, result = 0)", 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.072111+0000", 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00074808299999999997, 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00075606200000000005, 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:25.074 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072111+0000", 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072111+0000", 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072111+0000", 2024-04-26T12:32:25.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967296 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072113+0000", 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2699999999999999e-06 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072118+0000", 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1449999999999999e-06 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072123+0000", 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2350000000000001e-06 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072850+0000", 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00072784800000000001 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072858+0000", 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4290000000000004e-06 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072867+0000", 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3659999999999998e-06 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13746 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 147456~4096 in=4096b,write 368640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.072276+0000", 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00058284600000000004, 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00066751199999999999, 2024-04-26T12:32:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13746 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072276+0000", 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072276+0000", 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072276+0000", 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072286+0000", 2024-04-26T12:32:25.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0329000000000001e-05 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072297+0000", 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0865e-05 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072304+0000", 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5129999999999999e-06 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072346+0000", 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1949000000000001e-05 2024-04-26T12:32:25.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072422+0000", 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5285999999999997e-05 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072567+0000", 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014536799999999999 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:13747 4.2c e58/13 4:35cbff5f:::100000001f8.00000033:head v 58'430, mlcod=58'427)", 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.072801+0000", 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.8610999999999998e-05, 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020040800000000001, 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072801+0000", 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072801+0000", 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072800+0000", 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072826+0000", 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5965999999999998e-05 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072832+0000", 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1650000000000003e-06 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072837+0000", 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4039999999999997e-06 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072872+0000", 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5626000000000001e-05 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072891+0000", 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9113000000000001e-05 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13736 4.37 4:ef395e89:::100000001f8.00000020:head [write 2015232~4096 in=4096b,write 2060288~4096 in=4096b,write 2990080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.067545+0000", 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0053137310000000004, 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055033469999999996, 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.086 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13736 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.067545+0000", 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.067545+0000", 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.067545+0000", 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.067562+0000", 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.067574+0000", 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1727e-05 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.067582+0000", 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7540000000000006e-06 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.067621+0000", 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9375000000000002e-05 2024-04-26T12:32:25.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.067718+0000", 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6861000000000007e-05 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.067874+0000", 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015595 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072864+0000", 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049895829999999997 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13738 4.3f 4:fde182c5:::100000001f8.00000039:head [write 2899968~4096 in=4096b,write 3100672~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.068578+0000", 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.004281422, 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045177610000000003, 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:25.091 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13738 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068578+0000", 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068578+0000", 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068577+0000", 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068594+0000", 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6554000000000001e-05 2024-04-26T12:32:25.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068606+0000", 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2727e-05 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068615+0000", 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0929999999999992e-06 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068651+0000", 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6115000000000002e-05 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068731+0000", 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9579000000000005e-05 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068865+0000", 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000134074 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072850+0000", 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039848119999999999 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13739 4.14 4:2b28d75f:::100000001f8.00000016:head [write 3219456~4096 in=4096b,write 3227648~4096 in=4096b,write 3239936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.068947+0000", 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0039120470000000001, 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041928929999999996, 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13739 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068947+0000", 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068947+0000", 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068946+0000", 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068958+0000", 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1583000000000001e-05 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068968+0000", 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0226e-05 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.068975+0000", 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0400000000000004e-06 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069029+0000", 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3433000000000002e-05 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069086+0000", 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7095999999999997e-05 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069174+0000", 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8449000000000006e-05 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072948+0000", 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037740349999999998 2024-04-26T12:32:25.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13740 4.35 4:af28909f:::100000001f8.0000001b:head [write 245760~4096 in=4096b,write 290816~4096 in=4096b,write 425984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.069299+0000", 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0035599109999999998, 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003885571, 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.101 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13740 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069299+0000", 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069299+0000", 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069298+0000", 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069317+0000", 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8101000000000002e-05 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069327+0000", 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0210999999999999e-05 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.103 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069334+0000", 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9779999999999999e-06 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069377+0000", 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3133999999999997e-05 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069450+0000", 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3230000000000002e-05 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069637+0000", 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018663100000000001 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071248+0000", 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001611328 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.105 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13741 4.35 4:af28909f:::100000001f8.0000001b:head [write 65536~4096 in=4096b,write 180224~4096 in=4096b,write 212992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.069971+0000", 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0028880080000000001, 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032618310000000002, 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13741 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069971+0000", 2024-04-26T12:32:25.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069971+0000", 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069970+0000", 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069981+0000", 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.042e-05 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069988+0000", 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3300000000000001e-06 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.069995+0000", 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3180000000000003e-06 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070415+0000", 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042053499999999998 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070467+0000", 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1969000000000003e-05 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070560+0000", 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3274000000000002e-05 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.109 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071676+0000", 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001115312 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13742 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 2076672~4096 in=4096b,write 2117632~4096 in=4096b,write 2150400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.070594+0000", 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0022647850000000001, 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026830869999999998, 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13742 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070594+0000", 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070594+0000", 2024-04-26T12:32:25.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070594+0000", 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070606+0000", 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1909000000000001e-05 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070617+0000", 2024-04-26T12:32:25.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1009000000000001e-05 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070625+0000", 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9230000000000008e-06 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070664+0000", 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8526999999999999e-05 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070746+0000", 2024-04-26T12:32:25.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2023999999999999e-05 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.070913+0000", 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016714799999999999 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.073027+0000", 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002113691 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13743 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1347584~4096 in=4096b,write 1384448~4096 in=4096b,write 1466368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.071111+0000", 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.001748103, 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022104859999999998, 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13743 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.115 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071111+0000", 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071111+0000", 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071110+0000", 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071136+0000", 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5323000000000001e-05 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071147+0000", 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1406999999999999e-05 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071155+0000", 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071199+0000", 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3831000000000001e-05 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071267+0000", 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8750000000000004e-05 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071352+0000", 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4169e-05 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:13744 4.2c e58/13 4:36128e15:::100000001f8.00000008:head v 58'429, mlcod=58'427)", 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.071770+0000", 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0010894399999999999, 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015915969999999999, 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071770+0000", 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071770+0000", 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.120 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071769+0000", 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071783+0000", 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4112e-05 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071793+0000", 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4390000000000006e-06 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071809+0000", 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6481e-05 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071845+0000", 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5315000000000003e-05 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071865+0000", 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0100000000000001e-05 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.122 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:13745 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 4141056~4096 in=4096b,write 4165632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:25.071888+0000", 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00097162599999999996, 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001508108, 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 13745 2024-04-26T12:32:25.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071888+0000", 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071888+0000", 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071887+0000", 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071897+0000", 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7100000000000002e-06 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071908+0000", 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1112e-05 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.071918+0000", 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0686000000000001e-05 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072050+0000", 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013154200000000001 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072240+0000", 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000190535 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:25.072356+0000", 2024-04-26T12:32:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011554599999999999 2024-04-26T12:32:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-04-26T12:32:25.127 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 12 2024-04-26T12:32:25.127 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:25.128 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:25.127+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:25.129 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:25.229 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:25.228+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:25.242 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:32:25.330 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:25.329+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:25.334 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:25.334 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:25.334 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:32:25.334 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:32:25.334 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:25.347 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:25.432 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:25.431+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:25.531 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:25.530+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 112.95369882, 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0131138, 2024-04-26T12:32:25.560 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602826+0000", 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.561 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602825+0000", 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602830+0000", 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8709999999999996e-06 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602842+0000", 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1208e-05 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.562 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.602850+0000", 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.439e-06 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.603892+0000", 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001042109 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.604045+0000", 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015293199999999999 2024-04-26T12:32:25.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.565 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:30:32.615940+0000", 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01189486 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:28 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:13.300550+0000", 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 12.255974395000001, 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014307429, 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.566 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 28 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.300550+0000", 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.300550+0000", 2024-04-26T12:32:25.567 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.300548+0000", 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.305944+0000", 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053957120000000004 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.568 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.305964+0000", 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0397000000000001e-05 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.305976+0000", 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1362999999999999e-05 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.306080+0000", 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104017 2024-04-26T12:32:25.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.306216+0000", 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013630900000000001 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.306339+0000", 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012262500000000001 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.570 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.312030+0000", 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056913770000000001 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.314786+0000", 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027561199999999999 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.314826+0000", 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0138000000000001e-05 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.571 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:13.314858+0000", 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1655000000000001e-05 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:49 4.1c 4:39b842ef:::100000001f8.00000029:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.7581912029999991, 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.31553130400000001, 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.572 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798333+0000", 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802052+0000", 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037186889999999998 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802065+0000", 2024-04-26T12:32:25.574 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.393e-05 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802090+0000", 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5028000000000002e-05 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802171+0000", 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0267999999999998e-05 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802183+0000", 2024-04-26T12:32:25.575 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2612999999999999e-05 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103759+0000", 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.30157593799999999 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103871+0000", 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112215 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.576 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104010+0000", 2024-04-26T12:32:25.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013841799999999999 2024-04-26T12:32:25.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.577 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.577 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.109832+0000", 2024-04-26T12:32:25.577 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058224430000000001 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113792+0000", 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039597809999999999 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113833+0000", 2024-04-26T12:32:25.578 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1162000000000003e-05 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113865+0000", 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1664e-05 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:50 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:25.579 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.6451191880000007, 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.211685075, 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.580 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911403+0000", 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.581 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915165+0000", 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037618870000000002 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915180+0000", 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5130000000000001e-05 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915206+0000", 2024-04-26T12:32:25.582 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6248e-05 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915253+0000", 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6387000000000002e-05 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915262+0000", 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9239999999999996e-06 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103986+0000", 2024-04-26T12:32:25.583 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.188724843 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104199+0000", 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021283900000000001 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104324+0000", 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012447599999999999 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.115992+0000", 2024-04-26T12:32:25.584 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011668286 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123002+0000", 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070100400000000004 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123053+0000", 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1427000000000001e-05 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123091+0000", 2024-04-26T12:32:25.585 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271000000000003e-05 2024-04-26T12:32:25.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.586 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.586 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.586 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.586 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:58 4.28 4:15eeb89b:::100000001f8.00000032:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:32:25.586 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:16.843596+0000", 2024-04-26T12:32:25.586 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.712928797, 2024-04-26T12:32:25.586 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013750413, 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 58 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.843596+0000", 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.587 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.843596+0000", 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.843593+0000", 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847507+0000", 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039135569999999998 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.588 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847530+0000", 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3078000000000002e-05 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847542+0000", 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.221e-05 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847613+0000", 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0729999999999995e-05 2024-04-26T12:32:25.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847724+0000", 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111736 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.847819+0000", 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4413000000000006e-05 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.590 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.852150+0000", 2024-04-26T12:32:25.591 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043307989999999998 2024-04-26T12:32:25.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.591 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.591 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.591 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.857286+0000", 2024-04-26T12:32:25.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051360420000000004 2024-04-26T12:32:25.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.592 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.592 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.857320+0000", 2024-04-26T12:32:25.592 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4484999999999999e-05 2024-04-26T12:32:25.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.592 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.593 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.593 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.857346+0000", 2024-04-26T12:32:25.593 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6282999999999999e-05 2024-04-26T12:32:25.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.593 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.593 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.593 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.593 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:66 4.c e54/13 4:33b8095f:::100000001f8.0000003a:head v 54'1, mlcod=0'0)", 2024-04-26T12:32:25.594 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:17.802479+0000", 2024-04-26T12:32:25.594 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 7.7540461949999999, 2024-04-26T12:32:25.594 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015632038000000001, 2024-04-26T12:32:25.594 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.594 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.594 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.594 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.594 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.802479+0000", 2024-04-26T12:32:25.595 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.595 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.595 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.595 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.802479+0000", 2024-04-26T12:32:25.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.596 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.596 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.596 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.802477+0000", 2024-04-26T12:32:25.596 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:25.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.597 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814418+0000", 2024-04-26T12:32:25.597 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011941475999999999 2024-04-26T12:32:25.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.597 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814434+0000", 2024-04-26T12:32:25.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5107e-05 2024-04-26T12:32:25.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.598 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.598 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.598 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814442+0000", 2024-04-26T12:32:25.598 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3510000000000002e-06 2024-04-26T12:32:25.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814532+0000", 2024-04-26T12:32:25.599 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0367999999999999e-05 2024-04-26T12:32:25.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.599 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.599 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.599 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.814554+0000", 2024-04-26T12:32:25.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1965999999999999e-05 2024-04-26T12:32:25.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.600 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.600 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.600 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.818063+0000", 2024-04-26T12:32:25.600 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035086459999999998 2024-04-26T12:32:25.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.601 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.601 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.601 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:17.818111+0000", 2024-04-26T12:32:25.601 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7856999999999999e-05 2024-04-26T12:32:25.601 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.601 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.602 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.602 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.602 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5297 4.30 4:0c89e311:::100000001f8.00000017:head [write 299008~4096,write 327680~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.602 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.056909+0000", 2024-04-26T12:32:25.602 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.4996162760000002, 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0130286, 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5297 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.603 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056909+0000", 2024-04-26T12:32:25.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.604 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.604 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.604 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056909+0000", 2024-04-26T12:32:25.604 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056908+0000", 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056930+0000", 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2396e-05 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056939+0000", 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4300000000000006e-06 2024-04-26T12:32:25.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056945+0000", 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.241e-06 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.056974+0000", 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9079000000000001e-05 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.606 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.057046+0000", 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1596999999999999e-05 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.057143+0000", 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7369999999999998e-05 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.607 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.058276+0000", 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001132632 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.069862+0000", 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011586358 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.069912+0000", 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0148999999999997e-05 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.608 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.069937+0000", 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5001999999999999e-05 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5834 4.35 4:af28909f:::100000001f8.0000001b:head [write 2560000~4096,write 2605056~4096,write 2613248~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.286157+0000", 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2703677979999997, 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014257870000000001, 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.609 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5834 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286157+0000", 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286157+0000", 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286156+0000", 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286168+0000", 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1637000000000001e-05 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.611 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286178+0000", 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8709999999999992e-06 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286183+0000", 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.062e-06 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286220+0000", 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7178999999999998e-05 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286299+0000", 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9091000000000006e-05 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.286417+0000", 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011814 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.287337+0000", 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00091955599999999998 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.613 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.300361+0000", 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013024321 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.300394+0000", 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2258999999999997e-05 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.300415+0000", 2024-04-26T12:32:25.614 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1373e-05 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5877 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1519616~4096,write 1609728~4096,write 1675264~4096,write 1814528~4096,write 1851392~4096,write 1957888~4096,write 1994752~4096,write 2064384~4096,write 2084864~4096,write 2220032~4096,write 2408448~4096,write 2445312~8192,write 2498560~4096,write 2510848~4096,write 2727936~4096,write 2768896~4096,write 2879488~4096,write 3043328~4096,write 3100672~4096,write 3223552~4096,write 3350528~4096,write 3362816~4096,write 3395584~4096,write 3428352~4096,write 3469312~4096,write 3538944~4096,write 3608576~4096,write 3674112~4096,write 3944448~4096,write 3964928~4096,write 4030464~4096,write 4038656~4096,write 4087808~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.303431+0000", 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2530937260000004, 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016850225, 2024-04-26T12:32:25.615 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5877 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303431+0000", 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.616 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303431+0000", 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303431+0000", 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.617 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303565+0000", 2024-04-26T12:32:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013472199999999999 2024-04-26T12:32:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303572+0000", 2024-04-26T12:32:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6780000000000003e-06 2024-04-26T12:32:25.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303576+0000", 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9199999999999997e-06 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303602+0000", 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5962e-05 2024-04-26T12:32:25.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303675+0000", 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3505999999999997e-05 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304040+0000", 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036495100000000002 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317607+0000", 2024-04-26T12:32:25.620 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013567002999999999 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320197+0000", 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025896299999999999 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320246+0000", 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9237000000000003e-05 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.621 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320281+0000", 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5088e-05 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5878 4.15 4:aada5e43:::100000001f8.00000028:head [write 135168~4096,write 155648~4096,write 290816~4096,write 319488~4096,write 430080~4096,write 815104~4096,write 835584~4096,write 864256~4096,write 880640~4096,write 913408~4096,write 1048576~4096,write 1085440~4096,write 2461696~4096,write 2617344~4096,write 2768896~4096,write 2793472~4096,write 3100672~4096,write 3108864~4096,write 3276800~4096,write 3289088~4096,write 3436544~4096,write 3645440~4096,write 3895296~4096,write 3932160~4096,write 4009984~4096,write 4079616~4096,write 4177920~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.303583+0000", 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2529419669999999, 2024-04-26T12:32:25.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016171478, 2024-04-26T12:32:25.623 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.623 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.623 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.623 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.623 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.623 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5878 2024-04-26T12:32:25.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.623 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303583+0000", 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303583+0000", 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303582+0000", 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303669+0000", 2024-04-26T12:32:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6623000000000001e-05 2024-04-26T12:32:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303674+0000", 2024-04-26T12:32:25.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3489999999999999e-06 2024-04-26T12:32:25.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303679+0000", 2024-04-26T12:32:25.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7079999999999996e-06 2024-04-26T12:32:25.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303713+0000", 2024-04-26T12:32:25.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3912999999999999e-05 2024-04-26T12:32:25.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303782+0000", 2024-04-26T12:32:25.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8787000000000004e-05 2024-04-26T12:32:25.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304147+0000", 2024-04-26T12:32:25.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036504799999999998 2024-04-26T12:32:25.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.316525+0000", 2024-04-26T12:32:25.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012378062 2024-04-26T12:32:25.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319679+0000", 2024-04-26T12:32:25.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031538429999999999 2024-04-26T12:32:25.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319726+0000", 2024-04-26T12:32:25.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7364999999999998e-05 2024-04-26T12:32:25.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319754+0000", 2024-04-26T12:32:25.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8360999999999998e-05 2024-04-26T12:32:25.631 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.631 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.631 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.631 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5879 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 1548288~4096,write 1556480~4096,write 1658880~4096,write 1667072~4096,write 1679360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.632 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.303685+0000", 2024-04-26T12:32:25.632 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2528397089999999, 2024-04-26T12:32:25.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012896047000000001, 2024-04-26T12:32:25.632 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.632 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.632 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.632 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.632 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.632 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5879 2024-04-26T12:32:25.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.633 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303685+0000", 2024-04-26T12:32:25.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303685+0000", 2024-04-26T12:32:25.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303685+0000", 2024-04-26T12:32:25.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303697+0000", 2024-04-26T12:32:25.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2574e-05 2024-04-26T12:32:25.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.635 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.635 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303703+0000", 2024-04-26T12:32:25.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2419999999999997e-06 2024-04-26T12:32:25.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303709+0000", 2024-04-26T12:32:25.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5369999999999997e-06 2024-04-26T12:32:25.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303744+0000", 2024-04-26T12:32:25.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4468999999999998e-05 2024-04-26T12:32:25.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303794+0000", 2024-04-26T12:32:25.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0000000000000002e-05 2024-04-26T12:32:25.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303900+0000", 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106047 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.313825+0000", 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099253250000000005 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.316507+0000", 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026819700000000001 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.316559+0000", 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1724000000000001e-05 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.316581+0000", 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2631000000000001e-05 2024-04-26T12:32:25.639 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5882 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 114688~4096,write 344064~4096,write 589824~4096,write 712704~4096,write 757760~4096,write 1892352~4096,write 2052096~4096,write 2215936~4096,write 2232320~4096,write 2342912~4096,write 2514944~4096,write 2547712~4096,write 2641920~4096,write 2748416~4096,write 2838528~4096,write 2908160~4096,write 3059712~4096,write 3600384~4096,write 3686400~4096,write 4096000~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.303996+0000", 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.2525290010000001, 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013307235000000001, 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.640 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5882 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303996+0000", 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303996+0000", 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.303995+0000", 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304103+0000", 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000108093 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304112+0000", 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8799999999999997e-06 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304119+0000", 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9569999999999996e-06 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304399+0000", 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000279926 2024-04-26T12:32:25.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304452+0000", 2024-04-26T12:32:25.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3251000000000002e-05 2024-04-26T12:32:25.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304821+0000", 2024-04-26T12:32:25.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00036832100000000001 2024-04-26T12:32:25.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.313853+0000", 2024-04-26T12:32:25.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090322279999999998 2024-04-26T12:32:25.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317222+0000", 2024-04-26T12:32:25.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033689129999999999 2024-04-26T12:32:25.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317269+0000", 2024-04-26T12:32:25.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6882999999999998e-05 2024-04-26T12:32:25.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317303+0000", 2024-04-26T12:32:25.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4453999999999999e-05 2024-04-26T12:32:25.648 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.648 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.649 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.649 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:5884 4.19 4:997b7129:::100000001f8.00000000:head [write 28672~4096,write 69632~4096,write 94208~4096,write 421888~4096,write 999424~4096,write 1290240~4096,write 2383872~4096,write 2510848~4096,write 2592768~8192,write 2965504~4096,write 3145728~4096,write 3190784~4096,write 3383296~4096,write 3506176~8192,write 3670016~4096,write 3743744~4096,write 3756032~4096,write 3768320~4096,write 3784704~4096,write 3919872~4096,write 3940352~4096,write 4005888~4096,write 4026368~4096,write 4145152~4096,write 4161536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.649 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.304197+0000", 2024-04-26T12:32:25.649 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.252328017, 2024-04-26T12:32:25.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015648957000000002, 2024-04-26T12:32:25.650 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.650 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.650 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.650 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.650 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.650 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5884 2024-04-26T12:32:25.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.651 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304197+0000", 2024-04-26T12:32:25.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304197+0000", 2024-04-26T12:32:25.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304196+0000", 2024-04-26T12:32:25.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304641+0000", 2024-04-26T12:32:25.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044442 2024-04-26T12:32:25.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304651+0000", 2024-04-26T12:32:25.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0079e-05 2024-04-26T12:32:25.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304673+0000", 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2314999999999999e-05 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.305229+0000", 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055571699999999995 2024-04-26T12:32:25.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.305343+0000", 2024-04-26T12:32:25.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114145 2024-04-26T12:32:25.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.305784+0000", 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00044109599999999998 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.317601+0000", 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011816929 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319780+0000", 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002178939 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319822+0000", 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1897000000000002e-05 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.319846+0000", 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4029e-05 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:5880 4.c e55/13 4:33b8095f:::100000001f8.0000003a:head v 55'92, mlcod=55'90)", 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.304595+0000", 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.25193026, 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015576405999999999, 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304595+0000", 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304595+0000", 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304594+0000", 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.661 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304841+0000", 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024755799999999999 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304851+0000", 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0450000000000006e-06 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304857+0000", 2024-04-26T12:32:25.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4910000000000002e-06 2024-04-26T12:32:25.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304909+0000", 2024-04-26T12:32:25.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1687000000000002e-05 2024-04-26T12:32:25.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.304924+0000", 2024-04-26T12:32:25.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5353e-05 2024-04-26T12:32:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320145+0000", 2024-04-26T12:32:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015220638999999999 2024-04-26T12:32:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.320171+0000", 2024-04-26T12:32:25.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6308999999999998e-05 2024-04-26T12:32:25.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.666 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6438 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1445888~4096,write 1560576~4096,write 1572864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.666 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.579547+0000", 2024-04-26T12:32:25.667 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.9769778310000001, 2024-04-26T12:32:25.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013460306999999999, 2024-04-26T12:32:25.667 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.667 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.667 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6438 2024-04-26T12:32:25.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.668 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579547+0000", 2024-04-26T12:32:25.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579547+0000", 2024-04-26T12:32:25.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579546+0000", 2024-04-26T12:32:25.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579561+0000", 2024-04-26T12:32:25.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4839e-05 2024-04-26T12:32:25.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579572+0000", 2024-04-26T12:32:25.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0729e-05 2024-04-26T12:32:25.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579580+0000", 2024-04-26T12:32:25.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3049999999999993e-06 2024-04-26T12:32:25.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.671 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.671 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579615+0000", 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4465000000000003e-05 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579688+0000", 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3561999999999998e-05 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.579847+0000", 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015918900000000001 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580829+0000", 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098204799999999991 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.592920+0000", 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012090314 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.592967+0000", 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7083000000000003e-05 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.593007+0000", 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0626e-05 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6439 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1851392~4096,write 1912832~4096,write 1966080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.580063+0000", 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.9764620069999999, 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013067944999999999, 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.674 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6439 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580063+0000", 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580063+0000", 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580062+0000", 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580078+0000", 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5233e-05 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580086+0000", 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9670000000000001e-06 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.676 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580092+0000", 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5529999999999998e-06 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580134+0000", 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1535999999999997e-05 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580192+0000", 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7874000000000002e-05 2024-04-26T12:32:25.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.580337+0000", 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145105 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.583757+0000", 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034202799999999999 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.593041+0000", 2024-04-26T12:32:25.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092844769999999993 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.593086+0000", 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4591e-05 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.593131+0000", 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4844e-05 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6658 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3649536~4096,write 4145152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.671234+0000", 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8852907050000001, 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013155567999999999, 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6658 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671234+0000", 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671234+0000", 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671233+0000", 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.681 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671244+0000", 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0896999999999999e-05 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671255+0000", 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0458e-05 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671260+0000", 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.259e-06 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671303+0000", 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2910000000000001e-05 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671379+0000", 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6291999999999994e-05 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.671511+0000", 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013184000000000001 2024-04-26T12:32:25.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.679009+0000", 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074976840000000001 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.684308+0000", 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052990060000000002 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.684364+0000", 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6153000000000003e-05 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.684390+0000", 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5865000000000001e-05 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:6665 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2031616~4096,write 2236416~4096,write 2260992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:21.674017+0000", 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8825077050000001, 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012636455, 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.685 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 6665 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674017+0000", 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674017+0000", 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674016+0000", 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674032+0000", 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5681000000000001e-05 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674042+0000", 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5359999999999998e-06 2024-04-26T12:32:25.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674047+0000", 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4920000000000001e-06 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674077+0000", 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0094999999999999e-05 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674156+0000", 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9252999999999995e-05 2024-04-26T12:32:25.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.674309+0000", 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015275099999999999 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.680917+0000", 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066073709999999999 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.686571+0000", 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056549089999999996 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.686617+0000", 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5494000000000002e-05 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:21.686654+0000", 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6683000000000001e-05 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:7974 4.38 e56/13 4:1e2c7ed9:::100000001f8.0000002d:head v 56'502, mlcod=56'500)", 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:22.292402+0000", 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.2641232379999998, 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013583168, 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.292402+0000", 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.292402+0000", 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.292401+0000", 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.292414+0000", 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3147e-05 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.292421+0000", 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1760000000000004e-06 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.292426+0000", 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6800000000000001e-06 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.292453+0000", 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7284000000000002e-05 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.693 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.292465+0000", 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1378e-05 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.305946+0000", 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013481412999999999 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.305985+0000", 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8649999999999998e-05 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.694 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:8051 4.36 4:6ee5e2c4:::100000001f9.00000000:head [write 0~1048576] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:22.318439+0000", 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.238086317, 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01293035, 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 8051 2024-04-26T12:32:25.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.318439+0000", 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.318439+0000", 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.318438+0000", 2024-04-26T12:32:25.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.319669+0000", 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00123124 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.319680+0000", 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0789e-05 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.319688+0000", 2024-04-26T12:32:25.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.328295+0000", 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086070039999999997 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.328395+0000", 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100336 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.328539+0000", 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014369299999999999 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.331143+0000", 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026040600000000001 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.331321+0000", 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000178197 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.331347+0000", 2024-04-26T12:32:25.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5503999999999998e-05 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:22.331369+0000", 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2184999999999999e-05 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:25.700 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:25.702 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:25.702 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:25.700+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:25.803 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:25.802+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:25.857 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15396 4.36 e59/52 4:6fa85f86:::100000001f8.00000013:head v 59'723, mlcod=59'721)", 2024-04-26T12:32:25.857 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.855359+0000", 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0014580610000000001, 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001481521, 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.855359+0000", 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:25.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.855359+0000", 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.855358+0000", 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.855372+0000", 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3902e-05 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.855382+0000", 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0216e-05 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.855389+0000", 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.855431+0000", 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2043999999999999e-05 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.855450+0000", 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9389999999999999e-05 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15399 4.23 e59/13 4:c6f90462:::100000001f8.00000037:head v 59'220, mlcod=59'218)", 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.856380+0000", 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00043651399999999999, 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00052868900000000005, 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:25.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856380+0000", 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856380+0000", 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856380+0000", 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856395+0000", 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5336999999999999e-05 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856406+0000", 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.128e-05 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856413+0000", 2024-04-26T12:32:25.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8510000000000001e-06 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856455+0000", 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1522e-05 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856483+0000", 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8654999999999999e-05 2024-04-26T12:32:25.864 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15400 4.f e59/13 4:f2a80dfe:::100000001f8.00000019:head v 59'744, mlcod=59'742)", 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.856695+0000", 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.000121385, 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026376999999999998, 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:25.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856695+0000", 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856695+0000", 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856695+0000", 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856707+0000", 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1885999999999999e-05 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856716+0000", 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5869999999999999e-06 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856729+0000", 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2945000000000001e-05 2024-04-26T12:32:25.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856764+0000", 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5296999999999998e-05 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856780+0000", 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5302999999999999e-05 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.868 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15401 4.e e59/13)", 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.856949+0000", 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9998679, 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0196000000000004e-05, 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856949+0000", 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:25.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856949+0000", 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856948+0000", 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856961+0000", 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3596e-05 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856970+0000", 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8230000000000001e-06 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.856975+0000", 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6519999999999997e-06 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.857008+0000", 2024-04-26T12:32:25.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2567000000000002e-05 2024-04-26T12:32:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:25.872 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 4 2024-04-26T12:32:25.872 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:25.873 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:25.917 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:25.916+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:26.004 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:26.003+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:26.031 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:26.031 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:26.032 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:26.032 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:26.032 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:26.044 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:26.105 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:26.104+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:26.206 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:26.206+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:26.248 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:26.248 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:26.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 113.64253471000001, 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:26.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:32:26.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:32:26.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.255 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 113.642476648, 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:32:26.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.261 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 113.64244809500001, 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:32:26.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:32:26.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 113.64242862, 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.268 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 113.642364837, 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:26.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.116529767999999, 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013138092000000001, 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.280 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 18 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129198+0000", 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133886+0000", 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046879779999999998 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133913+0000", 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-05 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133924+0000", 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1629e-05 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133975+0000", 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1056e-05 2024-04-26T12:32:26.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134116+0000", 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014008799999999999 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134222+0000", 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106283 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.140668+0000", 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064464539999999999 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142263+0000", 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001595162 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142302+0000", 2024-04-26T12:32:26.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8331000000000003e-05 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142338+0000", 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6405999999999997e-05 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.527512980000001, 2024-04-26T12:32:26.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021336570999999999, 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 23 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718215+0000", 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722001+0000", 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037856769999999999 2024-04-26T12:32:26.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722016+0000", 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5123000000000001e-05 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722024+0000", 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6799999999999993e-06 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722085+0000", 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1277000000000003e-05 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722183+0000", 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7922000000000002e-05 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722284+0000", 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100985 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.726784+0000", 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045004479999999998 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739478+0000", 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012693594000000001 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739511+0000", 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3322999999999999e-05 2024-04-26T12:32:26.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739553+0000", 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2250999999999999e-05 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:25 4.2a 4:57147dc3:::100000001f8.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.275570350000001, 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013954156000000001, 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.292 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 25 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:26.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970158+0000", 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973845+0000", 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036870309999999999 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973859+0000", 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3431999999999999e-05 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973867+0000", 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7940000000000003e-06 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973931+0000", 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4793000000000001e-05 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974029+0000", 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7404000000000005e-05 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974117+0000", 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8641999999999996e-05 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.976886+0000", 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027684480000000002 2024-04-26T12:32:26.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984047+0000", 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.007161059 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984086+0000", 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9490000000000003e-05 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984114+0000", 2024-04-26T12:32:26.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.73e-05 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.060660403, 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012144647, 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:26.298 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 27 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185068+0000", 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188763+0000", 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036955120000000002 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188778+0000", 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4295e-05 2024-04-26T12:32:26.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188785+0000", 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4699999999999996e-06 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188863+0000", 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7713999999999995e-05 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188978+0000", 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115073 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.189082+0000", 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010394400000000001 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.191988+0000", 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029058840000000001 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197152+0000", 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0051638999999999999 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197184+0000", 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2756999999999998e-05 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197214+0000", 2024-04-26T12:32:26.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9575999999999999e-05 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:5837 4.24 4:27adda6e:::100000001f8.0000000f:head [write 671744~4096,write 806912~4096,write 888832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:21.287577+0000", 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.9581528070000003, 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012834908000000001, 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:26.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5837 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287577+0000", 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287577+0000", 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287576+0000", 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287589+0000", 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2918999999999999e-05 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287600+0000", 2024-04-26T12:32:26.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0713000000000001e-05 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287606+0000", 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2670000000000003e-06 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287636+0000", 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0306000000000001e-05 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287689+0000", 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2423999999999998e-05 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287779+0000", 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9884999999999997e-05 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.289247+0000", 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014684089999999999 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.300328+0000", 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011080922 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.300371+0000", 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2749e-05 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.300412+0000", 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1282000000000002e-05 2024-04-26T12:32:26.309 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:14337 4.24 4:27adda6e:::100000001f8.0000000f:head [write 966656~4096,write 1040384~4096,write 1089536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.88253408099999997, 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014670404, 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.310 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 14337 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363195+0000", 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363205+0000", 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363216+0000", 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363222+0000", 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8690000000000001e-06 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363265+0000", 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2571999999999998e-05 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363340+0000", 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5190000000000003e-05 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363526+0000", 2024-04-26T12:32:26.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185897 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.364824+0000", 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001298238 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377804+0000", 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012979892999999999 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377837+0000", 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3642000000000001e-05 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377866+0000", 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8657e-05 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15151 4.31 e59/13 4:8fb8ba0c:::100000001f8.00000024:head v 59'234, mlcod=59'231)", 2024-04-26T12:32:26.315 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50287538399999998, 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012740345, 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742870+0000", 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6078000000000001e-05 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742885+0000", 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4919999999999999e-05 2024-04-26T12:32:26.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742891+0000", 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742923+0000", 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1575999999999997e-05 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742940+0000", 2024-04-26T12:32:26.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7771e-05 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755553+0000", 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012612959999999999 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755595+0000", 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1529000000000002e-05 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.319 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15152 4.13 e59/13 4:cbf33e86:::100000001f8.00000026:head v 59'478, mlcod=59'476)", 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.743204+0000", 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50252616500000002, 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012507279, 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743204+0000", 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743204+0000", 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743203+0000", 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743216+0000", 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.26e-05 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743224+0000", 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6519999999999995e-06 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743229+0000", 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1819999999999999e-06 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743263+0000", 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4139e-05 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743288+0000", 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5119000000000001e-05 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755675+0000", 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012387359000000001 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755711+0000", 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5726000000000003e-05 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15153 4.3b e59/52 4:dcc0c15f:::100000001f8.0000001a:head v 59'227, mlcod=59'225)", 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.743555+0000", 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50217477799999999, 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012180757, 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.324 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743555+0000", 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743555+0000", 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743554+0000", 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743570+0000", 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5591e-05 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743587+0000", 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.664e-05 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743595+0000", 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7749999999999998e-06 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743623+0000", 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7246999999999998e-05 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743635+0000", 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.277e-05 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755714+0000", 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012078884 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755736+0000", 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1522000000000002e-05 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.328 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15154 4.2d e59/13 4:b4aa06e9:::100000001f8.0000001d:head v 59'480, mlcod=59'477)", 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.743969+0000", 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.501760541, 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011747148000000001, 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743969+0000", 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743969+0000", 2024-04-26T12:32:26.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743969+0000", 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743983+0000", 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4696e-05 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743995+0000", 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1986e-05 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744002+0000", 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.046e-06 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744029+0000", 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6987000000000001e-05 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744040+0000", 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1070000000000001e-05 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755662+0000", 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01162148 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755716+0000", 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4474000000000001e-05 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15155 4.6 e59/52 4:635f8cb4:::100000001f8.0000003c:head v 59'916, mlcod=59'914)", 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50155064599999999, 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012694219, 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744192+0000", 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3468e-05 2024-04-26T12:32:26.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744203+0000", 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0834e-05 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744211+0000", 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744262+0000", 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1607999999999998e-05 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744280+0000", 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7931000000000002e-05 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756849+0000", 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012568924 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756873+0000", 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4357000000000001e-05 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15156 4.8 e59/52 4:11ee3b64:::100000001f8.0000003e:head v 59'235, mlcod=59'233)", 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.744636+0000", 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50109351400000002, 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012310519000000001, 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.337 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744636+0000", 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744636+0000", 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744636+0000", 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744649+0000", 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3495e-05 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744660+0000", 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0689e-05 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744666+0000", 2024-04-26T12:32:26.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0780000000000001e-06 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744702+0000", 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5936000000000003e-05 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744723+0000", 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756915+0000", 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012191997 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756947+0000", 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2149e-05 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15157 4.3d e59/13 4:bd3afb9d:::100000001f8.00000009:head v 59'470, mlcod=59'468)", 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.745129+0000", 2024-04-26T12:32:26.341 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50060109900000005, 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011775404, 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745129+0000", 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745129+0000", 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745128+0000", 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745143+0000", 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5218999999999999e-05 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745151+0000", 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0620000000000001e-06 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745156+0000", 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7269999999999998e-06 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745180+0000", 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3671000000000001e-05 2024-04-26T12:32:26.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745192+0000", 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2323999999999999e-05 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756882+0000", 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011690002 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756904+0000", 2024-04-26T12:32:26.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1931999999999999e-05 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15638 4.28 e59/52 4:15eeb89b:::100000001f8.00000032:head v 59'488, mlcod=59'486)", 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.969304+0000", 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.27642620699999998, 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01195852, 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969304+0000", 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969304+0000", 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969303+0000", 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969328+0000", 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5043999999999999e-05 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969336+0000", 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8769999999999993e-06 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969342+0000", 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3419999999999998e-06 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969388+0000", 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6647000000000002e-05 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969410+0000", 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2302000000000001e-05 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.981222+0000", 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011811510000000001 2024-04-26T12:32:26.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.981262+0000", 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15720 4.12 e59/13 4:48ab9bde:::100000001f8.00000015:head v 59'493, mlcod=59'489)", 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.238381747, 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015457238999999999, 2024-04-26T12:32:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:26.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007347+0000", 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007368+0000", 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0183999999999999e-05 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007378+0000", 2024-04-26T12:32:26.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0499000000000001e-05 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007394+0000", 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6254999999999999e-05 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.009739+0000", 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023449489999999998 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.009760+0000", 2024-04-26T12:32:26.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1128000000000002e-05 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.022776+0000", 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013015729 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.022805+0000", 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9096999999999999e-05 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.355 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:26.355 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:26.355 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:26.356 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:26.355+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:26.357 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:32:26.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:26.457 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:26.456+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:26.508 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:26.508 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:26.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:16723 4.a 4:50194ce5:::100000001f8.00000027:head [write 3309568~4096 in=4096b,write 3342336~4096 in=4096b,write 3440640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:26.505518+0000", 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0028472549999999999, 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028673850000000001, 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 16723 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.505518+0000", 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.505518+0000", 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.505517+0000", 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.505531+0000", 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4398e-05 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.505544+0000", 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2738000000000001e-05 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.505552+0000", 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1820000000000006e-06 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.505589+0000", 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6616999999999999e-05 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.505643+0000", 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4240999999999998e-05 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.505726+0000", 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2613000000000003e-05 2024-04-26T12:32:26.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.506647+0000", 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00092086299999999996 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:16726 4.38 4:1dcf718c:::100000001f8.00000022:head [write 1400832~4096 in=4096b,write 1499136~4096 in=4096b,write 1523712~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:26.507294+0000", 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0010710579999999999, 2024-04-26T12:32:26.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0011552730000000001, 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 16726 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.507294+0000", 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.507294+0000", 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.507293+0000", 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.507303+0000", 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6549999999999999e-06 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.507311+0000", 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5680000000000002e-06 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.507316+0000", 2024-04-26T12:32:26.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2140000000000004e-06 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.507348+0000", 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2446000000000001e-05 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.507393+0000", 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5083999999999997e-05 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:26.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.507473+0000", 2024-04-26T12:32:26.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0038999999999997e-05 2024-04-26T12:32:26.518 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.518 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.518 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.518 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.518 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:26.518 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 2 2024-04-26T12:32:26.518 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:26.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:26.558 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:26.557+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:26.659 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:26.657+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:26.683 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:26.683 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:26.683 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:26.683 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:26.683 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:26.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:26.760 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:26.759+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:26.861 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:26.861 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:26.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:26.861 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:26.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14175 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1835008~4096,write 1945600~4096,write 2031616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.5656034330000002, 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.98270771099999998, 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14175 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292076+0000", 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1482e-05 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292089+0000", 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2865e-05 2024-04-26T12:32:26.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292097+0000", 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6290000000000001e-06 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292141+0000", 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4759000000000003e-05 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292152+0000", 2024-04-26T12:32:26.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0906e-05 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264779+0000", 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.97262671899999997 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264860+0000", 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0871999999999994e-05 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264964+0000", 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104584 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269185+0000", 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042204790000000001 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274691+0000", 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0055061140000000003 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274737+0000", 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6428999999999999e-05 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274773+0000", 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5722999999999997e-05 2024-04-26T12:32:26.868 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14176 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3907584~4096,write 4022272~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.565324317, 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.98263749300000003, 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.869 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14176 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292344+0000", 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292364+0000", 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0412e-05 2024-04-26T12:32:26.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292371+0000", 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.477e-06 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292375+0000", 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8840000000000004e-06 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292408+0000", 2024-04-26T12:32:26.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3003999999999998e-05 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292416+0000", 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0620000000000001e-06 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266076+0000", 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.97366027499999996 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266132+0000", 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6279000000000001e-05 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266224+0000", 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1463000000000002e-05 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269227+0000", 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0030027220000000002 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274894+0000", 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0056677730000000001 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274944+0000", 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9356e-05 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274982+0000", 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8343999999999997e-05 2024-04-26T12:32:26.875 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14209 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2813952~4096,write 2973696~4096,write 3047424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.5502183550000002, 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.96821334599999997, 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.876 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14209 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307465+0000", 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4949e-05 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307479+0000", 2024-04-26T12:32:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4707e-05 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307490+0000", 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0146000000000001e-05 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307531+0000", 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1677000000000001e-05 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307538+0000", 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7309999999999996e-06 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266634+0000", 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.959096422 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266704+0000", 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9338000000000006e-05 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266808+0000", 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103847 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269265+0000", 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0024577010000000001 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275617+0000", 2024-04-26T12:32:26.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0063514490000000003 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275644+0000", 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7761000000000001e-05 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275664+0000", 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9340000000000001e-05 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14210 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3596288~4096,write 3612672~4096,write 3633152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.54983396, 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.96837596400000003, 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14210 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.883 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307834+0000", 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307850+0000", 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5736e-05 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307860+0000", 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6050000000000004e-06 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307867+0000", 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307928+0000", 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0779999999999997e-05 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307935+0000", 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0400000000000004e-06 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267291+0000", 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.95935644200000003 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267350+0000", 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8502999999999999e-05 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267438+0000", 2024-04-26T12:32:26.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8274000000000002e-05 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269295+0000", 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018571449999999999 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276165+0000", 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0068700970000000004 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276191+0000", 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6043000000000001e-05 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276211+0000", 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9599999999999999e-05 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.889 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14234 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 872448~4096,write 937984~4096,write 1011712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.53870749, 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.95729165400000005, 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14234 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318973+0000", 2024-04-26T12:32:26.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1941e-05 2024-04-26T12:32:26.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318981+0000", 2024-04-26T12:32:26.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5099999999999998e-06 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318988+0000", 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7349999999999999e-06 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.319020+0000", 2024-04-26T12:32:26.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2155e-05 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.319027+0000", 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8129999999999998e-06 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268425+0000", 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.949398454 2024-04-26T12:32:26.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268508+0000", 2024-04-26T12:32:26.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2711000000000001e-05 2024-04-26T12:32:26.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268677+0000", 2024-04-26T12:32:26.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000168956 2024-04-26T12:32:26.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274681+0000", 2024-04-26T12:32:26.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.006004255 2024-04-26T12:32:26.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276216+0000", 2024-04-26T12:32:26.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015346680000000001 2024-04-26T12:32:26.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276237+0000", 2024-04-26T12:32:26.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:32:26.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276253+0000", 2024-04-26T12:32:26.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5809999999999999e-05 2024-04-26T12:32:26.899 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.899 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.899 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14298 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1114112~4096,write 1130496~4096,write 1196032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.5103797910000001, 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.92900384300000005, 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14298 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347288+0000", 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347301+0000", 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2772000000000001e-05 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347310+0000", 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5909999999999996e-06 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347316+0000", 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5180000000000001e-06 2024-04-26T12:32:26.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347350+0000", 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3643000000000003e-05 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347358+0000", 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6739999999999997e-06 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269323+0000", 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.921965492 2024-04-26T12:32:26.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269443+0000", 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000119998 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269600+0000", 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015721600000000001 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274812+0000", 2024-04-26T12:32:26.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.005211551 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276257+0000", 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014454190000000001 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276278+0000", 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0403000000000001e-05 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276293+0000", 2024-04-26T12:32:26.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5235999999999999e-05 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14357 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 319488~4096,write 528384~4096,write 536576~4096,write 552960~4096,write 704512~4096,write 741376~4096,write 1064960~4096,write 1359872~4096,write 1409024~4096,write 1536000~4096,write 1581056~4096,write 1650688~4096,write 1658880~4096,write 1781760~4096,write 1822720~4096,write 2183168~4096,write 2191360~4096,write 2306048~4096,write 2433024~4096,write 2633728~4096,write 2650112~4096,write 2662400~4096,write 2797568~4096,write 3153920~4096,write 3182592~4096,write 3194880~4096,write 3420160~4096,write 3469312~4096,write 3584000~4096,write 3670016~4096,write 3829760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.488127854, 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.91281808399999997, 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.906 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14357 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369640+0000", 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9499000000000004e-05 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369645+0000", 2024-04-26T12:32:26.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.51e-06 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369648+0000", 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4879999999999999e-06 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.371151+0000", 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001503332 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.371162+0000", 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270133+0000", 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.89897075599999998 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270195+0000", 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2224000000000006e-05 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270513+0000", 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00031765100000000001 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275008+0000", 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0044954000000000001 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282289+0000", 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072804460000000003 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282335+0000", 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6337e-05 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282359+0000", 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3918999999999999e-05 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.912 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14616 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 24576~4096,write 32768~4096,write 57344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.3396338910000001, 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.76447159499999995, 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14616 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.913 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518034+0000", 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518046+0000", 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1545999999999999e-05 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518054+0000", 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0029999999999994e-06 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518059+0000", 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9470000000000002e-06 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518200+0000", 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014118799999999999 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518210+0000", 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0275000000000001e-05 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275044+0000", 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.75683380899999997 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275126+0000", 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1536e-05 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275221+0000", 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5253000000000004e-05 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282369+0000", 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071480729999999996 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282438+0000", 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9494999999999998e-05 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282472+0000", 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3896999999999997e-05 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282507+0000", 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4245999999999997e-05 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14664 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 0~4096,write 110592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.320317078, 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.74525697300000004, 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.919 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14664 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537351+0000", 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537360+0000", 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4080000000000004e-06 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537370+0000", 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4080000000000004e-06 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537375+0000", 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4600000000000002e-06 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537408+0000", 2024-04-26T12:32:26.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2237999999999999e-05 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537414+0000", 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0619999999999997e-06 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275680+0000", 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.73826678099999998 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275731+0000", 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0281000000000002e-05 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275814+0000", 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3407999999999998e-05 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282375+0000", 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065614180000000003 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282558+0000", 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00018219699999999999 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282588+0000", 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0051000000000001e-05 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282609+0000", 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1021000000000001e-05 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.925 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14959 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 118784~4096,write 270336~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.193699289, 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.61876598900000002, 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.926 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14959 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663969+0000", 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663977+0000", 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4230000000000005e-06 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663985+0000", 2024-04-26T12:32:26.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.277e-06 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663989+0000", 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7650000000000001e-06 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.664023+0000", 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3277e-05 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.664030+0000", 2024-04-26T12:32:26.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0759999999999997e-06 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276327+0000", 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.61229685599999994 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276405+0000", 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:32:26.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276583+0000", 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017775700000000001 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282380+0000", 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0057972709999999997 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282654+0000", 2024-04-26T12:32:26.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000273095 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282699+0000", 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5129000000000001e-05 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282736+0000", 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.684e-05 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15290 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2097152~4096,write 2134016~4096,write 2248704~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.0540650549999999, 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.48063225399999998, 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15290 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803603+0000", 2024-04-26T12:32:26.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803611+0000", 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8990000000000001e-06 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803618+0000", 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0119999999999999e-06 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803623+0000", 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2930000000000002e-06 2024-04-26T12:32:26.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803650+0000", 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7858e-05 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803657+0000", 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1430000000000003e-06 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277533+0000", 2024-04-26T12:32:26.937 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.473876666 2024-04-26T12:32:26.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.937 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.937 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.937 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277591+0000", 2024-04-26T12:32:26.937 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7605999999999997e-05 2024-04-26T12:32:26.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277692+0000", 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000100868 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282386+0000", 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046946890000000002 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284181+0000", 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001795079 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284216+0000", 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284236+0000", 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0171000000000001e-05 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15338 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3837952~4096,write 3850240~4096,write 4026368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.0313059520000001, 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45796468000000001, 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15338 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.940 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826362+0000", 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826384+0000", 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2115000000000001e-05 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826394+0000", 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.2250000000000006e-06 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826399+0000", 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.259e-06 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826438+0000", 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9082999999999998e-05 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826449+0000", 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0747000000000001e-05 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278509+0000", 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45205991600000001 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278588+0000", 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9072000000000005e-05 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278725+0000", 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000137207 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282392+0000", 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0036672520000000002 2024-04-26T12:32:26.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284276+0000", 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018842780000000001 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284307+0000", 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284328+0000", 2024-04-26T12:32:26.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0778e-05 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15354 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1396736~4096,write 1449984~4096,write 1675264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 1.023533013, 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45026424700000001, 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.946 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15354 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834135+0000", 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834147+0000", 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2592000000000001e-05 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834157+0000", 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5550000000000008e-06 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.948 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834170+0000", 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2683999999999999e-05 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834202+0000", 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2668e-05 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834209+0000", 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279284+0000", 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.44507556799999998 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279333+0000", 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8560999999999998e-05 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279427+0000", 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3917000000000002e-05 2024-04-26T12:32:26.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282397+0000", 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029705460000000001 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284358+0000", 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0019611770000000001 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284383+0000", 2024-04-26T12:32:26.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284400+0000", 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.747e-05 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15416 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 950272~4096,write 1155072~4096,write 1245184~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.99397709700000003, 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.420828757, 2024-04-26T12:32:26.952 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15416 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863691+0000", 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863706+0000", 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:32:26.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863716+0000", 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0139000000000001e-05 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863723+0000", 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9290000000000001e-06 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863762+0000", 2024-04-26T12:32:26.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863769+0000", 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1509999999999998e-06 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280011+0000", 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.416241743 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280098+0000", 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7367000000000006e-05 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280249+0000", 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000150168 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282617+0000", 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023680839999999999 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284444+0000", 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018270000000000001 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284488+0000", 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4659000000000001e-05 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284520+0000", 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2193000000000002e-05 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.958 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15421 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3383296~4096,write 3407872~4096,write 3440640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.99169979399999997, 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.41862908900000001, 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15421 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.959 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865968+0000", 2024-04-26T12:32:26.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865986+0000", 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7314000000000001e-05 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865994+0000", 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2409999999999995e-06 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866000+0000", 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866042+0000", 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2162000000000001e-05 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866049+0000", 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5270000000000004e-06 2024-04-26T12:32:26.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280822+0000", 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.414773799 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280904+0000", 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2118000000000002e-05 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281077+0000", 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017207600000000001 2024-04-26T12:32:26.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282621+0000", 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015443259999999999 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284550+0000", 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001928969 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284580+0000", 2024-04-26T12:32:26.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9835000000000001e-05 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284598+0000", 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8447000000000001e-05 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15449 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 405504~4096,write 671744~4096,write 700416~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.97964734799999997, 2024-04-26T12:32:26.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.40665650599999997, 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15449 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878038+0000", 2024-04-26T12:32:26.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7227999999999998e-05 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878049+0000", 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0869999999999999e-05 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878054+0000", 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2619999999999998e-06 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878085+0000", 2024-04-26T12:32:26.968 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0559000000000003e-05 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878091+0000", 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9939999999999997e-06 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281693+0000", 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.40360222499999998 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281747+0000", 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4017999999999997e-05 2024-04-26T12:32:26.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281850+0000", 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103348 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284244+0000", 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023942669999999998 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284637+0000", 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000392369 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284660+0000", 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3116e-05 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284678+0000", 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8048999999999999e-05 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15473 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3801088~4096,write 4050944~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.96696688200000003, 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39472404999999999, 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15473 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.972 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890701+0000", 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890723+0000", 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1681000000000001e-05 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890731+0000", 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5349999999999999e-06 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890735+0000", 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8520000000000003e-06 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890988+0000", 2024-04-26T12:32:26.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025219499999999998 2024-04-26T12:32:26.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890994+0000", 2024-04-26T12:32:26.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282756+0000", 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39176148700000002 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282818+0000", 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2429999999999997e-05 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282922+0000", 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103094 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284408+0000", 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001486343 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285350+0000", 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00094174299999999999 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285388+0000", 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8306000000000002e-05 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285426+0000", 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8102999999999998e-05 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15483 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2674688~4096,write 3006464~4096,write 3055616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.978 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.96278939900000005, 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39308472300000002, 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15483 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.979 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:26.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:26.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:26.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894890+0000", 2024-04-26T12:32:26.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1477999999999999e-05 2024-04-26T12:32:26.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.983 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894902+0000", 2024-04-26T12:32:26.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1802e-05 2024-04-26T12:32:26.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.983 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.983 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894909+0000", 2024-04-26T12:32:26.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8700000000000003e-06 2024-04-26T12:32:26.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.984 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.984 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894980+0000", 2024-04-26T12:32:26.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1518000000000002e-05 2024-04-26T12:32:26.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894991+0000", 2024-04-26T12:32:26.985 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0916e-05 2024-04-26T12:32:26.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.985 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283304+0000", 2024-04-26T12:32:26.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38831311299999999 2024-04-26T12:32:26.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283374+0000", 2024-04-26T12:32:26.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9589000000000001e-05 2024-04-26T12:32:26.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283526+0000", 2024-04-26T12:32:26.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015212 2024-04-26T12:32:26.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285298+0000", 2024-04-26T12:32:26.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001772385 2024-04-26T12:32:26.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287859+0000", 2024-04-26T12:32:26.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0025601439999999999 2024-04-26T12:32:26.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.989 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.989 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287919+0000", 2024-04-26T12:32:26.989 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9951000000000002e-05 2024-04-26T12:32:26.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.989 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287964+0000", 2024-04-26T12:32:26.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5608000000000001e-05 2024-04-26T12:32:26.990 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.990 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.990 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15503 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2396160~4096,write 2449408~4096,write 2605056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.95326263700000002, 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38366402100000002, 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15503 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:26.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904405+0000", 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904421+0000", 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5413e-05 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904431+0000", 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0244999999999999e-05 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904442+0000", 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0746e-05 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904487+0000", 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4858999999999999e-05 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904501+0000", 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4498000000000001e-05 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284701+0000", 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38019989100000001 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284748+0000", 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6668000000000001e-05 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:26.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284839+0000", 2024-04-26T12:32:26.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1133999999999999e-05 2024-04-26T12:32:26.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:26.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287788+0000", 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029491349999999999 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288005+0000", 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00021703299999999999 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288033+0000", 2024-04-26T12:32:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7971e-05 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288070+0000", 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7231000000000003e-05 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15520 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3747840~4096,write 3772416~4096,write 4149248~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.94444099199999998, 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.37495473499999998, 2024-04-26T12:32:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15520 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:27.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:27.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:27.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:27.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:27.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:27.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913227+0000", 2024-04-26T12:32:27.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:27.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:27.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913241+0000", 2024-04-26T12:32:27.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3995999999999999e-05 2024-04-26T12:32:27.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:27.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913250+0000", 2024-04-26T12:32:27.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:32:27.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913257+0000", 2024-04-26T12:32:27.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4649999999999997e-06 2024-04-26T12:32:27.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:27.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913297+0000", 2024-04-26T12:32:27.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9274999999999999e-05 2024-04-26T12:32:27.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:27.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913303+0000", 2024-04-26T12:32:27.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4049999999999997e-06 2024-04-26T12:32:27.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:27.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285461+0000", 2024-04-26T12:32:27.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.37215769999999998 2024-04-26T12:32:27.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:27.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285508+0000", 2024-04-26T12:32:27.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6938999999999999e-05 2024-04-26T12:32:27.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285613+0000", 2024-04-26T12:32:27.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00010532899999999999 2024-04-26T12:32:27.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:27.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288084+0000", 2024-04-26T12:32:27.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002471132 2024-04-26T12:32:27.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:27.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288121+0000", 2024-04-26T12:32:27.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6665000000000002e-05 2024-04-26T12:32:27.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:27.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288148+0000", 2024-04-26T12:32:27.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7379e-05 2024-04-26T12:32:27.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:27.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:27.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:27.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288183+0000", 2024-04-26T12:32:27.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4419999999999999e-05 2024-04-26T12:32:27.008 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:27.009 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:27.009 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:27.009 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:27.009 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:27.009 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:27.010 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:27.012 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:27.009+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:27.012 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:27.111 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:27.110+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:27.189 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:27.189 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:27.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.189 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18163 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 819200~4096 in=4096b,write 827392~4096 in=4096b,write 851968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.189 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.186871+0000", 2024-04-26T12:32:27.189 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0013036359999999999, 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001326287, 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18163 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186871+0000", 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186871+0000", 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186871+0000", 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186881+0000", 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0142999999999999e-05 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186890+0000", 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7919999999999998e-06 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186902+0000", 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2584e-05 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186932+0000", 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9399000000000001e-05 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186995+0000", 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3651000000000004e-05 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187101+0000", 2024-04-26T12:32:27.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000105429 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18164 4.19 4:997b7129:::100000001f8.00000000:head [write 1081344~4096 in=4096b,write 1241088~4096 in=4096b,write 1265664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.187575+0000", 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00059966100000000003, 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000675989, 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18164 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187575+0000", 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187575+0000", 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187574+0000", 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187588+0000", 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3154e-05 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187599+0000", 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1049999999999999e-05 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187606+0000", 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3710000000000002e-06 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.188133+0000", 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052730099999999999 2024-04-26T12:32:27.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.188204+0000", 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0900000000000002e-05 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18165 4.6 4:616d4c41:::100000001f8.00000034:head [write 147456~4096 in=4096b,write 172032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.187972+0000", 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.000203513, 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033147199999999997, 2024-04-26T12:32:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18165 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187972+0000", 2024-04-26T12:32:27.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187972+0000", 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187971+0000", 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187982+0000", 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0822000000000001e-05 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187993+0000", 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1704e-05 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.188002+0000", 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5040000000000002e-06 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.188044+0000", 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2546000000000002e-05 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.188103+0000", 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9225000000000003e-05 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.188226+0000", 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122247 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.202 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.203 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.205 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18152 4.37 4:ef395e89:::100000001f8.00000020:head [write 3018752~4096 in=4096b,write 3067904~4096 in=4096b,write 3108864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.205 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.181884+0000", 2024-04-26T12:32:27.205 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0062905729999999998, 2024-04-26T12:32:27.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064650439999999997, 2024-04-26T12:32:27.205 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.205 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:27.205 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.205 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18152 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.181884+0000", 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.181884+0000", 2024-04-26T12:32:27.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.181884+0000", 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.181898+0000", 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4080000000000001e-05 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.181905+0000", 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0679999999999999e-06 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.181910+0000", 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8799999999999999e-06 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182038+0000", 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012766599999999999 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182095+0000", 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7089000000000002e-05 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182185+0000", 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9993000000000004e-05 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186655+0000", 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044702350000000004 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.209 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18154 4.3f 4:fde182c5:::100000001f8.00000039:head [write 2519040~4096 in=4096b,write 2605056~4096 in=4096b,write 2641920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.182871+0000", 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0053042990000000002, 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055272960000000001, 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.210 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18154 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182871+0000", 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182871+0000", 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182870+0000", 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182891+0000", 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1259000000000001e-05 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182902+0000", 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1191e-05 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182909+0000", 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0230000000000004e-06 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.182951+0000", 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2024000000000003e-05 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183047+0000", 2024-04-26T12:32:27.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5183e-05 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183149+0000", 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101951 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186688+0000", 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035389689999999999 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18156 4.28 4:15eeb89b:::100000001f8.00000032:head [write 2080768~4096 in=4096b,write 2109440~4096 in=4096b,write 2125824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.183562+0000", 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0046128949999999997, 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048834120000000002, 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18156 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183562+0000", 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183562+0000", 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183561+0000", 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:27.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183575+0000", 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3995000000000001e-05 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183584+0000", 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.132e-06 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183592+0000", 2024-04-26T12:32:27.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3989999999999998e-06 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183680+0000", 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8159999999999996e-05 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183772+0000", 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2161000000000001e-05 2024-04-26T12:32:27.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.183879+0000", 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000107249 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186702+0000", 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028222439999999998 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18157 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 1204224~4096 in=4096b,write 1220608~4096 in=4096b,write 1425408~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.184137+0000", 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0040383700000000003, 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043556300000000001, 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18157 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.184137+0000", 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.184137+0000", 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.184136+0000", 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.184151+0000", 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5276000000000001e-05 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.184164+0000", 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3223e-05 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.184173+0000", 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1579999999999994e-06 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.184212+0000", 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8954e-05 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.184298+0000", 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5909999999999996e-05 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.184388+0000", 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0129000000000004e-05 2024-04-26T12:32:27.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186844+0000", 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024552480000000002 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18160 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 73728~4096 in=4096b,write 147456~4096 in=4096b,write 266240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.185644+0000", 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0025312720000000002, 2024-04-26T12:32:27.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028992760000000001, 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18160 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185644+0000", 2024-04-26T12:32:27.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185644+0000", 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185643+0000", 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185656+0000", 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3084e-05 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185666+0000", 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9960000000000005e-06 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185671+0000", 2024-04-26T12:32:27.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.169e-06 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185707+0000", 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5345000000000001e-05 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185766+0000", 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9098999999999998e-05 2024-04-26T12:32:27.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185876+0000", 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109894 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187244+0000", 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013687110000000001 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18161 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 815104~4096 in=4096b,write 1028096~4096 in=4096b,write 1036288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.185944+0000", 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0022307270000000001, 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002674156, 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18161 2024-04-26T12:32:27.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185944+0000", 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185944+0000", 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185944+0000", 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185955+0000", 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1014e-05 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185961+0000", 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4919999999999998e-06 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.185966+0000", 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1189999999999996e-06 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186004+0000", 2024-04-26T12:32:27.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8180999999999999e-05 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186094+0000", 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0006999999999994e-05 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186242+0000", 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000147754 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.187567+0000", 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001324743 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:18162 4.12 4:48ab9bde:::100000001f8.00000015:head [write 3637248~4096 in=4096b,write 3665920~4096 in=4096b,write 3715072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:27.186511+0000", 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0016638200000000001, 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021973840000000001, 2024-04-26T12:32:27.236 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 18162 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186511+0000", 2024-04-26T12:32:27.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186511+0000", 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186510+0000", 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186526+0000", 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5591e-05 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186537+0000", 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0942e-05 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:27.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186544+0000", 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4270000000000002e-06 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186584+0000", 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9829000000000001e-05 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186657+0000", 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2609999999999998e-05 2024-04-26T12:32:27.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.186769+0000", 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111907 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:27.188577+0000", 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0018086039999999999 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:27.241 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.242 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:27.242 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-04-26T12:32:27.242 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 10 2024-04-26T12:32:27.242 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:27.242 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:32:27.242 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:32:27.243 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T12:32:27.243 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:32:27.243 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:32:27.243 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T12:32:27.245 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:27.242+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:27.245 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:27.245 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:27.246 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:27.252 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:27.254 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:27.254 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:27.254 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:27.345 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:27.345+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:27.445 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:27.445+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:27.454 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:27.454 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "" 2024-04-26T12:32:27.454 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:27.457 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:27.458 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:27.475 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:27.546 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:27.545+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:27.647 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:27.647+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:27.690 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:27.690 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:27.705 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:27.748 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:27.748+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:27.850 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:27.849+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:27.866 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:27.867 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:27.880 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:27.951 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:27.950+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:28.036 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:28.036 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:28.050 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:28.052 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:28.051+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:28.152 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:28.153+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:28.209 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:28.209 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:28.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:28.253 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:28.253+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:28.354 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:28.353+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:28.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:32:28.388 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:28.388 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:28.402 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:28.456 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:28.455+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:28.557 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:28.556+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:28.557 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:28.557 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:28.572 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:28.658 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:28.657+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:28.738 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:28.739 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:28.753 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:28.797 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:28.796+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:28.860 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:28.859+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:28.874 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:32:28.930 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:28.930 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:28.943 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:28.984 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:28.983+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:29.063 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:29.062+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:29.157 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:29.157 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:29.163 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:29.162+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:29.171 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:29.264 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:29.264+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:29.271 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:29.365 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:29.364+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:29.383 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:29.383 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:29.397 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:29.467 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:29.466+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:29.469 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:29.495 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:29.520 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:29.522 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:29.522 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:29.522 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:29.561 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:23179 4.2f e61/13 4:f59f865b:::100000001f8.00000007:head v 61'356, mlcod=61'354)", 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:29.559588+0000", 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0020594350000000001, 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020841369999999998, 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.559588+0000", 2024-04-26T12:32:29.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.559588+0000", 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.559588+0000", 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:29.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.559612+0000", 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4298999999999999e-05 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.559619+0000", 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8900000000000001e-06 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.559624+0000", 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5740000000000003e-06 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.559663+0000", 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8269000000000002e-05 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.559693+0000", 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9978999999999999e-05 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:23180 4.37 e61/13 4:ecbf0fb2:::100000001f8.00000038:head v 61'1081, mlcod=61'1077)", 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:29.560141+0000", 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0015064869999999999, 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001606304, 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.560141+0000", 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.560141+0000", 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.560140+0000", 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.560157+0000", 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7011e-05 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.560166+0000", 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9120000000000004e-06 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.560174+0000", 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5190000000000003e-06 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.560195+0000", 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1359e-05 2024-04-26T12:32:29.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.560208+0000", 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2503e-05 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:23181 4.34 e61/52 4:2d2c9530:::100000001f8.00000036:head v 61'371, mlcod=61'369)", 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:29.561622+0000", 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 2.5711000000000002e-05, 2024-04-26T12:32:29.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000168519, 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.561622+0000", 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:29.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.561622+0000", 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.561621+0000", 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.561631+0000", 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.048e-05 2024-04-26T12:32:29.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.561641+0000", 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.876e-06 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.561646+0000", 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8760000000000004e-06 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.561678+0000", 2024-04-26T12:32:29.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1986000000000002e-05 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:29.561693+0000", 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5243e-05 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 3 2024-04-26T12:32:29.573 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:29.574 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:29.573+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:29.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:29.675 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:29.674+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:29.739 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:29.740 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:29.740 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:29.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:29.775 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:29.775+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:29.878 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:29.877+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:29.960 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:29.960 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:29.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:29.960 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 117.354634676, 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:29.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:32:29.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:29.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:32:29.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:29.968 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 117.354576614, 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:29.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:32:29.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:32:29.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:29.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:32:29.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:29.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 117.354548061, 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:29.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:32:29.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:32:29.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:32:29.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.983 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 117.354528586, 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:29.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:32:29.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:29.990 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 117.354464803, 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:29.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:29.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:29.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:32:29.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:29.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:32:29.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:29.998 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.828629734, 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013138092000000001, 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 18 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:29.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129198+0000", 2024-04-26T12:32:30.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133886+0000", 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046879779999999998 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133913+0000", 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-05 2024-04-26T12:32:30.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133924+0000", 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1629e-05 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133975+0000", 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1056e-05 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134116+0000", 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014008799999999999 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134222+0000", 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106283 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.140668+0000", 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064464539999999999 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142263+0000", 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001595162 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142302+0000", 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8331000000000003e-05 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142338+0000", 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6405999999999997e-05 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.005 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 17.239612946000001, 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021336570999999999, 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 23 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.006 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718215+0000", 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722001+0000", 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037856769999999999 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722016+0000", 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5123000000000001e-05 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722024+0000", 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6799999999999993e-06 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722085+0000", 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1277000000000003e-05 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722183+0000", 2024-04-26T12:32:30.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7922000000000002e-05 2024-04-26T12:32:30.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:30.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722284+0000", 2024-04-26T12:32:30.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100985 2024-04-26T12:32:30.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.726784+0000", 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045004479999999998 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739478+0000", 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012693594000000001 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739511+0000", 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3322999999999999e-05 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739553+0000", 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2250999999999999e-05 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:25 4.2a 4:57147dc3:::100000001f8.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.987670315999999, 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013954156000000001, 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 25 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970158+0000", 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973845+0000", 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036870309999999999 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973859+0000", 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3431999999999999e-05 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973867+0000", 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7940000000000003e-06 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973931+0000", 2024-04-26T12:32:30.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4793000000000001e-05 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974029+0000", 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7404000000000005e-05 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974117+0000", 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8641999999999996e-05 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.976886+0000", 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027684480000000002 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984047+0000", 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.007161059 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984086+0000", 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9490000000000003e-05 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984114+0000", 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.73e-05 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 16.772760369, 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012144647, 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:30.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 27 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185069+0000", 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.185068+0000", 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188763+0000", 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036955120000000002 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188778+0000", 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4295e-05 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188785+0000", 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4699999999999996e-06 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188863+0000", 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7713999999999995e-05 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.188978+0000", 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000115073 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:30.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.189082+0000", 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010394400000000001 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.191988+0000", 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029058840000000001 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197152+0000", 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0051638999999999999 2024-04-26T12:32:30.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197184+0000", 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2756999999999998e-05 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:13.197214+0000", 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9575999999999999e-05 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:5837 4.24 4:27adda6e:::100000001f8.0000000f:head [write 671744~4096,write 806912~4096,write 888832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:21.287577+0000", 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6702527729999996, 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012834908000000001, 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.027 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5837 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287577+0000", 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287577+0000", 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287576+0000", 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287589+0000", 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2918999999999999e-05 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287600+0000", 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0713000000000001e-05 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287606+0000", 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2670000000000003e-06 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287636+0000", 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0306000000000001e-05 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287689+0000", 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2423999999999998e-05 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287779+0000", 2024-04-26T12:32:30.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9884999999999997e-05 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.289247+0000", 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014684089999999999 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.300328+0000", 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011080922 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.300371+0000", 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2749e-05 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.300412+0000", 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1282000000000002e-05 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.033 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:14337 4.24 4:27adda6e:::100000001f8.0000000f:head [write 966656~4096,write 1040384~4096,write 1089536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.5946340469999996, 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014670404, 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.034 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 14337 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363195+0000", 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363205+0000", 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363216+0000", 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363222+0000", 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8690000000000001e-06 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363265+0000", 2024-04-26T12:32:30.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2571999999999998e-05 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363340+0000", 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5190000000000003e-05 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363526+0000", 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185897 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.364824+0000", 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001298238 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377804+0000", 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012979892999999999 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377837+0000", 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3642000000000001e-05 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377866+0000", 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8657e-05 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.040 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15151 4.31 e59/13 4:8fb8ba0c:::100000001f8.00000024:head v 59'234, mlcod=59'231)", 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2149753499999996, 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012740345, 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742870+0000", 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6078000000000001e-05 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742885+0000", 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4919999999999999e-05 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742891+0000", 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742923+0000", 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1575999999999997e-05 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742940+0000", 2024-04-26T12:32:30.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7771e-05 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755553+0000", 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012612959999999999 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755595+0000", 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1529000000000002e-05 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.045 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15152 4.13 e59/13 4:cbf33e86:::100000001f8.00000026:head v 59'478, mlcod=59'476)", 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.743204+0000", 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2146261310000002, 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012507279, 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743204+0000", 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743204+0000", 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743203+0000", 2024-04-26T12:32:30.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743216+0000", 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.26e-05 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743224+0000", 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6519999999999995e-06 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743229+0000", 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1819999999999999e-06 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743263+0000", 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4139e-05 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743288+0000", 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5119000000000001e-05 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755675+0000", 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012387359000000001 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755711+0000", 2024-04-26T12:32:30.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5726000000000003e-05 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15153 4.3b e59/52 4:dcc0c15f:::100000001f8.0000001a:head v 59'227, mlcod=59'225)", 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.743555+0000", 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2142747439999999, 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012180757, 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.051 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743555+0000", 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743555+0000", 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743554+0000", 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743570+0000", 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5591e-05 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743587+0000", 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.664e-05 2024-04-26T12:32:30.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743595+0000", 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7749999999999998e-06 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743623+0000", 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7246999999999998e-05 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743635+0000", 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.277e-05 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755714+0000", 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012078884 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755736+0000", 2024-04-26T12:32:30.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1522000000000002e-05 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15155 4.6 e59/52 4:635f8cb4:::100000001f8.0000003c:head v 59'916, mlcod=59'914)", 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2136506120000004, 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012694219, 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.056 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744192+0000", 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3468e-05 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744203+0000", 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0834e-05 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744211+0000", 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744262+0000", 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1607999999999998e-05 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744280+0000", 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7931000000000002e-05 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756849+0000", 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012568924 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756873+0000", 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4357000000000001e-05 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15156 4.8 e59/52 4:11ee3b64:::100000001f8.0000003e:head v 59'235, mlcod=59'233)", 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.744636+0000", 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2131934800000002, 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012310519000000001, 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.061 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744636+0000", 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744636+0000", 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744636+0000", 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744649+0000", 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3495e-05 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744660+0000", 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0689e-05 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744666+0000", 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0780000000000001e-06 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744702+0000", 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5936000000000003e-05 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744723+0000", 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0876000000000001e-05 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756915+0000", 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012191997 2024-04-26T12:32:30.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756947+0000", 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2149e-05 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15157 4.3d e59/13 4:bd3afb9d:::100000001f8.00000009:head v 59'470, mlcod=59'468)", 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.745129+0000", 2024-04-26T12:32:30.066 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.2127010650000001, 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011775404, 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745129+0000", 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745129+0000", 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745128+0000", 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745143+0000", 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5218999999999999e-05 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745151+0000", 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0620000000000001e-06 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745156+0000", 2024-04-26T12:32:30.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7269999999999998e-06 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745180+0000", 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3671000000000001e-05 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.745192+0000", 2024-04-26T12:32:30.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2323999999999999e-05 2024-04-26T12:32:30.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756882+0000", 2024-04-26T12:32:30.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011690002 2024-04-26T12:32:30.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756904+0000", 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1931999999999999e-05 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15638 4.28 e59/52 4:15eeb89b:::100000001f8.00000032:head v 59'488, mlcod=59'486)", 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.969304+0000", 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.9885261729999999, 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01195852, 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.072 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969304+0000", 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969304+0000", 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969303+0000", 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969328+0000", 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5043999999999999e-05 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969336+0000", 2024-04-26T12:32:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8769999999999993e-06 2024-04-26T12:32:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969342+0000", 2024-04-26T12:32:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3419999999999998e-06 2024-04-26T12:32:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969388+0000", 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6647000000000002e-05 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.969410+0000", 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2302000000000001e-05 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.981222+0000", 2024-04-26T12:32:30.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011811510000000001 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.981262+0000", 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0157999999999997e-05 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15720 4.12 e59/13 4:48ab9bde:::100000001f8.00000015:head v 59'493, mlcod=59'489)", 2024-04-26T12:32:30.077 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.9504817129999998, 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015457238999999999, 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:30.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007347+0000", 2024-04-26T12:32:30.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007368+0000", 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0183999999999999e-05 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007378+0000", 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0499000000000001e-05 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007394+0000", 2024-04-26T12:32:30.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6254999999999999e-05 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.009739+0000", 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023449489999999998 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.009760+0000", 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1128000000000002e-05 2024-04-26T12:32:30.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.022776+0000", 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013015729 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.022805+0000", 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9096999999999999e-05 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:16533 4.f e60/13 4:f2a80dfe:::100000001f8.00000019:head v 60'798, mlcod=60'793)", 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:26.379037+0000", 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.5787931249999998, 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013554488, 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379037+0000", 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379037+0000", 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:30.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379036+0000", 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379065+0000", 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8999000000000001e-05 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379071+0000", 2024-04-26T12:32:30.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9229999999999999e-06 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379076+0000", 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379436+0000", 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000359926 2024-04-26T12:32:30.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379453+0000", 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6971999999999999e-05 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.392564+0000", 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013110309000000001 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:30.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:30.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.392591+0000", 2024-04-26T12:32:30.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625000000000001e-05 2024-04-26T12:32:30.090 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.090 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.090 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.090 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:30.090 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:30.090 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:30.092 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:30.090+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:30.092 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:30.192 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:30.191+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:30.263 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:30.263 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:30.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:24650 4.3 4:c222b65c:::100000001f8.00000021:head [write 1839104~4096 in=4096b,write 1863680~4096 in=4096b,write 1974272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:30.263013+0000", 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00041710299999999999, 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00044473000000000001, 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 24650 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.263013+0000", 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.263013+0000", 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.263009+0000", 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999957 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.263024+0000", 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5430999999999998e-05 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.263034+0000", 2024-04-26T12:32:30.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9559999999999992e-06 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.263041+0000", 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.263083+0000", 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1968999999999997e-05 2024-04-26T12:32:30.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.263135+0000", 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2102999999999999e-05 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.263230+0000", 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4576999999999999e-05 2024-04-26T12:32:30.268 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:24644 4.30 e61/23 4:0c89e311:::100000001f8.00000017:head v 61'395, mlcod=61'393)", 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:30.260946+0000", 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.002483987, 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0025621200000000002, 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.269 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.260946+0000", 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.260946+0000", 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.260945+0000", 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.260966+0000", 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0415999999999999e-05 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.260976+0000", 2024-04-26T12:32:30.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0346000000000001e-05 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.260983+0000", 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3080000000000004e-06 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.261011+0000", 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8116e-05 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:30.261027+0000", 2024-04-26T12:32:30.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6779e-05 2024-04-26T12:32:30.273 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.273 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.273 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.273 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.273 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:30.273 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 2 2024-04-26T12:32:30.273 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:30.276 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:30.319 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:30.319+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:30.395 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:30.394+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:30.434 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:30.434 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:30.434 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:30.435 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:30.435 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:30.447 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:30.496 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:30.495+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:30.597 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:30.596+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:30.653 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14175 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1835008~4096,write 1945600~4096,write 2031616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.653 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.3578306470000001, 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.98270771099999998, 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14175 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:30.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292076+0000", 2024-04-26T12:32:30.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1482e-05 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292089+0000", 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2865e-05 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292097+0000", 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6290000000000001e-06 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292141+0000", 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4759000000000003e-05 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292152+0000", 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0906e-05 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264779+0000", 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.97262671899999997 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264860+0000", 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0871999999999994e-05 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264964+0000", 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104584 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269185+0000", 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042204790000000001 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274691+0000", 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0055061140000000003 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274737+0000", 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6428999999999999e-05 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274773+0000", 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5722999999999997e-05 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.659 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14176 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3907584~4096,write 4022272~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.3575515310000004, 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.98263749300000003, 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14176 2024-04-26T12:32:30.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292344+0000", 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292364+0000", 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0412e-05 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292371+0000", 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.477e-06 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292375+0000", 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8840000000000004e-06 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292408+0000", 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3003999999999998e-05 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292416+0000", 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0620000000000001e-06 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266076+0000", 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.97366027499999996 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266132+0000", 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6279000000000001e-05 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266224+0000", 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1463000000000002e-05 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269227+0000", 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0030027220000000002 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274894+0000", 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0056677730000000001 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274944+0000", 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9356e-05 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274982+0000", 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8343999999999997e-05 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14209 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2813952~4096,write 2973696~4096,write 3047424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.3424455689999997, 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.96821334599999997, 2024-04-26T12:32:30.666 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14209 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307465+0000", 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4949e-05 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307479+0000", 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4707e-05 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307490+0000", 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0146000000000001e-05 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307531+0000", 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1677000000000001e-05 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307538+0000", 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7309999999999996e-06 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266634+0000", 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.959096422 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266704+0000", 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9338000000000006e-05 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266808+0000", 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103847 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269265+0000", 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0024577010000000001 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275617+0000", 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0063514490000000003 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275644+0000", 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7761000000000001e-05 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275664+0000", 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9340000000000001e-05 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14210 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3596288~4096,write 3612672~4096,write 3633152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.3420611740000004, 2024-04-26T12:32:30.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.96837596400000003, 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14210 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307834+0000", 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307850+0000", 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5736e-05 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307860+0000", 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6050000000000004e-06 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307867+0000", 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307928+0000", 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0779999999999997e-05 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307935+0000", 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0400000000000004e-06 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267291+0000", 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.95935644200000003 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267350+0000", 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8502999999999999e-05 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267438+0000", 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8274000000000002e-05 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269295+0000", 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018571449999999999 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276165+0000", 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0068700970000000004 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276191+0000", 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6043000000000001e-05 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276211+0000", 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9599999999999999e-05 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14234 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 872448~4096,write 937984~4096,write 1011712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.678 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.3309347039999997, 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.95729165400000005, 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14234 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:30.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318973+0000", 2024-04-26T12:32:30.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1941e-05 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318981+0000", 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5099999999999998e-06 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318988+0000", 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7349999999999999e-06 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.319020+0000", 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2155e-05 2024-04-26T12:32:30.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.319027+0000", 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8129999999999998e-06 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268425+0000", 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.949398454 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268508+0000", 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2711000000000001e-05 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268677+0000", 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000168956 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274681+0000", 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.006004255 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276216+0000", 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015346680000000001 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276237+0000", 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276253+0000", 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5809999999999999e-05 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.684 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14298 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1114112~4096,write 1130496~4096,write 1196032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.3026070049999996, 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.92900384300000005, 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14298 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347288+0000", 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347301+0000", 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2772000000000001e-05 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347310+0000", 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5909999999999996e-06 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347316+0000", 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5180000000000001e-06 2024-04-26T12:32:30.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347350+0000", 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3643000000000003e-05 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347358+0000", 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6739999999999997e-06 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269323+0000", 2024-04-26T12:32:30.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.921965492 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269443+0000", 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000119998 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269600+0000", 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015721600000000001 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274812+0000", 2024-04-26T12:32:30.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.005211551 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276257+0000", 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014454190000000001 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276278+0000", 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0403000000000001e-05 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276293+0000", 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5235999999999999e-05 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14357 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 319488~4096,write 528384~4096,write 536576~4096,write 552960~4096,write 704512~4096,write 741376~4096,write 1064960~4096,write 1359872~4096,write 1409024~4096,write 1536000~4096,write 1581056~4096,write 1650688~4096,write 1658880~4096,write 1781760~4096,write 1822720~4096,write 2183168~4096,write 2191360~4096,write 2306048~4096,write 2433024~4096,write 2633728~4096,write 2650112~4096,write 2662400~4096,write 2797568~4096,write 3153920~4096,write 3182592~4096,write 3194880~4096,write 3420160~4096,write 3469312~4096,write 3584000~4096,write 3670016~4096,write 3829760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.2803550680000004, 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.91281808399999997, 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.691 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14357 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:30.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369640+0000", 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9499000000000004e-05 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369645+0000", 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.51e-06 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369648+0000", 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4879999999999999e-06 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.371151+0000", 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001503332 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.371162+0000", 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270133+0000", 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.89897075599999998 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270195+0000", 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2224000000000006e-05 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270513+0000", 2024-04-26T12:32:30.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00031765100000000001 2024-04-26T12:32:30.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275008+0000", 2024-04-26T12:32:30.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0044954000000000001 2024-04-26T12:32:30.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282289+0000", 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072804460000000003 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282335+0000", 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6337e-05 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282359+0000", 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3918999999999999e-05 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14616 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 24576~4096,write 32768~4096,write 57344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.1318611049999996, 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.76447159499999995, 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.699 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14616 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:30.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518034+0000", 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518046+0000", 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1545999999999999e-05 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518054+0000", 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0029999999999994e-06 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518059+0000", 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9470000000000002e-06 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518200+0000", 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014118799999999999 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518210+0000", 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0275000000000001e-05 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275044+0000", 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.75683380899999997 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275126+0000", 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1536e-05 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275221+0000", 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5253000000000004e-05 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282369+0000", 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071480729999999996 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282438+0000", 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9494999999999998e-05 2024-04-26T12:32:30.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282472+0000", 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3896999999999997e-05 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282507+0000", 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4245999999999997e-05 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.705 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14664 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 0~4096,write 110592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.1125442919999999, 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.74525697300000004, 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14664 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537351+0000", 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537360+0000", 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4080000000000004e-06 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537370+0000", 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4080000000000004e-06 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537375+0000", 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4600000000000002e-06 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537408+0000", 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2237999999999999e-05 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537414+0000", 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0619999999999997e-06 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275680+0000", 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.73826678099999998 2024-04-26T12:32:30.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275731+0000", 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0281000000000002e-05 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275814+0000", 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3407999999999998e-05 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282375+0000", 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065614180000000003 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282558+0000", 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00018219699999999999 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282588+0000", 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0051000000000001e-05 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282609+0000", 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1021000000000001e-05 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14959 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 118784~4096,write 270336~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.985926503, 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.61876598900000002, 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.712 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14959 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663969+0000", 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663977+0000", 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4230000000000005e-06 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663985+0000", 2024-04-26T12:32:30.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.277e-06 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663989+0000", 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7650000000000001e-06 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.664023+0000", 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3277e-05 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.664030+0000", 2024-04-26T12:32:30.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0759999999999997e-06 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276327+0000", 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.61229685599999994 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276405+0000", 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276583+0000", 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017775700000000001 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282380+0000", 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0057972709999999997 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282654+0000", 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000273095 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282699+0000", 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5129000000000001e-05 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282736+0000", 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.684e-05 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15290 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2097152~4096,write 2134016~4096,write 2248704~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.718 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.8462922690000001, 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.48063225399999998, 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15290 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803603+0000", 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803611+0000", 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8990000000000001e-06 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803618+0000", 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0119999999999999e-06 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803623+0000", 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2930000000000002e-06 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803650+0000", 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7858e-05 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803657+0000", 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1430000000000003e-06 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277533+0000", 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.473876666 2024-04-26T12:32:30.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277591+0000", 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7605999999999997e-05 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277692+0000", 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000100868 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282386+0000", 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046946890000000002 2024-04-26T12:32:30.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284181+0000", 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001795079 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284216+0000", 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284236+0000", 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0171000000000001e-05 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15338 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3837952~4096,write 3850240~4096,write 4026368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.8235331659999998, 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45796468000000001, 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.725 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15338 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826362+0000", 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826384+0000", 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2115000000000001e-05 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826394+0000", 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.2250000000000006e-06 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826399+0000", 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.259e-06 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826438+0000", 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9082999999999998e-05 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826449+0000", 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0747000000000001e-05 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278509+0000", 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45205991600000001 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278588+0000", 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9072000000000005e-05 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278725+0000", 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000137207 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282392+0000", 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0036672520000000002 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284276+0000", 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018842780000000001 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284307+0000", 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284328+0000", 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0778e-05 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15354 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1396736~4096,write 1449984~4096,write 1675264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.8157602270000002, 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45026424700000001, 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.731 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15354 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834135+0000", 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834147+0000", 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2592000000000001e-05 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834157+0000", 2024-04-26T12:32:30.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5550000000000008e-06 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834170+0000", 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2683999999999999e-05 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834202+0000", 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2668e-05 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834209+0000", 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279284+0000", 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.44507556799999998 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279333+0000", 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8560999999999998e-05 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279427+0000", 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3917000000000002e-05 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282397+0000", 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029705460000000001 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284358+0000", 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0019611770000000001 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284383+0000", 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284400+0000", 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.747e-05 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15416 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 950272~4096,write 1155072~4096,write 1245184~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.737 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.7862043109999997, 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.420828757, 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15416 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:30.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863691+0000", 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863706+0000", 2024-04-26T12:32:30.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863716+0000", 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0139000000000001e-05 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863723+0000", 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9290000000000001e-06 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863762+0000", 2024-04-26T12:32:30.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863769+0000", 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1509999999999998e-06 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280011+0000", 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.416241743 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280098+0000", 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7367000000000006e-05 2024-04-26T12:32:30.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280249+0000", 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000150168 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282617+0000", 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023680839999999999 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284444+0000", 2024-04-26T12:32:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018270000000000001 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284488+0000", 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4659000000000001e-05 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284520+0000", 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2193000000000002e-05 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15421 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3383296~4096,write 3407872~4096,write 3440640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.783927008, 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.41862908900000001, 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15421 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865968+0000", 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865986+0000", 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7314000000000001e-05 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865994+0000", 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2409999999999995e-06 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866000+0000", 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:32:30.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866042+0000", 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2162000000000001e-05 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866049+0000", 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5270000000000004e-06 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280822+0000", 2024-04-26T12:32:30.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.414773799 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280904+0000", 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2118000000000002e-05 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281077+0000", 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017207600000000001 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282621+0000", 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015443259999999999 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284550+0000", 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001928969 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284580+0000", 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9835000000000001e-05 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284598+0000", 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8447000000000001e-05 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15449 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 405504~4096,write 671744~4096,write 700416~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.7718745619999998, 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.40665650599999997, 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.750 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15449 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878038+0000", 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7227999999999998e-05 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878049+0000", 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0869999999999999e-05 2024-04-26T12:32:30.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878054+0000", 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2619999999999998e-06 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878085+0000", 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0559000000000003e-05 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878091+0000", 2024-04-26T12:32:30.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9939999999999997e-06 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281693+0000", 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.40360222499999998 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281747+0000", 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4017999999999997e-05 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281850+0000", 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103348 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284244+0000", 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023942669999999998 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284637+0000", 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000392369 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284660+0000", 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3116e-05 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284678+0000", 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8048999999999999e-05 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15473 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3801088~4096,write 4050944~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.756 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.7591940959999999, 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39472404999999999, 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15473 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:30.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890701+0000", 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890723+0000", 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1681000000000001e-05 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890731+0000", 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5349999999999999e-06 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890735+0000", 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8520000000000003e-06 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890988+0000", 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025219499999999998 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890994+0000", 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282756+0000", 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39176148700000002 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282818+0000", 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2429999999999997e-05 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282922+0000", 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103094 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284408+0000", 2024-04-26T12:32:30.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001486343 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285350+0000", 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00094174299999999999 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285388+0000", 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8306000000000002e-05 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285426+0000", 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8102999999999998e-05 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15483 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2674688~4096,write 3006464~4096,write 3055616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.7550166130000004, 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39308472300000002, 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.763 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15483 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:30.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894890+0000", 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1477999999999999e-05 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.765 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894902+0000", 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1802e-05 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894909+0000", 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8700000000000003e-06 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894980+0000", 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1518000000000002e-05 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894991+0000", 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0916e-05 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283304+0000", 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38831311299999999 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283374+0000", 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9589000000000001e-05 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283526+0000", 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015212 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285298+0000", 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001772385 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287859+0000", 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0025601439999999999 2024-04-26T12:32:30.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287919+0000", 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9951000000000002e-05 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287964+0000", 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5608000000000001e-05 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.769 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15503 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2396160~4096,write 2449408~4096,write 2605056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.7454898510000003, 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38366402100000002, 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15503 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904405+0000", 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904421+0000", 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5413e-05 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904431+0000", 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0244999999999999e-05 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904442+0000", 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0746e-05 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904487+0000", 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4858999999999999e-05 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904501+0000", 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4498000000000001e-05 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284701+0000", 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38019989100000001 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284748+0000", 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6668000000000001e-05 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284839+0000", 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1133999999999999e-05 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287788+0000", 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029491349999999999 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288005+0000", 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00021703299999999999 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288033+0000", 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7971e-05 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288070+0000", 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7231000000000003e-05 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.775 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15520 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3747840~4096,write 3772416~4096,write 4149248~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.736668206, 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.37495473499999998, 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15520 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.776 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913227+0000", 2024-04-26T12:32:30.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913241+0000", 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3995999999999999e-05 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913250+0000", 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913257+0000", 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4649999999999997e-06 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913297+0000", 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9274999999999999e-05 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913303+0000", 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4049999999999997e-06 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285461+0000", 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.37215769999999998 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285508+0000", 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6938999999999999e-05 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285613+0000", 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00010532899999999999 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288084+0000", 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002471132 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288121+0000", 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6665000000000002e-05 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288148+0000", 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7379e-05 2024-04-26T12:32:30.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288183+0000", 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4419999999999999e-05 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:30.782 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:30.784 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:30.782+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:30.784 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:32:30.884 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:30.884+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:30.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26104 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3035136~4096 in=4096b,write 3067904~4096 in=4096b,write 3440640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.959664+0000", 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0047499600000000001, 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047792609999999999, 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:30.966 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26104 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.959664+0000", 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.959664+0000", 2024-04-26T12:32:30.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.959664+0000", 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.959684+0000", 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0716999999999998e-05 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:30.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.959691+0000", 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6819999999999997e-06 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.959696+0000", 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.651e-06 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.959740+0000", 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4166999999999999e-05 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:30.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.959872+0000", 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013218400000000001 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960016+0000", 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014363099999999999 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963214+0000", 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031985519999999999 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.970 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26105 4.6 4:63e80496:::100000001f8.0000001e:head [write 3698688~4096 in=4096b,write 3719168~4096 in=4096b,write 3919872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.960048+0000", 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0043657100000000001, 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004497979, 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26105 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.971 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960048+0000", 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960048+0000", 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960048+0000", 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960060+0000", 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1972e-05 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960068+0000", 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6370000000000005e-06 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960075+0000", 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6819999999999997e-06 2024-04-26T12:32:30.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960167+0000", 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2386000000000006e-05 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960246+0000", 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8999999999999996e-05 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960423+0000", 2024-04-26T12:32:30.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000176467 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26106 4.12 4:4be51a30:::100000001f8.0000000b:head [write 237568~4096 in=4096b,write 299008~4096 in=4096b,write 385024~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.960433+0000", 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0039814020000000002, 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041961669999999998, 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.975 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26106 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960433+0000", 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960433+0000", 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:30.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960432+0000", 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960447+0000", 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5177999999999999e-05 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960455+0000", 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3329999999999997e-06 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960462+0000", 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9149999999999999e-06 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960509+0000", 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6403000000000003e-05 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960587+0000", 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8098999999999999e-05 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.960739+0000", 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000152261 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963148+0000", 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024086620000000002 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:26107 4.2c e61/13 4:35cbff5f:::100000001f8.00000033:head v 61'840, mlcod=61'838)", 2024-04-26T12:32:30.979 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.961829+0000", 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002584963, 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028535560000000001, 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961829+0000", 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961829+0000", 2024-04-26T12:32:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961829+0000", 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961844+0000", 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5095e-05 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961850+0000", 2024-04-26T12:32:30.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2500000000000003e-06 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961855+0000", 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0640000000000001e-06 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961885+0000", 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0165e-05 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:30.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961909+0000", 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3470999999999999e-05 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26110 4.6 4:63e80496:::100000001f8.0000001e:head [write 3088384~8192 in=8192b,write 3125248~4096 in=4096b,write 3260416~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.961887+0000", 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0025271529999999999, 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028345750000000002, 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:30.983 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26110 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961887+0000", 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961887+0000", 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.961886+0000", 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962052+0000", 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000165468 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962061+0000", 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5729999999999997e-06 2024-04-26T12:32:30.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962070+0000", 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3760000000000008e-06 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962953+0000", 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000883689 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963002+0000", 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8522000000000001e-05 2024-04-26T12:32:30.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963100+0000", 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7769000000000005e-05 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:26108 4.2c e61/13 4:36128e15:::100000001f8.00000008:head v 61'841, mlcod=61'838)", 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.962321+0000", 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.002093489, 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024906820000000001, 2024-04-26T12:32:30.987 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962321+0000", 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962321+0000", 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:30.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962320+0000", 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962332+0000", 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1778e-05 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962337+0000", 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.079e-06 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962341+0000", 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6500000000000002e-06 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962853+0000", 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00051201700000000003 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.962871+0000", 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7975999999999999e-05 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.990 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:26111 4.2c e61/13 4:35cbff5f:::100000001f8.00000033:head v 61'842, mlcod=61'838)", 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.963676+0000", 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.000738114, 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012034490000000001, 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963676+0000", 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963676+0000", 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963675+0000", 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963688+0000", 2024-04-26T12:32:30.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2816999999999999e-05 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963699+0000", 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0686000000000001e-05 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963706+0000", 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0979999999999996e-06 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:30.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964316+0000", 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060986899999999997 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964334+0000", 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7822e-05 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26112 4.12 4:4be51a30:::100000001f8.0000000b:head [write 4104192~4096 in=4096b,write 4145152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.963805+0000", 2024-04-26T12:32:30.994 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00060935600000000003, 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011481760000000001, 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26112 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963805+0000", 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963805+0000", 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963804+0000", 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963818+0000", 2024-04-26T12:32:30.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3698e-05 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963829+0000", 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1632e-05 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963839+0000", 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8169999999999994e-06 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:30.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963873+0000", 2024-04-26T12:32:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3670000000000001e-05 2024-04-26T12:32:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.963922+0000", 2024-04-26T12:32:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8882999999999999e-05 2024-04-26T12:32:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964004+0000", 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2786000000000003e-05 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26113 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2326528~4096 in=4096b,write 2473984~4096 in=4096b,write 3690496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.964028+0000", 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.00038618600000000001, 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001034185, 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:30.999 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26113 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964028+0000", 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964028+0000", 2024-04-26T12:32:31.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964027+0000", 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964046+0000", 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9057000000000001e-05 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964059+0000", 2024-04-26T12:32:31.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2901999999999999e-05 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964067+0000", 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964109+0000", 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1603000000000001e-05 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964194+0000", 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4876999999999994e-05 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964330+0000", 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013652599999999999 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26114 4.1c 4:39b842ef:::100000001f8.00000029:head [write 1982464~4096 in=4096b,write 1998848~4096 in=4096b,write 2056192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.964359+0000", 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.5461000000000003e-05, 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079784099999999998, 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26114 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964359+0000", 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964359+0000", 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964358+0000", 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964380+0000", 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2816999999999999e-05 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964393+0000", 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2578000000000001e-05 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964400+0000", 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.725e-06 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964434+0000", 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3915999999999999e-05 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964494+0000", 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0380000000000001e-05 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964583+0000", 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8422000000000001e-05 2024-04-26T12:32:31.007 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26115 4.3f 4:fde182c5:::100000001f8.00000039:head [write 126976~4096 in=4096b,write 413696~4096 in=4096b,write 458752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.964686+0000", 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.9997277, 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00054998999999999998, 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26115 2024-04-26T12:32:31.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964686+0000", 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964686+0000", 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964685+0000", 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964708+0000", 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2399999999999999e-05 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964726+0000", 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7980000000000001e-05 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964733+0000", 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5179999999999998e-06 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964779+0000", 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6032999999999998e-05 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.964868+0000", 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8775000000000003e-05 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.965059+0000", 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019047000000000001 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4532.0:26104 4.2d e61/13)", 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.965248+0000", 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4294967295.999166, 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5071999999999998e-05, 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-04-26T12:32:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.965248+0000", 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.965248+0000", 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.965247+0000", 2024-04-26T12:32:31.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.965252+0000", 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3819999999999997e-06 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.965262+0000", 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8339999999999994e-06 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.965268+0000", 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2310000000000001e-06 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.965293+0000", 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5349000000000001e-05 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 12 2024-04-26T12:32:31.015 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:31.017 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:32:31.017 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:31.016+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:31.117 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:31.116+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:31.218 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:31.217+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:31.234 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:31.234 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:32:31.234 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-04-26T12:32:31.234 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-04-26T12:32:31.234 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:31.248 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:32:31.318 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:31.318+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:31.420 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:31.419+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:49 4.1c 4:39b842ef:::100000001f8.00000029:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.633030414, 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.31553130400000001, 2024-04-26T12:32:31.434 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 49 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798334+0000", 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.798333+0000", 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802052+0000", 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037186889999999998 2024-04-26T12:32:31.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802065+0000", 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.393e-05 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802090+0000", 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5028000000000002e-05 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802171+0000", 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0267999999999998e-05 2024-04-26T12:32:31.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.802183+0000", 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2612999999999999e-05 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103759+0000", 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.30157593799999999 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103871+0000", 2024-04-26T12:32:31.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000112215 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104010+0000", 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013841799999999999 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.109832+0000", 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058224430000000001 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113792+0000", 2024-04-26T12:32:31.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039597809999999999 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113833+0000", 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1162000000000003e-05 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.113865+0000", 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1664e-05 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:50 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.519958399, 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.211685075, 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 50 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911406+0000", 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.911403+0000", 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999971 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915165+0000", 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037618870000000002 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915180+0000", 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5130000000000001e-05 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915206+0000", 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6248e-05 2024-04-26T12:32:31.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915253+0000", 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6387000000000002e-05 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:15.915262+0000", 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9239999999999996e-06 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.103986+0000", 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.188724843 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104199+0000", 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00021283900000000001 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.104324+0000", 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012447599999999999 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.115992+0000", 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011668286 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123002+0000", 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070100400000000004 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123053+0000", 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1427000000000001e-05 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:16.123091+0000", 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7271000000000003e-05 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.446 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:15720 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2646016~4096,write 2793472~4096,write 2908160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:26.004476+0000", 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.4268881899999997, 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018470818999999999, 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 15720 2024-04-26T12:32:31.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.004476+0000", 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.004476+0000", 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.004475+0000", 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.004498+0000", 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.317e-05 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.004507+0000", 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4370000000000007e-06 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.004511+0000", 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5360000000000003e-06 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.007115+0000", 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0026039280000000001 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.007169+0000", 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3906000000000002e-05 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.007269+0000", 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100041 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.009527+0000", 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022574700000000001 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.022888+0000", 2024-04-26T12:32:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013361291000000001 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.022917+0000", 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9116e-05 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.022947+0000", 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9583000000000001e-05 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.452 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:16536 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 610304~4096,write 630784~4096,write 659456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:26.379711+0000", 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.0516534850000001, 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018339919, 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 16536 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.453 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.379711+0000", 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.379711+0000", 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.379706+0000", 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999952 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.379720+0000", 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.385e-05 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.379731+0000", 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0716999999999999e-05 2024-04-26T12:32:31.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.379740+0000", 2024-04-26T12:32:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8190000000000003e-06 2024-04-26T12:32:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.379767+0000", 2024-04-26T12:32:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6363000000000002e-05 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.379822+0000", 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5296e-05 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.379913+0000", 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0563999999999996e-05 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.382027+0000", 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021140949999999999 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.397983+0000", 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015956277000000001 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.398013+0000", 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9867999999999999e-05 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.398051+0000", 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7613000000000001e-05 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:16552 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 1052672~4096,write 1069056~4096,write 1220608~4096,write 1277952~4096,write 1343488~4096,write 1589248~4096,write 1703936~4096,write 1826816~4096,write 1884160~4096,write 2015232~4096,write 2060288~8192,write 2109440~4096,write 2289664~4096,write 2568192~4096,write 2707456~4096,write 2777088~4096,write 2805760~4096,write 2813952~4096,write 2826240~4096,write 2867200~4096,write 3031040~4096,write 3395584~4096,write 3432448~4096,write 3440640~4096,write 3567616~4096,write 3596288~4096,write 3694592~4096,write 3760128~4096,write 3862528~4096,write 3977216~4096,write 4014080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:26.384634+0000", 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.046730374, 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018515157000000001, 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.459 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 16552 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.384634+0000", 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.384634+0000", 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.384633+0000", 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.384754+0000", 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012126 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.384764+0000", 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3700000000000001e-06 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.384770+0000", 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.398226+0000", 2024-04-26T12:32:31.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013456030000000001 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.398330+0000", 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104172 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.398895+0000", 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00056435299999999997 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.402606+0000", 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003710891 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.403062+0000", 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000456642 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.403109+0000", 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6709000000000003e-05 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:26.403149+0000", 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9972000000000003e-05 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:25025 4.28 4:153ae410:::100000001f8.0000003b:head [write 2613248~4096,write 2809856~4096,write 2818048~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.431702+0000", 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.99966173000000003, 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019226508999999999, 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.465 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 25025 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431702+0000", 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431702+0000", 2024-04-26T12:32:31.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431702+0000", 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431732+0000", 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0252000000000001e-05 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431737+0000", 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431740+0000", 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2480000000000001e-06 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431777+0000", 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7375e-05 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431873+0000", 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6003999999999998e-05 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.432026+0000", 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015291799999999999 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.440719+0000", 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086931790000000005 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.450871+0000", 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010151759 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.450905+0000", 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3939999999999997e-05 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.450929+0000", 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3765e-05 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.470 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:25024 4.38 e61/13 4:1fc350da:::100000001f8.0000002f:head v 61'1560, mlcod=61'1558)", 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.431804+0000", 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.99956049899999999, 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019147266, 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431804+0000", 2024-04-26T12:32:31.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431804+0000", 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431803+0000", 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431818+0000", 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4528999999999999e-05 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431826+0000", 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4759999999999998e-06 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431832+0000", 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431855+0000", 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2772000000000002e-05 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.431867+0000", 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2316e-05 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.450931+0000", 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019064037999999998 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.450951+0000", 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9474999999999999e-05 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:25032 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1478656~4096,write 1593344~4096,write 1757184~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.434523+0000", 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.99684060500000005, 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018247032, 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.475 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 25032 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.434523+0000", 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.434523+0000", 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.434523+0000", 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.434538+0000", 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4861999999999999e-05 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.434546+0000", 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8240000000000006e-06 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.434551+0000", 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9110000000000001e-06 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.434583+0000", 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1937999999999998e-05 2024-04-26T12:32:31.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.434647+0000", 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3391000000000003e-05 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.434761+0000", 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113843 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.441550+0000", 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067890809999999998 2024-04-26T12:32:31.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.452692+0000", 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011141959 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.452737+0000", 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5226999999999999e-05 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.452770+0000", 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3664000000000002e-05 2024-04-26T12:32:31.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:25051 4.38 e61/13 4:1e2c7ed9:::100000001f8.0000002d:head v 61'1564, mlcod=61'1558)", 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.442947+0000", 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.98841713399999998, 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018442481, 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.442947+0000", 2024-04-26T12:32:31.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.442947+0000", 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.442946+0000", 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.482 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.442966+0000", 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9420999999999999e-05 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.442975+0000", 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2639999999999997e-06 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.442983+0000", 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9650000000000008e-06 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.446466+0000", 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0034832800000000001 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.446483+0000", 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6685e-05 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.461354+0000", 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014870675999999999 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.461389+0000", 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5850999999999999e-05 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:25060 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 483328~4096,write 532480~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:30.446831+0000", 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.98453341400000005, 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018071116000000002, 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.485 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 25060 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.446831+0000", 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.446831+0000", 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.446830+0000", 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.446846+0000", 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6401000000000001e-05 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.446862+0000", 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5806000000000001e-05 2024-04-26T12:32:31.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.446870+0000", 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3580000000000003e-06 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.446927+0000", 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7120999999999997e-05 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.447014+0000", 2024-04-26T12:32:31.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6508999999999995e-05 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.447179+0000", 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000164549 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.450004+0000", 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028256209999999999 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.464838+0000", 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014833492 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.464868+0000", 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0052e-05 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:30.464902+0000", 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4059e-05 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.490 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26835 4.6 4:63e80496:::100000001f8.0000001e:head [write 532480~4096,write 540672~4096,write 688128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.267055+0000", 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.16430906000000001, 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020540234000000001, 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26835 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.491 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.267055+0000", 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.267055+0000", 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.267054+0000", 2024-04-26T12:32:31.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.267069+0000", 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4948e-05 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.267090+0000", 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1401000000000001e-05 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.267100+0000", 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3079999999999997e-06 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.271190+0000", 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040902489999999998 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.271271+0000", 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1297000000000004e-05 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.494 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.271401+0000", 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000129794 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275857+0000", 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044556509999999997 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287504+0000", 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011646843 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287556+0000", 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2169999999999997e-05 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287595+0000", 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9549999999999999e-05 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.496 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26839 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2289664~4096,write 2306048~4096,write 2547712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.268404+0000", 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.162960259, 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019333659, 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26839 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.268404+0000", 2024-04-26T12:32:31.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.268404+0000", 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.268403+0000", 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.268415+0000", 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2291e-05 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.268426+0000", 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0481e-05 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.268435+0000", 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.499 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272577+0000", 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041421349999999999 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272647+0000", 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0349e-05 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272782+0000", 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000135096 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.280466+0000", 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076837950000000002 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287648+0000", 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071818359999999996 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287702+0000", 2024-04-26T12:32:31.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4218999999999997e-05 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287737+0000", 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5209000000000001e-05 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26843 4.36 4:6da220e6:::100000001f8.0000003f:head [write 565248~4096,write 983040~4096,write 1036288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.269763+0000", 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.16160112099999999, 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018063833000000001, 2024-04-26T12:32:31.502 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26843 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.269763+0000", 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.269763+0000", 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.269762+0000", 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.269774+0000", 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1440999999999999e-05 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.269783+0000", 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2539999999999998e-06 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.269790+0000", 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2130000000000002e-06 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272565+0000", 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027747090000000002 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.505 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272657+0000", 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2645000000000005e-05 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272751+0000", 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3783000000000007e-05 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.280488+0000", 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077365999999999997 2024-04-26T12:32:31.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287746+0000", 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007257973 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287792+0000", 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6020999999999999e-05 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287827+0000", 2024-04-26T12:32:31.507 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4918e-05 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26844 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 761856~4096,write 913408~4096,write 921600~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.270051+0000", 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.16131258900000001, 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017856414000000001, 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.508 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26844 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.270051+0000", 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.270051+0000", 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.509 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.270051+0000", 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.270063+0000", 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2575000000000001e-05 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.270074+0000", 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.043e-05 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.510 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.270081+0000", 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0829999999999998e-06 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.273860+0000", 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037793760000000001 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.273940+0000", 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9487000000000007e-05 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.511 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.274106+0000", 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000166591 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.280526+0000", 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064197259999999997 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287834+0000", 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073079089999999996 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.512 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287875+0000", 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1165000000000003e-05 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.287908+0000", 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2971e-05 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26847 4.36 4:6da220e6:::100000001f8.0000003f:head [write 307200~4096,write 315392~4096,write 495616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.513 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.271190+0000", 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.16017403499999999, 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017783717000000001, 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26847 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.271190+0000", 2024-04-26T12:32:31.514 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.271190+0000", 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.271189+0000", 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.515 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.271202+0000", 2024-04-26T12:32:31.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3044000000000001e-05 2024-04-26T12:32:31.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.516 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.516 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.516 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.271212+0000", 2024-04-26T12:32:31.516 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7580000000000004e-06 2024-04-26T12:32:31.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.271220+0000", 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7889999999999995e-06 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275862+0000", 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004641956 2024-04-26T12:32:31.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275950+0000", 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8645000000000003e-05 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.276109+0000", 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000158901 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.280581+0000", 2024-04-26T12:32:31.518 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00447146 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.288895+0000", 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083139939999999999 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.288937+0000", 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.227e-05 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.519 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.288974+0000", 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.676e-05 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26849 4.12 4:48ab9bde:::100000001f8.00000015:head [write 159744~4096,write 253952~4096,write 278528~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.272231+0000", 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.15913286800000001, 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020322255000000001, 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.520 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26849 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272231+0000", 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272231+0000", 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.521 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272230+0000", 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.999999 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272245+0000", 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4559000000000001e-05 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272255+0000", 2024-04-26T12:32:31.522 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0101999999999999e-05 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272263+0000", 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5279999999999998e-06 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272298+0000", 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5333999999999997e-05 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.523 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272367+0000", 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9530999999999995e-05 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.272470+0000", 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000102305 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.288663+0000", 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016193255 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.524 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.292472+0000", 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038090250000000002 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.292516+0000", 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3498000000000003e-05 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.292553+0000", 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7938999999999997e-05 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.525 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26853 4.12 4:48ab9bde:::100000001f8.00000015:head [write 688128~4096,write 1028096~4096,write 1044480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.273680+0000", 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.157684503, 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.023315810999999999, 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26853 2024-04-26T12:32:31.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.273680+0000", 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.273680+0000", 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.273679+0000", 2024-04-26T12:32:31.527 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.273693+0000", 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4059999999999999e-05 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.273704+0000", 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0718e-05 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.528 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.273710+0000", 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7910000000000001e-06 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.278904+0000", 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051949869999999999 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.278985+0000", 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0248999999999997e-05 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.529 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.279151+0000", 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000166529 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.288703+0000", 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0095516920000000005 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.296905+0000", 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082022829999999994 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.530 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.296948+0000", 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2747999999999998e-05 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.296995+0000", 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7382999999999997e-05 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26856 4.12 4:48ab9bde:::100000001f8.00000015:head [write 319488~4096,write 528384~4096,write 618496~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.531 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.274586+0000", 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.15677856000000001, 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022515113999999999, 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26856 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.274586+0000", 2024-04-26T12:32:31.532 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.274586+0000", 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.274585+0000", 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.274616+0000", 2024-04-26T12:32:31.533 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1047999999999998e-05 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.274623+0000", 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7950000000000002e-06 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.274627+0000", 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.138e-06 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.534 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.288730+0000", 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014103374 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.288808+0000", 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7892999999999994e-05 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.288956+0000", 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000147787 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.535 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.292597+0000", 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036408180000000001 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.297004+0000", 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044068609999999998 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.297064+0000", 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0365999999999998e-05 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.536 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.297101+0000", 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6599e-05 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4532.0:26858 4.38 e61/13 4:1e2c7ed9:::100000001f8.0000002d:head v 61'1670, mlcod=61'1668)", 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.275456+0000", 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.155908136, 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019269110999999998, 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.537 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275456+0000", 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275456+0000", 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.538 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275455+0000", 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275470+0000", 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4178999999999999e-05 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275481+0000", 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1537e-05 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.539 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275487+0000", 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1099999999999999e-06 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275524+0000", 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6569000000000002e-05 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.275542+0000", 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8139999999999999e-05 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.540 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.294700+0000", 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019157803000000001 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.294725+0000", 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5360000000000001e-05 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4532.0:26861 4.12 4:4be51a30:::100000001f8.0000000b:head [write 4005888~4096,write 4014080~4096,write 4059136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-04-26T12:32:31.277004+0000", 2024-04-26T12:32:31.541 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.15436021, 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020364401000000001, 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4532", 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 26861 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.277004+0000", 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.277004+0000", 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.277003+0000", 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.277014+0000", 2024-04-26T12:32:31.543 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0361e-05 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.277025+0000", 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0988999999999999e-05 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.277032+0000", 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.114e-06 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.291576+0000", 2024-04-26T12:32:31.544 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014543840000000001 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.291652+0000", 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6722000000000002e-05 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.291782+0000", 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012994499999999999 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-04-26T12:32:31.545 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.297109+0000", 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053269490000000001 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.297302+0000", 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019232 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.297337+0000", 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5355000000000003e-05 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-04-26T12:32:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-04-26T12:32:31.547 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-04-26T12:32:31.297368+0000", 2024-04-26T12:32:31.547 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1211000000000003e-05 2024-04-26T12:32:31.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.547 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-04-26T12:32:31.547 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-04-26T12:32:31.547 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:32:31.548 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:31.549 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:31.550 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:31.547+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:31.649 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:31.648+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:31.722 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:31.722 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:31.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.722 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:27825 4.e e61/13 4:73e84e43:::100000001f8.00000004:head v 61'447, mlcod=61'445)", 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:31.720964+0000", 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001214026, 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0012320059999999999, 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.720964+0000", 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.720964+0000", 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.720963+0000", 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.720976+0000", 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2697999999999999e-05 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.720986+0000", 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.023e-05 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.720992+0000", 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2049999999999999e-06 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721031+0000", 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8643999999999998e-05 2024-04-26T12:32:31.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721042+0000", 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1222e-05 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:27824 4.19 e61/52 4:9a4319fb:::100000001f8.0000002a:head v 61'891, mlcod=61'889)", 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:31.721572+0000", 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00060584099999999998, 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00066480900000000004, 2024-04-26T12:32:31.726 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721572+0000", 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721572+0000", 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721571+0000", 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721586+0000", 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4779e-05 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721598+0000", 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1759e-05 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721608+0000", 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8069999999999994e-06 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721639+0000", 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0675e-05 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.721654+0000", 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5257e-05 2024-04-26T12:32:31.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:27828 4.3d e61/13 4:bd3afb9d:::100000001f8.00000009:head v 61'898, mlcod=61'896)", 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:31.722093+0000", 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.5061000000000004e-05, 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018445700000000001, 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.722093+0000", 2024-04-26T12:32:31.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.722093+0000", 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.722092+0000", 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:31.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.722104+0000", 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1798e-05 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.722114+0000", 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.645e-06 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.722120+0000", 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3949999999999998e-06 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:31.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.722153+0000", 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3149999999999999e-05 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.722167+0000", 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3431999999999999e-05 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 3 2024-04-26T12:32:31.733 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:31.735 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:31.743 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:31.749 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:32:31.748+0000 7f619273c700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 40379) UID: 0 2024-04-26T12:32:31.769 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:31.792 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:31.794 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:31.794 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:31.795 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:31.850 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:31.849+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:31.906 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:31.906 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:31.920 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:31.964 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:31.963+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:32.052 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:32.050+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:32.087 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:32.087 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:32.088 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:32:32.101 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:32.152 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:32.151+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:32.253 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:32.252+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:32.270 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:32.270 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:32.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:32.354 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:32.353+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:32.454 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:32.455 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:32.455 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:32.453+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:32.467 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:32.471 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:32:32.471 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:32:32.471 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-04-26T12:32:32.471 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T12:32:32.471 INFO:teuthology.orchestra.console.smithi098:Power off 2024-04-26T12:32:32.471 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T12:32:32.497 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2024-04-26T12:32:32.497 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:32:32.521 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-26T12:32:32.555 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:32.555+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:32.656 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:32.655+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:32.665 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:32.665 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:32.680 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:32.757 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:32.756+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:32.846 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:32.846 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:32.858 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:32.857+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:32.859 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:32.959 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:32.958+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:33.060 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:33.059+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:33.062 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:33.063 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:33.076 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:33.161 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:33.160+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:33.263 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:33.262+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:33.284 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:33.284 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:33.299 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:33.366 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:33.365+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:33.460 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:33.460 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:33.467 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:33.466+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:33.474 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:33.569 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:33.568+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:33.670 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:33.669+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:33.672 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:33.672 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:33.685 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:33.771 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:33.770+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:33.807 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:33.840 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:33.840 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:33.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:33.897 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:33.896+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:33.972 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:33.972+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:34.010 INFO:teuthology.orchestra.run.smithi038.stdout:osd.0: {} 2024-04-26T12:32:34.025 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:34.025 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:34.034 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:34.039 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:34.063 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:34.065 INFO:teuthology.orchestra.run.smithi038.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:32:34.065 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:34.065 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:34.083 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:34.083+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:34.105 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:32:34.174 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:34.173+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:34.212 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:34.212 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:34.212 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:34.212 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:34.212 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:34.225 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:34.275 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:34.274+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:34.375 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:34.375+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:34.442 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:34.442 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 121.83658318499999, 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01355234, 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:34.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603195+0000", 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603194+0000", 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603204+0000", 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0835999999999999e-05 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603217+0000", 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2415999999999999e-05 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603229+0000", 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603809+0000", 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057991 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603814+0000", 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3279999999999996e-06 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606363+0000", 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025485500000000001 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606473+0000", 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000110574 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606909+0000", 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00043583199999999998 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613989+0000", 2024-04-26T12:32:34.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070796009999999996 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616496+0000", 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025069860000000001 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616710+0000", 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021416800000000001 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616747+0000", 2024-04-26T12:32:34.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7657000000000002e-05 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 121.836525123, 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:32:34.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:32:34.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 121.83649656999999, 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012888112, 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.455 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603282+0000", 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603281+0000", 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603284+0000", 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9840000000000001e-06 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603290+0000", 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9900000000000002e-06 2024-04-26T12:32:34.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603296+0000", 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.823e-06 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603901+0000", 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060446700000000003 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op must wait for map", 2024-04-26T12:32:34.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603910+0000", 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9570000000000008e-06 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605807+0000", 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018973989999999999 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.605928+0000", 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012074900000000001 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606062+0000", 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000134475 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613981+0000", 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079182890000000002 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616065+0000", 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020845709999999999 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616129+0000", 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4336000000000002e-05 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616170+0000", 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0422e-05 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.461 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 121.83647709500001, 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013022545, 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603301+0000", 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603305+0000", 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603311+0000", 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0070000000000003e-06 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603316+0000", 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1200000000000001e-06 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603939+0000", 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062300699999999997 2024-04-26T12:32:34.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603946+0000", 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9450000000000004e-06 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606381+0000", 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024352200000000001 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606464+0000", 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2787000000000005e-05 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.606927+0000", 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00046250799999999998 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.613995+0000", 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070681399999999997 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616213+0000", 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022182590000000002 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616270+0000", 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6808000000000002e-05 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616324+0000", 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4039000000000002e-05 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 121.836413312, 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.468 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:18 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.310578242999998, 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013138092000000001, 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 18 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129200+0000", 2024-04-26T12:32:34.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.129198+0000", 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999976 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133886+0000", 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046879779999999998 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133913+0000", 2024-04-26T12:32:34.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7039999999999999e-05 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133924+0000", 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1629e-05 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.133975+0000", 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1056e-05 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134116+0000", 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014008799999999999 2024-04-26T12:32:34.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.134222+0000", 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000106283 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.140668+0000", 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064464539999999999 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142263+0000", 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001595162 2024-04-26T12:32:34.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142302+0000", 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8331000000000003e-05 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.142338+0000", 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6405999999999997e-05 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:34.479 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.721561455, 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021336570999999999, 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 23 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718215+0000", 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722001+0000", 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037856769999999999 2024-04-26T12:32:34.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722016+0000", 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5123000000000001e-05 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722024+0000", 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6799999999999993e-06 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722085+0000", 2024-04-26T12:32:34.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1277000000000003e-05 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722183+0000", 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7922000000000002e-05 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722284+0000", 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100985 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.726784+0000", 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045004479999999998 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739478+0000", 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012693594000000001 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739511+0000", 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3322999999999999e-05 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739553+0000", 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2250999999999999e-05 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:25 4.2a 4:57147dc3:::100000001f8.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 21.469618825000001, 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013954156000000001, 2024-04-26T12:32:34.485 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 25 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970158+0000", 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973845+0000", 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036870309999999999 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973859+0000", 2024-04-26T12:32:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3431999999999999e-05 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973867+0000", 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7940000000000003e-06 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973931+0000", 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4793000000000001e-05 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974029+0000", 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7404000000000005e-05 2024-04-26T12:32:34.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974117+0000", 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8641999999999996e-05 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.976886+0000", 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027684480000000002 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984047+0000", 2024-04-26T12:32:34.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.007161059 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984086+0000", 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9490000000000003e-05 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984114+0000", 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.73e-05 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:5837 4.24 4:27adda6e:::100000001f8.0000000f:head [write 671744~4096,write 806912~4096,write 888832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:21.287577+0000", 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 13.152201282, 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012834908000000001, 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 5837 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287577+0000", 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287577+0000", 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287576+0000", 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287589+0000", 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2918999999999999e-05 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287600+0000", 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0713000000000001e-05 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287606+0000", 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2670000000000003e-06 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287636+0000", 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0306000000000001e-05 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287689+0000", 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2423999999999998e-05 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.287779+0000", 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9884999999999997e-05 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.289247+0000", 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014684089999999999 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.300328+0000", 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011080922 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.300371+0000", 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2749e-05 2024-04-26T12:32:34.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:21.300412+0000", 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1282000000000002e-05 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:14337 4.24 4:27adda6e:::100000001f8.0000000f:head [write 966656~4096,write 1040384~4096,write 1089536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:34.496 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.076582556, 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014670404, 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 14337 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363195+0000", 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363205+0000", 2024-04-26T12:32:34.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363216+0000", 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363222+0000", 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8690000000000001e-06 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363265+0000", 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2571999999999998e-05 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363340+0000", 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5190000000000003e-05 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363526+0000", 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185897 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.364824+0000", 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001298238 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377804+0000", 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012979892999999999 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377837+0000", 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3642000000000001e-05 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377866+0000", 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8657e-05 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15151 4.31 e59/13 4:8fb8ba0c:::100000001f8.00000024:head v 59'234, mlcod=59'231)", 2024-04-26T12:32:34.502 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.696923859, 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012740345, 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:34.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742854+0000", 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742870+0000", 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6078000000000001e-05 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742885+0000", 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4919999999999999e-05 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742891+0000", 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0349999999999998e-06 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742923+0000", 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1575999999999997e-05 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.742940+0000", 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7771e-05 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755553+0000", 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012612959999999999 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755595+0000", 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1529000000000002e-05 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15152 4.13 e59/13 4:cbf33e86:::100000001f8.00000026:head v 59'478, mlcod=59'476)", 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.743204+0000", 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6965746399999997, 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012507279, 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743204+0000", 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743204+0000", 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743203+0000", 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743216+0000", 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.26e-05 2024-04-26T12:32:34.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743224+0000", 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6519999999999995e-06 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743229+0000", 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1819999999999999e-06 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743263+0000", 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4139e-05 2024-04-26T12:32:34.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.743288+0000", 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5119000000000001e-05 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755675+0000", 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012387359000000001 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.755711+0000", 2024-04-26T12:32:34.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5726000000000003e-05 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15155 4.6 e59/52 4:635f8cb4:::100000001f8.0000003c:head v 59'916, mlcod=59'914)", 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6955991210000008, 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012694219, 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744179+0000", 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744192+0000", 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3468e-05 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744203+0000", 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0834e-05 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744211+0000", 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6229999999999997e-06 2024-04-26T12:32:34.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744262+0000", 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1607999999999998e-05 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.744280+0000", 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7931000000000002e-05 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756849+0000", 2024-04-26T12:32:34.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012568924 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.756873+0000", 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4357000000000001e-05 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15720 4.12 e59/13 4:48ab9bde:::100000001f8.00000015:head v 59'493, mlcod=59'489)", 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.4324302220000007, 2024-04-26T12:32:34.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015457238999999999, 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007347+0000", 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007368+0000", 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0183999999999999e-05 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007378+0000", 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0499000000000001e-05 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007394+0000", 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6254999999999999e-05 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.009739+0000", 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023449489999999998 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.009760+0000", 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1128000000000002e-05 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.022776+0000", 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013015729 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.022805+0000", 2024-04-26T12:32:34.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9096999999999999e-05 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:16533 4.f e60/13 4:f2a80dfe:::100000001f8.00000019:head v 60'798, mlcod=60'793)", 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:26.379037+0000", 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.0607416339999993, 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013554488, 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.520 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379037+0000", 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379037+0000", 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379036+0000", 2024-04-26T12:32:34.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379065+0000", 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8999000000000001e-05 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379071+0000", 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9229999999999999e-06 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379076+0000", 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379436+0000", 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000359926 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379453+0000", 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6971999999999999e-05 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.392564+0000", 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013110309000000001 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.392591+0000", 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625000000000001e-05 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:26775 4.37 e61/13 4:ecbf0fb2:::100000001f8.00000038:head v 61'1251, mlcod=61'1249)", 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:31.243933+0000", 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.1958455250000002, 2024-04-26T12:32:34.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013290732, 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.243933+0000", 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.243933+0000", 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.243932+0000", 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.243962+0000", 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9649e-05 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.243973+0000", 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1369000000000001e-05 2024-04-26T12:32:34.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.243981+0000", 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5599999999999996e-06 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.244011+0000", 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9981e-05 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.244025+0000", 2024-04-26T12:32:34.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4469e-05 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.257195+0000", 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013169683 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.257224+0000", 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8606999999999999e-05 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:27313 4.1c e61/52 4:39b842ef:::100000001f8.00000029:head v 61'444, mlcod=61'442)", 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:31.467522+0000", 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 2.972256099, 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014886968, 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467522+0000", 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467522+0000", 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467522+0000", 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467782+0000", 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026050200000000002 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467790+0000", 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0039999999999999e-06 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467796+0000", 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.037e-06 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467826+0000", 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9848e-05 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467843+0000", 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6365e-05 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.482384+0000", 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014541554999999999 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.482409+0000", 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5089999999999999e-05 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:27318 4.3b e61/52 4:dcc0c15f:::100000001f8.0000001a:head v 61'424, mlcod=61'422)", 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:31.468499+0000", 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 2.9712791479999998, 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012896932999999999, 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468499+0000", 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468499+0000", 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468499+0000", 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468652+0000", 2024-04-26T12:32:34.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000152998 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468663+0000", 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0959e-05 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468669+0000", 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.798e-06 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468715+0000", 2024-04-26T12:32:34.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5460999999999997e-05 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468746+0000", 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1072000000000003e-05 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.481363+0000", 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012617132 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.481396+0000", 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3111999999999997e-05 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:27322 4.2d e61/13 4:b4aa06e9:::100000001f8.0000001d:head v 61'836, mlcod=61'833)", 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:31.468904+0000", 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 2.9708741760000001, 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013340818000000001, 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468904+0000", 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468904+0000", 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.468904+0000", 2024-04-26T12:32:34.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469081+0000", 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017767400000000001 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469467+0000", 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038616699999999998 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469475+0000", 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1130000000000003e-06 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469652+0000", 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017781599999999999 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469673+0000", 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0358000000000001e-05 2024-04-26T12:32:34.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.482222+0000", 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012548962 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.482245+0000", 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3295e-05 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.541 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:27323 4.d e61/13 4:b1164065:::100000001f8.00000035:head v 61'436, mlcod=61'434)", 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:31.469317+0000", 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 2.9704610580000002, 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013205289, 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469317+0000", 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:34.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469317+0000", 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469317+0000", 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469415+0000", 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8406999999999995e-05 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:34.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469426+0000", 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0968000000000001e-05 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469433+0000", 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2049999999999996e-06 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469473+0000", 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9950999999999997e-05 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.469495+0000", 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1554999999999999e-05 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.482504+0000", 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013008774000000001 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.482523+0000", 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9001e-05 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:34.546 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:34.546 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:34.547 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:34.548 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:34.547+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:34.648 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:34.648+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:34181 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2289664~4096 in=4096b,write 2342912~4096 in=4096b,write 2355200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:34.714175+0000", 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0053851130000000004, 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0054152030000000004, 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:34.720 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 34181 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.714175+0000", 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.714175+0000", 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:34.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.714174+0000", 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.714226+0000", 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.714235+0000", 2024-04-26T12:32:34.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4620000000000002e-06 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.714243+0000", 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1239999999999999e-06 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.714283+0000", 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0478000000000001e-05 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:34.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.714333+0000", 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9901000000000002e-05 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.714424+0000", 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1121999999999999e-05 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.717656+0000", 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003232136 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:34.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719603+0000", 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0019469470000000001 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:34184 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 1499136~4096 in=4096b,write 1552384~4096 in=4096b,write 1564672~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:34.715752+0000", 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0038084260000000002, 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0039391699999999997, 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:34.725 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 34184 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.715752+0000", 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.715752+0000", 2024-04-26T12:32:34.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.715751+0000", 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.715763+0000", 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1466e-05 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.715771+0000", 2024-04-26T12:32:34.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6009999999999995e-06 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.715776+0000", 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.079e-06 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.715807+0000", 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0583999999999997e-05 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:34.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.715854+0000", 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6705000000000001e-05 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.715935+0000", 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1223000000000005e-05 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:34187 4.35 e62/23 4:af28909f:::100000001f8.0000001b:head v 62'1055, mlcod=62'1053)", 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:34.717502+0000", 2024-04-26T12:32:34.729 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0020577199999999999, 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0022497039999999999, 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.717502+0000", 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.717502+0000", 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:34.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.717502+0000", 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.717513+0000", 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0961000000000001e-05 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.717523+0000", 2024-04-26T12:32:34.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0213e-05 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.717530+0000", 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6590000000000001e-06 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.717559+0000", 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9556999999999998e-05 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.717570+0000", 2024-04-26T12:32:34.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1351e-05 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:34193 4.38 4:1fc350da:::100000001f8.0000002f:head [write 2912256~4096 in=4096b,write 3018752~4096 in=4096b,write 3051520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:34.719531+0000", 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 2.9311000000000001e-05, 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025956299999999998, 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:34.733 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 34193 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719531+0000", 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719531+0000", 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719530+0000", 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719540+0000", 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0593e-05 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719556+0000", 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5659999999999999e-05 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719562+0000", 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.139e-06 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719595+0000", 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3068999999999998e-05 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719650+0000", 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4902999999999999e-05 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:34.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:34.719758+0000", 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107544 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 4 2024-04-26T12:32:34.737 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:34.738 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:34.749 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:34.749+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:34.849 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:34.849+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:34.892 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:34.892 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:34.892 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:34.892 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:34.892 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:34.904 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:34.989 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:34.988+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:35.051 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:35.051+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:35.104 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:35.104 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:35.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:35.104 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:35.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.104 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14175 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1835008~4096,write 1945600~4096,write 2031616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.104 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:35.104 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.8089584320000007, 2024-04-26T12:32:35.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.98270771099999998, 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14175 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292076+0000", 2024-04-26T12:32:35.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1482e-05 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292089+0000", 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2865e-05 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292097+0000", 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6290000000000001e-06 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292141+0000", 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4759000000000003e-05 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292152+0000", 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0906e-05 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264779+0000", 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.97262671899999997 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264860+0000", 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0871999999999994e-05 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264964+0000", 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104584 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269185+0000", 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042204790000000001 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274691+0000", 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0055061140000000003 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274737+0000", 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6428999999999999e-05 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274773+0000", 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5722999999999997e-05 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.110 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14176 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3907584~4096,write 4022272~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.8086793159999992, 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.98263749300000003, 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14176 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292344+0000", 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292364+0000", 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0412e-05 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292371+0000", 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.477e-06 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292375+0000", 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8840000000000004e-06 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292408+0000", 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3003999999999998e-05 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292416+0000", 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0620000000000001e-06 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266076+0000", 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.97366027499999996 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266132+0000", 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6279000000000001e-05 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266224+0000", 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1463000000000002e-05 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269227+0000", 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0030027220000000002 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274894+0000", 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0056677730000000001 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274944+0000", 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9356e-05 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274982+0000", 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8343999999999997e-05 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.116 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14209 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2813952~4096,write 2973696~4096,write 3047424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.7935733539999994, 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.96821334599999997, 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14209 2024-04-26T12:32:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307465+0000", 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4949e-05 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307479+0000", 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4707e-05 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307490+0000", 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0146000000000001e-05 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307531+0000", 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1677000000000001e-05 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307538+0000", 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7309999999999996e-06 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266634+0000", 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.959096422 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266704+0000", 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9338000000000006e-05 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266808+0000", 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103847 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269265+0000", 2024-04-26T12:32:35.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0024577010000000001 2024-04-26T12:32:35.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275617+0000", 2024-04-26T12:32:35.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0063514490000000003 2024-04-26T12:32:35.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275644+0000", 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7761000000000001e-05 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275664+0000", 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9340000000000001e-05 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.123 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14210 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3596288~4096,write 3612672~4096,write 3633152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.7931889590000001, 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.96837596400000003, 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14210 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:35.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307834+0000", 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307850+0000", 2024-04-26T12:32:35.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5736e-05 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307860+0000", 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6050000000000004e-06 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307867+0000", 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307928+0000", 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0779999999999997e-05 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307935+0000", 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0400000000000004e-06 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267291+0000", 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.95935644200000003 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267350+0000", 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8502999999999999e-05 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267438+0000", 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8274000000000002e-05 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269295+0000", 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018571449999999999 2024-04-26T12:32:35.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276165+0000", 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0068700970000000004 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276191+0000", 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6043000000000001e-05 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276211+0000", 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9599999999999999e-05 2024-04-26T12:32:35.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14234 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 872448~4096,write 937984~4096,write 1011712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.7820624889999994, 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.95729165400000005, 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14234 2024-04-26T12:32:35.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:35.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318973+0000", 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1941e-05 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318981+0000", 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5099999999999998e-06 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318988+0000", 2024-04-26T12:32:35.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7349999999999999e-06 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.319020+0000", 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2155e-05 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.319027+0000", 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8129999999999998e-06 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268425+0000", 2024-04-26T12:32:35.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.949398454 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268508+0000", 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2711000000000001e-05 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268677+0000", 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000168956 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274681+0000", 2024-04-26T12:32:35.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.006004255 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276216+0000", 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015346680000000001 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276237+0000", 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276253+0000", 2024-04-26T12:32:35.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5809999999999999e-05 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14298 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1114112~4096,write 1130496~4096,write 1196032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.7537347899999993, 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.92900384300000005, 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.136 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14298 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347288+0000", 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347301+0000", 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2772000000000001e-05 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347310+0000", 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5909999999999996e-06 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347316+0000", 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5180000000000001e-06 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347350+0000", 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3643000000000003e-05 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347358+0000", 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6739999999999997e-06 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269323+0000", 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.921965492 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269443+0000", 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000119998 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269600+0000", 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015721600000000001 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274812+0000", 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.005211551 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276257+0000", 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014454190000000001 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276278+0000", 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0403000000000001e-05 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276293+0000", 2024-04-26T12:32:35.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5235999999999999e-05 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14357 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 319488~4096,write 528384~4096,write 536576~4096,write 552960~4096,write 704512~4096,write 741376~4096,write 1064960~4096,write 1359872~4096,write 1409024~4096,write 1536000~4096,write 1581056~4096,write 1650688~4096,write 1658880~4096,write 1781760~4096,write 1822720~4096,write 2183168~4096,write 2191360~4096,write 2306048~4096,write 2433024~4096,write 2633728~4096,write 2650112~4096,write 2662400~4096,write 2797568~4096,write 3153920~4096,write 3182592~4096,write 3194880~4096,write 3420160~4096,write 3469312~4096,write 3584000~4096,write 3670016~4096,write 3829760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.7314828529999993, 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.91281808399999997, 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.142 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14357 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369640+0000", 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9499000000000004e-05 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369645+0000", 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.51e-06 2024-04-26T12:32:35.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369648+0000", 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4879999999999999e-06 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.371151+0000", 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001503332 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.371162+0000", 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:32:35.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270133+0000", 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.89897075599999998 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270195+0000", 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2224000000000006e-05 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270513+0000", 2024-04-26T12:32:35.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00031765100000000001 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275008+0000", 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0044954000000000001 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282289+0000", 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072804460000000003 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282335+0000", 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6337e-05 2024-04-26T12:32:35.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282359+0000", 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3918999999999999e-05 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14616 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 24576~4096,write 32768~4096,write 57344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.5829888899999993, 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.76447159499999995, 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.148 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14616 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:35.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518034+0000", 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518046+0000", 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1545999999999999e-05 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518054+0000", 2024-04-26T12:32:35.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0029999999999994e-06 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518059+0000", 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9470000000000002e-06 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518200+0000", 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014118799999999999 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518210+0000", 2024-04-26T12:32:35.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0275000000000001e-05 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275044+0000", 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.75683380899999997 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275126+0000", 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1536e-05 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275221+0000", 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5253000000000004e-05 2024-04-26T12:32:35.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282369+0000", 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071480729999999996 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282438+0000", 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9494999999999998e-05 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282472+0000", 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3896999999999997e-05 2024-04-26T12:32:35.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282507+0000", 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4245999999999997e-05 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14664 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 0~4096,write 110592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.5636720769999997, 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.74525697300000004, 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.154 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.155 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.155 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.155 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.155 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14664 2024-04-26T12:32:35.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.155 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:35.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537351+0000", 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537360+0000", 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4080000000000004e-06 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537370+0000", 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4080000000000004e-06 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537375+0000", 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4600000000000002e-06 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537408+0000", 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2237999999999999e-05 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537414+0000", 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0619999999999997e-06 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275680+0000", 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.73826678099999998 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275731+0000", 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0281000000000002e-05 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275814+0000", 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3407999999999998e-05 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282375+0000", 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065614180000000003 2024-04-26T12:32:35.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282558+0000", 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00018219699999999999 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282588+0000", 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0051000000000001e-05 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282609+0000", 2024-04-26T12:32:35.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1021000000000001e-05 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14959 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 118784~4096,write 270336~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.4370542880000006, 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.61876598900000002, 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.162 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14959 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663969+0000", 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663977+0000", 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4230000000000005e-06 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663985+0000", 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.277e-06 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663989+0000", 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7650000000000001e-06 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.664023+0000", 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3277e-05 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.664030+0000", 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0759999999999997e-06 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276327+0000", 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.61229685599999994 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276405+0000", 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276583+0000", 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017775700000000001 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282380+0000", 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0057972709999999997 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282654+0000", 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000273095 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282699+0000", 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5129000000000001e-05 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282736+0000", 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.684e-05 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15290 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2097152~4096,write 2134016~4096,write 2248704~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.2974200539999998, 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.48063225399999998, 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.168 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15290 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:35.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803603+0000", 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803611+0000", 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8990000000000001e-06 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803618+0000", 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0119999999999999e-06 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803623+0000", 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2930000000000002e-06 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803650+0000", 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7858e-05 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803657+0000", 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1430000000000003e-06 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277533+0000", 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.473876666 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277591+0000", 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7605999999999997e-05 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277692+0000", 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000100868 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282386+0000", 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046946890000000002 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284181+0000", 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001795079 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284216+0000", 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284236+0000", 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0171000000000001e-05 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15338 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3837952~4096,write 3850240~4096,write 4026368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:35.174 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.2746609509999995, 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45796468000000001, 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15338 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826362+0000", 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826384+0000", 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2115000000000001e-05 2024-04-26T12:32:35.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826394+0000", 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.2250000000000006e-06 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826399+0000", 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.259e-06 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826438+0000", 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9082999999999998e-05 2024-04-26T12:32:35.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826449+0000", 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0747000000000001e-05 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278509+0000", 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45205991600000001 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278588+0000", 2024-04-26T12:32:35.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9072000000000005e-05 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278725+0000", 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000137207 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282392+0000", 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0036672520000000002 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284276+0000", 2024-04-26T12:32:35.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018842780000000001 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284307+0000", 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284328+0000", 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0778e-05 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15354 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1396736~4096,write 1449984~4096,write 1675264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.2668880120000008, 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45026424700000001, 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15354 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834135+0000", 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834147+0000", 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2592000000000001e-05 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834157+0000", 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5550000000000008e-06 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834170+0000", 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2683999999999999e-05 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834202+0000", 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2668e-05 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834209+0000", 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279284+0000", 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.44507556799999998 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279333+0000", 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8560999999999998e-05 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279427+0000", 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3917000000000002e-05 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282397+0000", 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029705460000000001 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284358+0000", 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0019611770000000001 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284383+0000", 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284400+0000", 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.747e-05 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.186 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15416 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 950272~4096,write 1155072~4096,write 1245184~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.2373320959999994, 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.420828757, 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15416 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863691+0000", 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863706+0000", 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863716+0000", 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0139000000000001e-05 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863723+0000", 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9290000000000001e-06 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863762+0000", 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863769+0000", 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1509999999999998e-06 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280011+0000", 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.416241743 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280098+0000", 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7367000000000006e-05 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280249+0000", 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000150168 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282617+0000", 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023680839999999999 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284444+0000", 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018270000000000001 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284488+0000", 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4659000000000001e-05 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284520+0000", 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2193000000000002e-05 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15421 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3383296~4096,write 3407872~4096,write 3440640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.2350547929999998, 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.41862908900000001, 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15421 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865968+0000", 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865986+0000", 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7314000000000001e-05 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865994+0000", 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2409999999999995e-06 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866000+0000", 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:32:35.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866042+0000", 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2162000000000001e-05 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866049+0000", 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5270000000000004e-06 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280822+0000", 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.414773799 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280904+0000", 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2118000000000002e-05 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281077+0000", 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017207600000000001 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282621+0000", 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015443259999999999 2024-04-26T12:32:35.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284550+0000", 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001928969 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284580+0000", 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9835000000000001e-05 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284598+0000", 2024-04-26T12:32:35.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8447000000000001e-05 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15449 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 405504~4096,write 671744~4096,write 700416~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.2230023469999995, 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.40665650599999997, 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.199 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15449 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:35.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878038+0000", 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7227999999999998e-05 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878049+0000", 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0869999999999999e-05 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878054+0000", 2024-04-26T12:32:35.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2619999999999998e-06 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878085+0000", 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0559000000000003e-05 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878091+0000", 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9939999999999997e-06 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281693+0000", 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.40360222499999998 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281747+0000", 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4017999999999997e-05 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281850+0000", 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103348 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284244+0000", 2024-04-26T12:32:35.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023942669999999998 2024-04-26T12:32:35.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284637+0000", 2024-04-26T12:32:35.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000392369 2024-04-26T12:32:35.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284660+0000", 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3116e-05 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284678+0000", 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8048999999999999e-05 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15473 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3801088~4096,write 4050944~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:35.206 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.2103218810000005, 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39472404999999999, 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15473 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890701+0000", 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890723+0000", 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1681000000000001e-05 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890731+0000", 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5349999999999999e-06 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890735+0000", 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8520000000000003e-06 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890988+0000", 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025219499999999998 2024-04-26T12:32:35.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890994+0000", 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282756+0000", 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39176148700000002 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282818+0000", 2024-04-26T12:32:35.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2429999999999997e-05 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282922+0000", 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103094 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284408+0000", 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001486343 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285350+0000", 2024-04-26T12:32:35.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00094174299999999999 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285388+0000", 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8306000000000002e-05 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285426+0000", 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8102999999999998e-05 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15483 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2674688~4096,write 3006464~4096,write 3055616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.2061443979999993, 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39308472300000002, 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15483 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894890+0000", 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1477999999999999e-05 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894902+0000", 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1802e-05 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894909+0000", 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8700000000000003e-06 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894980+0000", 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1518000000000002e-05 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894991+0000", 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0916e-05 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283304+0000", 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38831311299999999 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283374+0000", 2024-04-26T12:32:35.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9589000000000001e-05 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283526+0000", 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015212 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285298+0000", 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001772385 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287859+0000", 2024-04-26T12:32:35.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0025601439999999999 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287919+0000", 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9951000000000002e-05 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287964+0000", 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5608000000000001e-05 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15503 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2396160~4096,write 2449408~4096,write 2605056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.1966176359999992, 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38366402100000002, 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15503 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904405+0000", 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904421+0000", 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5413e-05 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904431+0000", 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0244999999999999e-05 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904442+0000", 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0746e-05 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904487+0000", 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4858999999999999e-05 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904501+0000", 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4498000000000001e-05 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284701+0000", 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38019989100000001 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284748+0000", 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6668000000000001e-05 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284839+0000", 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1133999999999999e-05 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287788+0000", 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029491349999999999 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288005+0000", 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00021703299999999999 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288033+0000", 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7971e-05 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288070+0000", 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7231000000000003e-05 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15520 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3747840~4096,write 3772416~4096,write 4149248~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.1877959909999998, 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.37495473499999998, 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:35.225 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15520 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:35.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913227+0000", 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913241+0000", 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3995999999999999e-05 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913250+0000", 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913257+0000", 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4649999999999997e-06 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913297+0000", 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9274999999999999e-05 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913303+0000", 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4049999999999997e-06 2024-04-26T12:32:35.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285461+0000", 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.37215769999999998 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285508+0000", 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6938999999999999e-05 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285613+0000", 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00010532899999999999 2024-04-26T12:32:35.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288084+0000", 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002471132 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288121+0000", 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6665000000000002e-05 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288148+0000", 2024-04-26T12:32:35.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7379e-05 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288183+0000", 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4419999999999999e-05 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:35.231 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:35.233 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:35.232+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:35.233 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:32:35.234 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:35.335 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:35.334+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:35598 4.12 e63/13 4:48ab9bde:::100000001f8.00000015:head v 63'1100, mlcod=63'1098)", 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:35.398677+0000", 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00097369999999999998, 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00099209699999999994, 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.398677+0000", 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.398677+0000", 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.398677+0000", 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.398692+0000", 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4901e-05 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.398699+0000", 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8469999999999998e-06 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.398703+0000", 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4429999999999996e-06 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.398742+0000", 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8531000000000001e-05 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.398759+0000", 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6920999999999999e-05 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.403 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.404 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.404 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:35.404 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 1 2024-04-26T12:32:35.404 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:35.413 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:35.434 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:35.433+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:35.535 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:35.535+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:35.616 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:35.616 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:35.616 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:35.616 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:35.616 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:35.629 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:35.636 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:35.636+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:35.738 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:35.737+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:35.800 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 123.194804788, 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013632534, 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603253+0000", 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603252+0000", 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603258+0000", 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7899999999999996e-06 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603266+0000", 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603276+0000", 2024-04-26T12:32:35.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603854+0000", 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00057800400000000002 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603870+0000", 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5752000000000001e-05 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607180+0000", 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033105460000000001 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607292+0000", 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011171999999999999 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607430+0000", 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013829000000000001 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.615858+0000", 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0084276500000000001 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616803+0000", 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00094495400000000002 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616848+0000", 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4743999999999997e-05 2024-04-26T12:32:35.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616886+0000", 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8166e-05 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(mds.0.3:29 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 123.194692977, 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016996298, 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.807 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603365+0000", 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603369+0000", 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1370000000000004e-06 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603375+0000", 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5409999999999997e-06 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603380+0000", 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603962+0000", 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058153100000000004 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.603966+0000", 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9709999999999998e-06 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607694+0000", 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037287850000000001 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607846+0000", 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015131300000000001 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.607997+0000", 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015117400000000001 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.616025+0000", 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080275910000000006 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620305+0000", 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042801499999999999 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620335+0000", 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.989e-05 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:30:32.620361+0000", 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6709000000000001e-05 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.079841120000001, 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021336570999999999, 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.813 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 23 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718217+0000", 2024-04-26T12:32:35.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.718215+0000", 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722001+0000", 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037856769999999999 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722016+0000", 2024-04-26T12:32:35.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5123000000000001e-05 2024-04-26T12:32:35.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722024+0000", 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6799999999999993e-06 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722085+0000", 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1277000000000003e-05 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722183+0000", 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7922000000000002e-05 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.722284+0000", 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100985 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.726784+0000", 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0045004479999999998 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739478+0000", 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012693594000000001 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739511+0000", 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3322999999999999e-05 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.739553+0000", 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2250999999999999e-05 2024-04-26T12:32:35.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:25 4.2a 4:57147dc3:::100000001f8.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.827898489999999, 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013954156000000001, 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:35.820 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 25 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970159+0000", 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.970158+0000", 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973845+0000", 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036870309999999999 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973859+0000", 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3431999999999999e-05 2024-04-26T12:32:35.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973867+0000", 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7940000000000003e-06 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.973931+0000", 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4793000000000001e-05 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974029+0000", 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7404000000000005e-05 2024-04-26T12:32:35.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.974117+0000", 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8641999999999996e-05 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.976886+0000", 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027684480000000002 2024-04-26T12:32:35.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984047+0000", 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.007161059 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984086+0000", 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9490000000000003e-05 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:12.984114+0000", 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.73e-05 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:14337 4.24 4:27adda6e:::100000001f8.0000000f:head [write 966656~4096,write 1040384~4096,write 1089536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.434862220999999, 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014670404, 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:35.826 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 14337 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363196+0000", 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363195+0000", 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363205+0000", 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5140000000000007e-06 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363216+0000", 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1636e-05 2024-04-26T12:32:35.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363222+0000", 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8690000000000001e-06 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363265+0000", 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2571999999999998e-05 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363340+0000", 2024-04-26T12:32:35.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5190000000000003e-05 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.363526+0000", 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185897 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.364824+0000", 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001298238 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377804+0000", 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012979892999999999 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377837+0000", 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3642000000000001e-05 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:25.377866+0000", 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8657e-05 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.831 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:15720 4.12 e59/13 4:48ab9bde:::100000001f8.00000015:head v 59'493, mlcod=59'489)", 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.7907098870000002, 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015457238999999999, 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007348+0000", 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007347+0000", 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007368+0000", 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0183999999999999e-05 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007378+0000", 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0499000000000001e-05 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.007394+0000", 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6254999999999999e-05 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.009739+0000", 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023449489999999998 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.009760+0000", 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1128000000000002e-05 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.022776+0000", 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013015729 2024-04-26T12:32:35.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.022805+0000", 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9096999999999999e-05 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:16533 4.f e60/13 4:f2a80dfe:::100000001f8.00000019:head v 60'798, mlcod=60'793)", 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:26.379037+0000", 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 9.4190212990000006, 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013554488, 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.836 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379037+0000", 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379037+0000", 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379036+0000", 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379065+0000", 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8999000000000001e-05 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379071+0000", 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9229999999999999e-06 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379076+0000", 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379436+0000", 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000359926 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.379453+0000", 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6971999999999999e-05 2024-04-26T12:32:35.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.392564+0000", 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013110309000000001 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:26.392591+0000", 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625000000000001e-05 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:27313 4.1c e61/52 4:39b842ef:::100000001f8.00000029:head v 61'444, mlcod=61'442)", 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:31.467522+0000", 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.3305357640000004, 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014886968, 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467522+0000", 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467522+0000", 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467522+0000", 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467782+0000", 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026050200000000002 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467790+0000", 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0039999999999999e-06 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467796+0000", 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.037e-06 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467826+0000", 2024-04-26T12:32:35.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9848e-05 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.467843+0000", 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6365e-05 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.482384+0000", 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014541554999999999 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:31.482409+0000", 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5089999999999999e-05 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:33777 4.12 e62/13 4:48ab9bde:::100000001f8.00000015:head v 62'1033, mlcod=62'1031)", 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:34.500954+0000", 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.2971040469999999, 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013977180000000001, 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.500954+0000", 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.500954+0000", 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.500953+0000", 2024-04-26T12:32:35.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.500966+0000", 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2404e-05 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.500977+0000", 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0801e-05 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.500981+0000", 2024-04-26T12:32:35.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7740000000000004e-06 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.501014+0000", 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2863e-05 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.501030+0000", 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5707999999999999e-05 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.514896+0000", 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013866147000000001 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.514931+0000", 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4981999999999998e-05 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:33788 4.24 4:27adda6e:::100000001f8.0000000f:head [write 454656~4096,write 475136~4096,write 491520~4096,write 643072~4096,write 720896~4096,write 745472~4096,write 798720~4096,write 864256~4096,write 925696~4096,write 974848~4096,write 991232~4096,write 1003520~4096,write 1114112~4096,write 1138688~4096,write 1257472~4096,write 1273856~4096,write 1425408~8192,write 1695744~4096,write 1855488~4096,write 2322432~4096,write 2740224~4096,write 2764800~4096,write 2801664~8192,write 2883584~4096,write 2961408~4096,write 3063808~4096,write 3149824~4096,write 3194880~4096,write 3325952~4096,write 3760128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:34.503831+0000", 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.2942273289999999, 2024-04-26T12:32:35.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014421404000000001, 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 33788 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.503831+0000", 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.503831+0000", 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.503830+0000", 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.504029+0000", 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00019913299999999999 2024-04-26T12:32:35.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.504039+0000", 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0285000000000001e-05 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.504045+0000", 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7529999999999998e-06 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.504084+0000", 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9643e-05 2024-04-26T12:32:35.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.504220+0000", 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013506799999999999 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.504881+0000", 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00066174599999999995 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.517530+0000", 2024-04-26T12:32:35.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012648314000000001 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.518167+0000", 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00063689599999999997 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.518217+0000", 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0256999999999997e-05 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.518252+0000", 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5284999999999998e-05 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:34340 4.6 e62/52 4:62d56fc8:::100000001f8.0000001c:head v 62'2116, mlcod=62'2112)", 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:34.793108+0000", 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.004950308, 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016408150999999999, 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.793108+0000", 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.793108+0000", 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.793107+0000", 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.793116+0000", 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1290000000000002e-06 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.793124+0000", 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8650000000000001e-06 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.793129+0000", 2024-04-26T12:32:35.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4360000000000004e-06 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795375+0000", 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002246222 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795388+0000", 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3606e-05 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.809493+0000", 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014104274 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.809516+0000", 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3070000000000001e-05 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:34342 4.2e e62/52 4:75be0f36:::100000001f8.0000003d:head v 62'532, mlcod=62'530)", 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:34.794480+0000", 2024-04-26T12:32:35.859 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.0035782790000001, 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014101548, 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794480+0000", 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794480+0000", 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794479+0000", 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794508+0000", 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.906e-05 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794515+0000", 2024-04-26T12:32:35.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2960000000000004e-06 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794520+0000", 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7119999999999997e-06 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795369+0000", 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00084884700000000001 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795386+0000", 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6651e-05 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.808554+0000", 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013168556999999999 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.808581+0000", 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6794000000000001e-05 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:34341 4.6 e62/52 4:635f8cb4:::100000001f8.0000003c:head v 62'2117, mlcod=62'2112)", 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:34.794547+0000", 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.0035108269999999, 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014981807, 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794547+0000", 2024-04-26T12:32:35.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794547+0000", 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794547+0000", 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794559+0000", 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2361000000000001e-05 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794570+0000", 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1318000000000001e-05 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.794576+0000", 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0839999999999999e-06 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797010+0000", 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024345230000000001 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797031+0000", 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1297999999999998e-05 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.809518+0000", 2024-04-26T12:32:35.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012486273000000001 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.809529+0000", 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1285e-05 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:34348 4.f e62/13 4:f2a80dfe:::100000001f8.00000019:head v 62'1628, mlcod=62'1625)", 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:34.795262+0000", 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.0027961599999999, 2024-04-26T12:32:35.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015574094, 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795262+0000", 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795262+0000", 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795261+0000", 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795274+0000", 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3081999999999999e-05 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795282+0000", 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.469e-06 2024-04-26T12:32:35.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795287+0000", 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9219999999999996e-06 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795319+0000", 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1925999999999999e-05 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.795346+0000", 2024-04-26T12:32:35.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7399e-05 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.810808+0000", 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015461897 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.810836+0000", 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7953000000000002e-05 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:34349 4.36 e62/52 4:6fa85f86:::100000001f8.00000013:head v 62'1620, mlcod=62'1617)", 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:34.796994+0000", 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.0010635590000001, 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013805644000000001, 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.796994+0000", 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.796994+0000", 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.796994+0000", 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797006+0000", 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2266000000000001e-05 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797014+0000", 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9349999999999994e-06 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797019+0000", 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7199999999999997e-06 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.804408+0000", 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.007388932 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.804436+0000", 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8195e-05 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.810776+0000", 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063404630000000002 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.810800+0000", 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3609999999999999e-05 2024-04-26T12:32:35.876 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:34352 4.2f e62/13 4:f59f865b:::100000001f8.00000007:head v 62'540, mlcod=62'538)", 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:34.797213+0000", 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.0008451679999999, 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013646787000000001, 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797213+0000", 2024-04-26T12:32:35.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797213+0000", 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797212+0000", 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797232+0000", 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9805000000000001e-05 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797238+0000", 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1550000000000004e-06 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797248+0000", 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9569999999999997e-06 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797278+0000", 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9621999999999999e-05 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.797291+0000", 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3073e-05 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.810839+0000", 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013548008 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:34.810860+0000", 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0526999999999998e-05 2024-04-26T12:32:35.880 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:35838 4.23 e63/13 4:c6f90462:::100000001f8.00000037:head v 63'558, mlcod=63'556)", 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:35.515259+0000", 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.28279873300000002, 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015848298, 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515259+0000", 2024-04-26T12:32:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515259+0000", 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515259+0000", 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515272+0000", 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3429e-05 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515283+0000", 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.116e-05 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515291+0000", 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515319+0000", 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7761000000000001e-05 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515331+0000", 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2061e-05 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.531083+0000", 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015752703999999999 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.531108+0000", 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4184000000000001e-05 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:35839 4.37 e63/13 4:ef395e89:::100000001f8.00000020:head v 63'1679, mlcod=63'1677)", 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:35.515546+0000", 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.28251177, 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017409733, 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.885 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515546+0000", 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515546+0000", 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515546+0000", 2024-04-26T12:32:35.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515561+0000", 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.535e-05 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515571+0000", 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.042e-05 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515578+0000", 2024-04-26T12:32:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6050000000000003e-06 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515616+0000", 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8216000000000001e-05 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.515640+0000", 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3683999999999999e-05 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.532930+0000", 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017289690999999999 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.532956+0000", 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6373999999999999e-05 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:35842 4.f e63/13 4:f0d983b2:::100000001f8.0000001f:head v 63'1693, mlcod=63'1690)", 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:35.516832+0000", 2024-04-26T12:32:35.889 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.28122550699999999, 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016147914999999999, 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.516832+0000", 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.516832+0000", 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.516832+0000", 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.516843+0000", 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1027e-05 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.516851+0000", 2024-04-26T12:32:35.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4009999999999997e-06 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.516856+0000", 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6070000000000001e-06 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.516906+0000", 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0413e-05 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.516930+0000", 2024-04-26T12:32:35.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3068e-05 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.532960+0000", 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016030198999999998 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.532980+0000", 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.065e-05 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:35844 4.f e63/13 4:f2a80dfe:::100000001f8.00000019:head v 63'1694, mlcod=63'1691)", 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:35.518950+0000", 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.279107722, 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014047894, 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.518950+0000", 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:35.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.518950+0000", 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.518950+0000", 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.518962+0000", 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1844e-05 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.518973+0000", 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.163e-05 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.518978+0000", 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.476e-06 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.522851+0000", 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038735200000000001 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.522870+0000", 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8614000000000002e-05 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.532983+0000", 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0101128 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:35.532998+0000", 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5586e-05 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.897 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:35.898 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:35.898 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:35.899 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:35.898+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:35.899 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:36.000 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:36.000+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:36.069 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:36.069 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:36.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.069 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36943 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 675840~4096 in=4096b,write 692224~4096 in=4096b,write 733184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.069 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.039229+0000", 2024-04-26T12:32:36.069 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.026464456000000001, 2024-04-26T12:32:36.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026493691, 2024-04-26T12:32:36.069 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.069 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36943 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.039229+0000", 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.039229+0000", 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.039228+0000", 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.039247+0000", 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8756000000000001e-05 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.039259+0000", 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1554e-05 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.039267+0000", 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2619999999999998e-06 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.040251+0000", 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00098379700000000001 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.040319+0000", 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7706000000000005e-05 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.040412+0000", 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3448000000000004e-05 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.042582+0000", 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0021697729999999998 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.073 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36905 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 3244032~4096 in=4096b,write 3403776~4096 in=4096b,write 3530752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.024858+0000", 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.040836025999999997, 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.040965129000000003, 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.074 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36905 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.024858+0000", 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.024858+0000", 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.024857+0000", 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.024872+0000", 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5461999999999999e-05 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.024885+0000", 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3168e-05 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.024893+0000", 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0819999999999999e-06 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.024936+0000", 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2509999999999998e-05 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.025039+0000", 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00010357 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.025228+0000", 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00018875000000000001 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.029446+0000", 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042177830000000001 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.078 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36996 4.38 4:1fc350da:::100000001f8.0000002f:head [write 2277376~4096 in=4096b,write 2342912~4096 in=4096b,write 2355200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.060510+0000", 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0051839939999999999, 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0054054250000000002, 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36996 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.060510+0000", 2024-04-26T12:32:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.060510+0000", 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.060509+0000", 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.060525+0000", 2024-04-26T12:32:36.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6399999999999999e-05 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.060536+0000", 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0929e-05 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.060545+0000", 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4489999999999999e-06 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.060580+0000", 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5850999999999999e-05 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.060635+0000", 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4833999999999997e-05 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.060732+0000", 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6978999999999994e-05 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.065355+0000", 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046229859999999999 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36998 4.32 4:4f726a0c:::100000001f8.00000012:head [write 3477504~4096 in=4096b,write 3518464~4096 in=4096b,write 3641344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.061178+0000", 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0045153440000000001, 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0048368350000000003, 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36998 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.061178+0000", 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.061178+0000", 2024-04-26T12:32:36.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.061177+0000", 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.061190+0000", 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2369e-05 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.061205+0000", 2024-04-26T12:32:36.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5509e-05 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.061213+0000", 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7789999999999996e-06 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.061255+0000", 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2218000000000001e-05 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.061330+0000", 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4759999999999996e-05 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.061498+0000", 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016825400000000001 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.065808+0000", 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043096109999999997 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36908 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 3100672~4096 in=4096b,write 3133440~4096 in=4096b,write 3264512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.025884+0000", 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.039809918999999999, 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.040220660999999998, 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36908 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.025884+0000", 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.025884+0000", 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.025883+0000", 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.025897+0000", 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3773e-05 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.025908+0000", 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1676e-05 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.025924+0000", 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5682999999999999e-05 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.025974+0000", 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9574999999999999e-05 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.026053+0000", 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9214000000000004e-05 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.026212+0000", 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015953199999999999 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.029120+0000", 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029079349999999999 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36910 4.38 4:1fc350da:::100000001f8.0000002f:head [write 311296~4096 in=4096b,write 487424~4096 in=4096b,write 573440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.092 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.026895+0000", 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.038798125000000003, 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.039299168000000002, 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36910 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.026895+0000", 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.026895+0000", 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.026895+0000", 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.026919+0000", 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.408e-05 2024-04-26T12:32:36.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.026930+0000", 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.11e-05 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.026937+0000", 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.357e-06 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027377+0000", 2024-04-26T12:32:36.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00043936700000000002 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027454+0000", 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7733999999999998e-05 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027614+0000", 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015943700000000001 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.033142+0000", 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0055287649999999997 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36955 4.38 4:1d13bf87:::100000001f8.00000030:head [write 872448~4096 in=4096b,write 925696~4096 in=4096b,write 987136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.044394+0000", 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.021299339, 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.021895775999999999, 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.097 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36955 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.044394+0000", 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.044394+0000", 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.044394+0000", 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.044401+0000", 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7999999999999999e-06 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.044410+0000", 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7940000000000008e-06 2024-04-26T12:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.044414+0000", 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1949999999999996e-06 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.044451+0000", 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6180000000000003e-05 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.044529+0000", 2024-04-26T12:32:36.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8213999999999993e-05 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.044676+0000", 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014758699999999999 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046639+0000", 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0019627120000000001 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37003 4.d 4:b1164065:::100000001f8.00000035:head [write 598016~4096 in=4096b,write 798720~4096 in=4096b,write 811008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.063182+0000", 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0025117709999999999, 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003212646, 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37003 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063182+0000", 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063182+0000", 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063181+0000", 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063198+0000", 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6575e-05 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063205+0000", 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4939999999999997e-06 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063210+0000", 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8520000000000003e-06 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063240+0000", 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0071000000000001e-05 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063292+0000", 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1693999999999997e-05 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063376+0000", 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4572000000000003e-05 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.065855+0000", 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0024789170000000002 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36911 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3338240~4096 in=4096b,write 3448832~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.027232+0000", 2024-04-26T12:32:36.106 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.038461798999999998, 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.039261590999999998, 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36911 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027232+0000", 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027232+0000", 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027231+0000", 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027265+0000", 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.379e-05 2024-04-26T12:32:36.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027274+0000", 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5729999999999997e-06 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027281+0000", 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8940000000000004e-06 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027335+0000", 2024-04-26T12:32:36.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3222e-05 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027422+0000", 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7618e-05 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.027567+0000", 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000145265 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.033821+0000", 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062539350000000004 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37004 4.32 4:4f726a0c:::100000001f8.00000012:head [write 61440~4096 in=4096b,write 147456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.063510+0000", 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0021838970000000002, 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0030688880000000001, 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.111 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37004 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063510+0000", 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063510+0000", 2024-04-26T12:32:36.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063509+0000", 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063519+0000", 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0360000000000001e-05 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063529+0000", 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0141e-05 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063536+0000", 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8809999999999998e-06 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063565+0000", 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8838000000000001e-05 2024-04-26T12:32:36.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063611+0000", 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6328000000000001e-05 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063691+0000", 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9853999999999998e-05 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.065831+0000", 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002139873 2024-04-26T12:32:36.115 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37006 4.25 4:a76ff001:::100000001f8.0000002b:head [write 2940928~4096 in=4096b,write 2998272~4096 in=4096b,write 3035136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.063965+0000", 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00172875, 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0026621510000000002, 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37006 2024-04-26T12:32:36.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063965+0000", 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063965+0000", 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063964+0000", 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063988+0000", 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4425000000000001e-05 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.063999+0000", 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0888e-05 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064007+0000", 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6380000000000004e-06 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064048+0000", 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1471000000000003e-05 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064120+0000", 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1798000000000006e-05 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064238+0000", 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00011767 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066540+0000", 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023022189999999999 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36960 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3686400~4096 in=4096b,write 3698688~4096 in=4096b,write 3723264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.120 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.046493+0000", 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.019200728, 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020188389000000001, 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36960 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046493+0000", 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046493+0000", 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046492+0000", 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046502+0000", 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0308e-05 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046512+0000", 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6160000000000008e-06 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046518+0000", 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3029999999999996e-06 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046567+0000", 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8931999999999998e-05 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046670+0000", 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000102304 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.046842+0000", 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017228799999999999 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.047978+0000", 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001135612 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37007 4.25 4:a76ff001:::100000001f8.0000002b:head [write 299008~4096 in=4096b,write 368640~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.064289+0000", 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0014047440000000001, 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0024501639999999999, 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.125 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37007 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064289+0000", 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064289+0000", 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064288+0000", 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064315+0000", 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6656e-05 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064321+0000", 2024-04-26T12:32:36.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6819999999999997e-06 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.064326+0000", 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9180000000000002e-06 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.065393+0000", 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0010669900000000001 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.065447+0000", 2024-04-26T12:32:36.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4160000000000003e-05 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.065526+0000", 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8594e-05 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36963 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2605056~4096 in=4096b,write 2621440~4096 in=4096b,write 2650112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.047727+0000", 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.017966739999999998, 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019063877, 2024-04-26T12:32:36.129 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36963 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.047727+0000", 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.047727+0000", 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.047726+0000", 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.047736+0000", 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.414e-06 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.047744+0000", 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5050000000000007e-06 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.047749+0000", 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3449999999999996e-06 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.047788+0000", 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8689999999999997e-05 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.047871+0000", 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2343999999999996e-05 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.048029+0000", 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000158579 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.050323+0000", 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0022937270000000002 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37012 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 2846720~4096 in=4096b,write 2912256~4096 in=4096b,write 2985984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.066148+0000", 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4294967295.9995456, 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00069565600000000001, 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37012 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.134 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066148+0000", 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066148+0000", 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066147+0000", 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066157+0000", 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066166+0000", 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4319999999999999e-06 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066171+0000", 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1970000000000004e-06 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066217+0000", 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6205000000000002e-05 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066272+0000", 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4264000000000001e-05 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066369+0000", 2024-04-26T12:32:36.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7783999999999998e-05 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36966 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 1708032~8192 in=8192b,write 1904640~4096 in=4096b,write 2039808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.049032+0000", 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.016661809999999999, 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017890026, 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.138 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36966 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.049032+0000", 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.049032+0000", 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.049031+0000", 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.049048+0000", 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7218999999999999e-05 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.049059+0000", 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0912e-05 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.049066+0000", 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0280000000000003e-06 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.049094+0000", 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8348e-05 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.049149+0000", 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4783e-05 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.049237+0000", 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7900999999999997e-05 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.053237+0000", 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0039994460000000003 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36924 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 229376~4096 in=4096b,write 675840~4096 in=4096b,write 724992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.142 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.031718+0000", 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.033975782000000003, 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.035272128999999999, 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36924 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.031718+0000", 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.031718+0000", 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.031717+0000", 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.031735+0000", 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8501000000000001e-05 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.031744+0000", 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0450000000000006e-06 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.031751+0000", 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8560000000000001e-06 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.032382+0000", 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00063052400000000004 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.032462+0000", 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9950999999999994e-05 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.032620+0000", 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000157773 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.036649+0000", 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040297680000000004 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37013 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2703360~4096 in=4096b,write 2723840~4096 in=4096b,write 2801664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.066576+0000", 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4294967295.9991174, 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000466238, 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37013 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066576+0000", 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066576+0000", 2024-04-26T12:32:36.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066576+0000", 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066584+0000", 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2840000000000006e-06 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066591+0000", 2024-04-26T12:32:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066596+0000", 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5739999999999997e-06 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066635+0000", 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9439e-05 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066717+0000", 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1859000000000003e-05 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.066882+0000", 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000164303 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36894 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 770048~4096 in=4096b,write 839680~4096 in=4096b,write 847872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.020636+0000", 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.045057347999999997, 2024-04-26T12:32:36.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.046454611999999999, 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36894 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.020636+0000", 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.020636+0000", 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.020636+0000", 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.020648+0000", 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2598e-05 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.020658+0000", 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8360000000000004e-06 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.020663+0000", 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1250000000000001e-06 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.020699+0000", 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5596999999999998e-05 2024-04-26T12:32:36.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.020745+0000", 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6255999999999999e-05 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.020830+0000", 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5062000000000007e-05 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022790+0000", 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001960369 2024-04-26T12:32:36.155 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36979 4.a 4:50194ce5:::100000001f8.00000027:head [write 2015232~4096 in=4096b,write 2211840~4096 in=4096b,write 2228224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.054412+0000", 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.011281928, 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01272655, 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36979 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.156 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.054412+0000", 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.054412+0000", 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.054411+0000", 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.054433+0000", 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2036e-05 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.054442+0000", 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9779999999999994e-06 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.054448+0000", 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5769999999999999e-06 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.054480+0000", 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2017000000000002e-05 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.054539+0000", 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.897e-05 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.054648+0000", 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000108397 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.056745+0000", 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0020971169999999999 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36938 4.a 4:50194ce5:::100000001f8.00000027:head [write 2240512~4096 in=4096b,write 2617344~4096 in=4096b,write 2646016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.037302+0000", 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.028391842, 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.029920670999999999, 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.160 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36938 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037302+0000", 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037302+0000", 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037301+0000", 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037313+0000", 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2115e-05 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037322+0000", 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1759999999999999e-06 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037328+0000", 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6300000000000003e-06 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037356+0000", 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8031999999999999e-05 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037409+0000", 2024-04-26T12:32:36.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3081999999999998e-05 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037495+0000", 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6174000000000005e-05 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.039891+0000", 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023959839999999999 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36898 4.2c 4:36128e15:::100000001f8.00000008:head [write 307200~4096 in=4096b,write 364544~4096 in=4096b,write 466944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.022187+0000", 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.04350615, 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045087108000000001, 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36898 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022187+0000", 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022187+0000", 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022187+0000", 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022201+0000", 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4032000000000001e-05 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022210+0000", 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5019999999999998e-06 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022217+0000", 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.985e-06 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022261+0000", 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3912000000000002e-05 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022343+0000", 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1992999999999999e-05 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.022491+0000", 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014778099999999999 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.024173+0000", 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001682577 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36940 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1265664~4096 in=4096b,write 1515520~4096 in=4096b,write 1744896~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.037972+0000", 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.027721742000000001, 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.029387680999999999, 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.169 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36940 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037972+0000", 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037972+0000", 2024-04-26T12:32:36.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037971+0000", 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037986+0000", 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4242e-05 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037992+0000", 2024-04-26T12:32:36.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8980000000000001e-06 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.037996+0000", 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7090000000000001e-06 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.038026+0000", 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0111e-05 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.038074+0000", 2024-04-26T12:32:36.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7744999999999998e-05 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.038164+0000", 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9938999999999994e-05 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.042153+0000", 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003989121 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36902 4.a 4:50194ce5:::100000001f8.00000027:head [write 2953216~4096 in=4096b,write 2961408~4096 in=4096b,write 3117056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.023756+0000", 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.041937679999999998, 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.043704465999999997, 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36902 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.023756+0000", 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.023756+0000", 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.023755+0000", 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.023767+0000", 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1440999999999999e-05 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.023773+0000", 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7750000000000004e-06 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.023777+0000", 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6739999999999999e-06 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.023825+0000", 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8074000000000001e-05 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.023874+0000", 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9072e-05 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.023966+0000", 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.2127999999999996e-05 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.026843+0000", 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028769910000000002 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36992 4.2c 4:36128e15:::100000001f8.00000008:head [write 3960832~4096 in=4096b,write 3981312~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.058922+0000", 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0067711400000000001, 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0086301889999999999, 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.178 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36992 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.058922+0000", 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.058922+0000", 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.058922+0000", 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.058946+0000", 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3816999999999999e-05 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.058960+0000", 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4048e-05 2024-04-26T12:32:36.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.058965+0000", 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2460000000000003e-06 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.058995+0000", 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9598999999999999e-05 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.059049+0000", 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4549999999999998e-05 2024-04-26T12:32:36.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.059143+0000", 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3836000000000001e-05 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.062654+0000", 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003511447 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:36.182 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 25 2024-04-26T12:32:36.183 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:36.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:36.184 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:36.184+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:36.185 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:36.285 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:36.285+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:36.345 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:36.345 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:36.345 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:36.345 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:36.346 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:36.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:36.400 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:36.399+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:36.486 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:36.486+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:36.498 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:36.498 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:36.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:36.498 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:36.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.498 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14175 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1835008~4096,write 1945600~4096,write 2031616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.498 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 11.203923925, 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.98270771099999998, 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14175 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:36.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292065+0000", 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292076+0000", 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1482e-05 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292089+0000", 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2865e-05 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292097+0000", 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6290000000000001e-06 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292141+0000", 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4759000000000003e-05 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292152+0000", 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0906e-05 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264779+0000", 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.97262671899999997 2024-04-26T12:32:36.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264860+0000", 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0871999999999994e-05 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.264964+0000", 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104584 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269185+0000", 2024-04-26T12:32:36.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042204790000000001 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274691+0000", 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0055061140000000003 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274737+0000", 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6428999999999999e-05 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274773+0000", 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5722999999999997e-05 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14176 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3907584~4096,write 4022272~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 11.203644809, 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.98263749300000003, 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.505 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14176 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292345+0000", 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292344+0000", 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292364+0000", 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0412e-05 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292371+0000", 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.477e-06 2024-04-26T12:32:36.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292375+0000", 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8840000000000004e-06 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292408+0000", 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3003999999999998e-05 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.292416+0000", 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0620000000000001e-06 2024-04-26T12:32:36.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266076+0000", 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.97366027499999996 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266132+0000", 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6279000000000001e-05 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266224+0000", 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1463000000000002e-05 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269227+0000", 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0030027220000000002 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274894+0000", 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0056677730000000001 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274944+0000", 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9356e-05 2024-04-26T12:32:36.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274982+0000", 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8343999999999997e-05 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14209 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2813952~4096,write 2973696~4096,write 3047424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 11.188538847, 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.96821334599999997, 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.511 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14209 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307450+0000", 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307465+0000", 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4949e-05 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307479+0000", 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4707e-05 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307490+0000", 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0146000000000001e-05 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307531+0000", 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1677000000000001e-05 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307538+0000", 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7309999999999996e-06 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266634+0000", 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.959096422 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266704+0000", 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9338000000000006e-05 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.266808+0000", 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103847 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269265+0000", 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0024577010000000001 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275617+0000", 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0063514490000000003 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275644+0000", 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7761000000000001e-05 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275664+0000", 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9340000000000001e-05 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14210 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3596288~4096,write 3612672~4096,write 3633152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.517 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 11.188154451999999, 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.96837596400000003, 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14210 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:36.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307835+0000", 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307834+0000", 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307850+0000", 2024-04-26T12:32:36.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5736e-05 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307860+0000", 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6050000000000004e-06 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307867+0000", 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307928+0000", 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0779999999999997e-05 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.307935+0000", 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0400000000000004e-06 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267291+0000", 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.95935644200000003 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267350+0000", 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8502999999999999e-05 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.267438+0000", 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8274000000000002e-05 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269295+0000", 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018571449999999999 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276165+0000", 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0068700970000000004 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276191+0000", 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6043000000000001e-05 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276211+0000", 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9599999999999999e-05 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.523 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14234 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 872448~4096,write 937984~4096,write 1011712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 11.177027982, 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.95729165400000005, 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14234 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318961+0000", 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318973+0000", 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1941e-05 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318981+0000", 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5099999999999998e-06 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.318988+0000", 2024-04-26T12:32:36.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7349999999999999e-06 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.319020+0000", 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2155e-05 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.319027+0000", 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8129999999999998e-06 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268425+0000", 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.949398454 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268508+0000", 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2711000000000001e-05 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.268677+0000", 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000168956 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274681+0000", 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.006004255 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276216+0000", 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015346680000000001 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276237+0000", 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276253+0000", 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5809999999999999e-05 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14298 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1114112~4096,write 1130496~4096,write 1196032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 11.148700283, 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.92900384300000005, 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.530 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14298 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347289+0000", 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347288+0000", 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347301+0000", 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2772000000000001e-05 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347310+0000", 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5909999999999996e-06 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347316+0000", 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5180000000000001e-06 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347350+0000", 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3643000000000003e-05 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.347358+0000", 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6739999999999997e-06 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269323+0000", 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.921965492 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269443+0000", 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000119998 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.269600+0000", 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015721600000000001 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.274812+0000", 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.005211551 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276257+0000", 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014454190000000001 2024-04-26T12:32:36.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276278+0000", 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0403000000000001e-05 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276293+0000", 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5235999999999999e-05 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.536 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14357 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 319488~4096,write 528384~4096,write 536576~4096,write 552960~4096,write 704512~4096,write 741376~4096,write 1064960~4096,write 1359872~4096,write 1409024~4096,write 1536000~4096,write 1581056~4096,write 1650688~4096,write 1658880~4096,write 1781760~4096,write 1822720~4096,write 2183168~4096,write 2191360~4096,write 2306048~4096,write 2433024~4096,write 2633728~4096,write 2650112~4096,write 2662400~4096,write 2797568~4096,write 3153920~4096,write 3182592~4096,write 3194880~4096,write 3420160~4096,write 3469312~4096,write 3584000~4096,write 3670016~4096,write 3829760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 11.126448346, 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.91281808399999997, 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14357 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369541+0000", 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369640+0000", 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9499000000000004e-05 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369645+0000", 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.51e-06 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.369648+0000", 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4879999999999999e-06 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.371151+0000", 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001503332 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.371162+0000", 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0934999999999999e-05 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270133+0000", 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.89897075599999998 2024-04-26T12:32:36.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270195+0000", 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2224000000000006e-05 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.270513+0000", 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00031765100000000001 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275008+0000", 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0044954000000000001 2024-04-26T12:32:36.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282289+0000", 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0072804460000000003 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282335+0000", 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6337e-05 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282359+0000", 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3918999999999999e-05 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14616 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 24576~4096,write 32768~4096,write 57344~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.977954383, 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.76447159499999995, 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.543 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14616 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518035+0000", 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518034+0000", 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518046+0000", 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1545999999999999e-05 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518054+0000", 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0029999999999994e-06 2024-04-26T12:32:36.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518059+0000", 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9470000000000002e-06 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518200+0000", 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014118799999999999 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.518210+0000", 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0275000000000001e-05 2024-04-26T12:32:36.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275044+0000", 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.75683380899999997 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275126+0000", 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1536e-05 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275221+0000", 2024-04-26T12:32:36.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5253000000000004e-05 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282369+0000", 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071480729999999996 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282438+0000", 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9494999999999998e-05 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282472+0000", 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3896999999999997e-05 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282507+0000", 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4245999999999997e-05 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.549 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14664 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 0~4096,write 110592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.95863757, 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.74525697300000004, 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14664 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537352+0000", 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537351+0000", 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537360+0000", 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4080000000000004e-06 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537370+0000", 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4080000000000004e-06 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537375+0000", 2024-04-26T12:32:36.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4600000000000002e-06 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537408+0000", 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2237999999999999e-05 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.537414+0000", 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0619999999999997e-06 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275680+0000", 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.73826678099999998 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275731+0000", 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0281000000000002e-05 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.275814+0000", 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3407999999999998e-05 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282375+0000", 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065614180000000003 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282558+0000", 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00018219699999999999 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282588+0000", 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0051000000000001e-05 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282609+0000", 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1021000000000001e-05 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:14959 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 118784~4096,write 270336~4096,write 540672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.832019781, 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.61876598900000002, 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.556 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 14959 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663970+0000", 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663969+0000", 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663977+0000", 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4230000000000005e-06 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663985+0000", 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.277e-06 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.663989+0000", 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7650000000000001e-06 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.664023+0000", 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3277e-05 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.664030+0000", 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0759999999999997e-06 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276327+0000", 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.61229685599999994 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276405+0000", 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.276583+0000", 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017775700000000001 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282380+0000", 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0057972709999999997 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282654+0000", 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000273095 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282699+0000", 2024-04-26T12:32:36.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5129000000000001e-05 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282736+0000", 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.684e-05 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15290 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2097152~4096,write 2134016~4096,write 2248704~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.692385547000001, 2024-04-26T12:32:36.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.48063225399999998, 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15290 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803604+0000", 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803603+0000", 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803611+0000", 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8990000000000001e-06 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803618+0000", 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0119999999999999e-06 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803623+0000", 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2930000000000002e-06 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803650+0000", 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7858e-05 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.803657+0000", 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1430000000000003e-06 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277533+0000", 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.473876666 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277591+0000", 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7605999999999997e-05 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.277692+0000", 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000100868 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282386+0000", 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046946890000000002 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284181+0000", 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001795079 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284216+0000", 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284236+0000", 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0171000000000001e-05 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.568 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15338 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3837952~4096,write 3850240~4096,write 4026368~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.669626444, 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45796468000000001, 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15338 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826363+0000", 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826362+0000", 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826384+0000", 2024-04-26T12:32:36.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2115000000000001e-05 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826394+0000", 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.2250000000000006e-06 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826399+0000", 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.259e-06 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826438+0000", 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9082999999999998e-05 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.826449+0000", 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0747000000000001e-05 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278509+0000", 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45205991600000001 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278588+0000", 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9072000000000005e-05 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.278725+0000", 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000137207 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282392+0000", 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0036672520000000002 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284276+0000", 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018842780000000001 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284307+0000", 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284328+0000", 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0778e-05 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15354 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1396736~4096,write 1449984~4096,write 1675264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.661853505, 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.45026424700000001, 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15354 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834136+0000", 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834135+0000", 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834147+0000", 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2592000000000001e-05 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834157+0000", 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5550000000000008e-06 2024-04-26T12:32:36.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834170+0000", 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2683999999999999e-05 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834202+0000", 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2668e-05 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.834209+0000", 2024-04-26T12:32:36.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279284+0000", 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.44507556799999998 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279333+0000", 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8560999999999998e-05 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.279427+0000", 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3917000000000002e-05 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282397+0000", 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029705460000000001 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284358+0000", 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0019611770000000001 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284383+0000", 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284400+0000", 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.747e-05 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15416 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 950272~4096,write 1155072~4096,write 1245184~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:36.581 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.632297589, 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.420828757, 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15416 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863692+0000", 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863691+0000", 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863706+0000", 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:32:36.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863716+0000", 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0139000000000001e-05 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863723+0000", 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9290000000000001e-06 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863762+0000", 2024-04-26T12:32:36.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8968999999999999e-05 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.863769+0000", 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1509999999999998e-06 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280011+0000", 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.416241743 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280098+0000", 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7367000000000006e-05 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280249+0000", 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000150168 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282617+0000", 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023680839999999999 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284444+0000", 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018270000000000001 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284488+0000", 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4659000000000001e-05 2024-04-26T12:32:36.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284520+0000", 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2193000000000002e-05 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15421 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3383296~4096,write 3407872~4096,write 3440640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.630020286000001, 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.41862908900000001, 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.588 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15421 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865969+0000", 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865968+0000", 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865986+0000", 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7314000000000001e-05 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.865994+0000", 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2409999999999995e-06 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866000+0000", 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866042+0000", 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2162000000000001e-05 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.866049+0000", 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5270000000000004e-06 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280822+0000", 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.414773799 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.280904+0000", 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2118000000000002e-05 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281077+0000", 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017207600000000001 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282621+0000", 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015443259999999999 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284550+0000", 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001928969 2024-04-26T12:32:36.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284580+0000", 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9835000000000001e-05 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284598+0000", 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8447000000000001e-05 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15449 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 405504~4096,write 671744~4096,write 700416~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.61796784, 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.40665650599999997, 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15449 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878021+0000", 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878038+0000", 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7227999999999998e-05 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878049+0000", 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0869999999999999e-05 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878054+0000", 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2619999999999998e-06 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878085+0000", 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0559000000000003e-05 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.878091+0000", 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9939999999999997e-06 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281693+0000", 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.40360222499999998 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281747+0000", 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4017999999999997e-05 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.281850+0000", 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103348 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284244+0000", 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023942669999999998 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284637+0000", 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000392369 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284660+0000", 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3116e-05 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284678+0000", 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8048999999999999e-05 2024-04-26T12:32:36.600 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15473 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3801088~4096,write 4050944~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.605287374, 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39472404999999999, 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.601 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15473 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890702+0000", 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890701+0000", 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890723+0000", 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1681000000000001e-05 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890731+0000", 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5349999999999999e-06 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890735+0000", 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8520000000000003e-06 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890988+0000", 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00025219499999999998 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.890994+0000", 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8689999999999998e-06 2024-04-26T12:32:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282756+0000", 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39176148700000002 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282818+0000", 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2429999999999997e-05 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.282922+0000", 2024-04-26T12:32:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103094 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284408+0000", 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001486343 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285350+0000", 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00094174299999999999 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285388+0000", 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8306000000000002e-05 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285426+0000", 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8102999999999998e-05 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15483 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2674688~4096,write 3006464~4096,write 3055616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.601109891, 2024-04-26T12:32:36.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.39308472300000002, 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15483 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894879+0000", 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894890+0000", 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1477999999999999e-05 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894902+0000", 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1802e-05 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894909+0000", 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8700000000000003e-06 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894980+0000", 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1518000000000002e-05 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.894991+0000", 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0916e-05 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283304+0000", 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38831311299999999 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283374+0000", 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9589000000000001e-05 2024-04-26T12:32:36.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.283526+0000", 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015212 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285298+0000", 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001772385 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287859+0000", 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0025601439999999999 2024-04-26T12:32:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287919+0000", 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9951000000000002e-05 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287964+0000", 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5608000000000001e-05 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15503 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2396160~4096,write 2449408~4096,write 2605056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.591583129, 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38366402100000002, 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15503 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904406+0000", 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904405+0000", 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904421+0000", 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5413e-05 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904431+0000", 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0244999999999999e-05 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904442+0000", 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0746e-05 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904487+0000", 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4858999999999999e-05 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.904501+0000", 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4498000000000001e-05 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284701+0000", 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.38019989100000001 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284748+0000", 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6668000000000001e-05 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.284839+0000", 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1133999999999999e-05 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.287788+0000", 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029491349999999999 2024-04-26T12:32:36.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288005+0000", 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00021703299999999999 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288033+0000", 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7971e-05 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288070+0000", 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7231000000000003e-05 2024-04-26T12:32:36.619 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:15520 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3747840~4096,write 3772416~4096,write 4149248~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 10.582761484000001, 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.37495473499999998, 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 15520 2024-04-26T12:32:36.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913228+0000", 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:36.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913227+0000", 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913241+0000", 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3995999999999999e-05 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913250+0000", 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913257+0000", 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4649999999999997e-06 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913297+0000", 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9274999999999999e-05 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:25.913303+0000", 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4049999999999997e-06 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285461+0000", 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.37215769999999998 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285508+0000", 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6938999999999999e-05 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.285613+0000", 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00010532899999999999 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288084+0000", 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002471132 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288121+0000", 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6665000000000002e-05 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288148+0000", 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7379e-05 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:36.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:26.288183+0000", 2024-04-26T12:32:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4419999999999999e-05 2024-04-26T12:32:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:36.626 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:36.626 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:36.626 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:32:36.636 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:36.636+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:36.638 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:36.737 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:36.736+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:36.737 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-26T12:32:36.791 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36968 4.6 4.692017c6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119301+0000", 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64941157100000002, 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64943358100000004, 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36968 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119301+0000", 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119301+0000", 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119301+0000", 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119313+0000", 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1938e-05 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119320+0000", 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2180000000000002e-06 2024-04-26T12:32:36.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119346+0000", 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6571999999999999e-05 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123200+0000", 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0038539690000000001 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123205+0000", 2024-04-26T12:32:36.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.011e-06 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4.d91d77a8 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64571752999999998, 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64578988599999998, 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.796 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:32:36.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:32:36.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37138 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124559+0000", 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64415388900000004, 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64426567599999995, 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.800 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37138 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124559+0000", 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124559+0000", 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124558+0000", 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124571+0000", 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2808e-05 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124577+0000", 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2660000000000001e-06 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124582+0000", 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3349999999999997e-06 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124602+0000", 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9984e-05 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124605+0000", 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1839999999999999e-06 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.803 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37177 4.28 4.8275ca8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.139204+0000", 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62950832000000001, 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62965823899999995, 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37177 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.804 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139204+0000", 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139204+0000", 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139204+0000", 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139212+0000", 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6899999999999992e-06 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139218+0000", 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0759999999999999e-06 2024-04-26T12:32:36.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139221+0000", 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139262+0000", 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1174999999999998e-05 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139267+0000", 2024-04-26T12:32:36.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4669999999999998e-06 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37219 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.155912+0000", 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61280026799999998, 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.61298904300000001, 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.808 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37219 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155912+0000", 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155912+0000", 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155912+0000", 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155950+0000", 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8451999999999997e-05 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155961+0000", 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.119e-05 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155967+0000", 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7599999999999999e-06 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155997+0000", 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0176999999999999e-05 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.156003+0000", 2024-04-26T12:32:36.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37456 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.253957+0000", 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51475539999999997, 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51498176200000001, 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.812 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37456 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253957+0000", 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253957+0000", 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253957+0000", 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253973+0000", 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6096e-05 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253983+0000", 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9790000000000005e-06 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253991+0000", 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5399999999999996e-06 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.254026+0000", 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4771000000000003e-05 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.254031+0000", 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3319999999999999e-06 2024-04-26T12:32:36.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37487 4.14 4.faeb14d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.265607+0000", 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50310574200000002, 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50337005300000004, 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.816 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37487 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.265607+0000", 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.265607+0000", 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.265606+0000", 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.265645+0000", 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8688e-05 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.265655+0000", 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5570000000000001e-06 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.265662+0000", 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2620000000000001e-06 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.265719+0000", 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6663000000000003e-05 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.265728+0000", 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9730000000000003e-06 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37530 4.12 4.c58a7d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.281444+0000", 2024-04-26T12:32:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.48726898200000002, 2024-04-26T12:32:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.48757192300000002, 2024-04-26T12:32:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.820 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37530 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.281444+0000", 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.281444+0000", 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.281443+0000", 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.281459+0000", 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6215e-05 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.281466+0000", 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2599999999999999e-06 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.281470+0000", 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1479999999999999e-06 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.281495+0000", 2024-04-26T12:32:36.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4127000000000001e-05 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.281500+0000", 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.361e-06 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37043 4.37 4.4df0fd37 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123057+0000", 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64565543000000003, 2024-04-26T12:32:36.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64599606499999995, 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37043 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123057+0000", 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123057+0000", 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123057+0000", 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123073+0000", 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6107999999999999e-05 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123083+0000", 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.027e-05 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123091+0000", 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4610000000000002e-06 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123134+0000", 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3120000000000001e-05 2024-04-26T12:32:36.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123142+0000", 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8509999999999999e-06 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37179 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.139946+0000", 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62876649299999998, 2024-04-26T12:32:36.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62914412600000003, 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37179 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139946+0000", 2024-04-26T12:32:36.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139946+0000", 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139946+0000", 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139955+0000", 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0289999999999994e-06 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139965+0000", 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0667e-05 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.139971+0000", 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5979999999999996e-06 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140030+0000", 2024-04-26T12:32:36.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8891000000000002e-05 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140041+0000", 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1567e-05 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37221 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.156610+0000", 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.612102759, 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.61251823100000002, 2024-04-26T12:32:36.832 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37221 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.156610+0000", 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.156610+0000", 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.156609+0000", 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.156623+0000", 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4147e-05 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.156635+0000", 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.137e-05 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.156640+0000", 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.156674+0000", 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4150000000000003e-05 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.156680+0000", 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4399999999999996e-06 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.836 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37302 4.1c 4.f7421d9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.190922+0000", 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.57779064000000002, 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57824338500000005, 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37302 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.190922+0000", 2024-04-26T12:32:36.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.190922+0000", 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.190921+0000", 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.190938+0000", 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6390000000000001e-05 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.190950+0000", 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2604e-05 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.190959+0000", 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3680000000000002e-06 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.190992+0000", 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3247000000000002e-05 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.190998+0000", 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3330000000000002e-06 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37489 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.266527+0000", 2024-04-26T12:32:36.840 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50218560999999995, 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50267548699999998, 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37489 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.266527+0000", 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.266527+0000", 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.266526+0000", 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.266545+0000", 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8425999999999999e-05 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.266555+0000", 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6940000000000007e-06 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.266560+0000", 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2689999999999999e-06 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.266590+0000", 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0247999999999999e-05 2024-04-26T12:32:36.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.266596+0000", 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4820000000000002e-06 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37139 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.125013+0000", 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64369941799999997, 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64423297000000002, 2024-04-26T12:32:36.844 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37139 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125013+0000", 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125013+0000", 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125013+0000", 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125036+0000", 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2861999999999999e-05 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125041+0000", 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7679999999999997e-06 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125045+0000", 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9589999999999997e-06 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125078+0000", 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2332999999999997e-05 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125086+0000", 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1899999999999995e-06 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.848 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37303 4.2d 4.9760552d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.191385+0000", 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.57732750600000005, 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.577903795, 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37303 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.191385+0000", 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.191385+0000", 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.191385+0000", 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.191407+0000", 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2463000000000002e-05 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.191418+0000", 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0856000000000001e-05 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.191436+0000", 2024-04-26T12:32:36.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.766e-05 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.191475+0000", 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9338999999999997e-05 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.191483+0000", 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9570000000000002e-06 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37336 4.19 4.948ede99 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.206979+0000", 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.56173414700000002, 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.56234783499999996, 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37336 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.853 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.206979+0000", 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.206979+0000", 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.206978+0000", 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207034+0000", 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6385000000000003e-05 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207043+0000", 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2639999999999997e-06 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207051+0000", 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7300000000000005e-06 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207082+0000", 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1109999999999999e-05 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207088+0000", 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7660000000000004e-06 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.856 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37377 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.224717+0000", 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.54399571300000005, 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54464799100000005, 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37377 2024-04-26T12:32:36.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.224717+0000", 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.224717+0000", 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.224716+0000", 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.224729+0000", 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2791e-05 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.224739+0000", 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0096e-05 2024-04-26T12:32:36.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.224744+0000", 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.13e-06 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.224778+0000", 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3571000000000001e-05 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.224783+0000", 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2619999999999998e-06 2024-04-26T12:32:36.860 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37415 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.238930+0000", 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52978256899999998, 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.53047196299999999, 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.861 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37415 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.238930+0000", 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.238930+0000", 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.238930+0000", 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.238940+0000", 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0164e-05 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.238948+0000", 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8630000000000008e-06 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.238953+0000", 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2440000000000001e-06 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.238991+0000", 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8198999999999998e-05 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239000+0000", 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0319999999999992e-06 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37491 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.267317+0000", 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50139604800000004, 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50212283499999999, 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.865 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37491 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267317+0000", 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267317+0000", 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267316+0000", 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267337+0000", 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1625e-05 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267349+0000", 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1336e-05 2024-04-26T12:32:36.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267355+0000", 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7939999999999999e-06 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267392+0000", 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7648000000000003e-05 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267398+0000", 2024-04-26T12:32:36.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.49e-06 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37532 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.282118+0000", 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.48659426099999997, 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.48735787899999999, 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.869 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37532 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.282118+0000", 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.282118+0000", 2024-04-26T12:32:36.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.282118+0000", 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.282137+0000", 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9204000000000001e-05 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.282146+0000", 2024-04-26T12:32:36.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5880000000000004e-06 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.282152+0000", 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4820000000000002e-06 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.282183+0000", 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0917000000000002e-05 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.282189+0000", 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6089999999999997e-06 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36971 4.f 4.4dc19b0f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119352+0000", 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64936072099999997, 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.650161981, 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.873 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36971 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119352+0000", 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119352+0000", 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119352+0000", 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119367+0000", 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5577e-05 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120039+0000", 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00067193699999999995 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120048+0000", 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8130000000000002e-06 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122047+0000", 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019990749999999999 2024-04-26T12:32:36.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122053+0000", 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.631e-06 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37047 4.2f 4.da61f9af (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123097+0000", 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64561597900000001, 2024-04-26T12:32:36.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64647051899999997, 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37047 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123097+0000", 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123097+0000", 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123111+0000", 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4412e-05 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123118+0000", 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7330000000000003e-06 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123124+0000", 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6840000000000001e-06 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123168+0000", 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3628000000000003e-05 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123174+0000", 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3600000000000001e-06 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37140 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.125238+0000", 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64347460999999995, 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64436369599999999, 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37140 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125238+0000", 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125238+0000", 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125238+0000", 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.883 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125253+0000", 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5311999999999998e-05 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125258+0000", 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6399999999999996e-06 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125263+0000", 2024-04-26T12:32:36.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0470000000000001e-06 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125296+0000", 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2804e-05 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.125301+0000", 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9060000000000001e-06 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37180 4.3b 4.fa83033b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.140254+0000", 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62845903400000003, 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62938311999999996, 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37180 2024-04-26T12:32:36.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140254+0000", 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140254+0000", 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140253+0000", 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140274+0000", 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1047999999999999e-05 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140282+0000", 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8529999999999992e-06 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140286+0000", 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5519999999999998e-06 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140317+0000", 2024-04-26T12:32:36.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0981e-05 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.140324+0000", 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1879999999999999e-06 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37224 4.28 4.8275ca8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.157478+0000", 2024-04-26T12:32:36.890 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61123449299999999, 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.61219331300000002, 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37224 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157478+0000", 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157478+0000", 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157477+0000", 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157487+0000", 2024-04-26T12:32:36.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7569999999999999e-06 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157499+0000", 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2069000000000001e-05 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157505+0000", 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8769999999999998e-06 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157546+0000", 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1081000000000002e-05 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157553+0000", 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4609999999999996e-06 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37263 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.172834+0000", 2024-04-26T12:32:36.894 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.59587852799999996, 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59687237199999998, 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37263 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.172834+0000", 2024-04-26T12:32:36.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.172834+0000", 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.172833+0000", 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.172845+0000", 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1450999999999999e-05 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.172853+0000", 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2300000000000008e-06 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.172858+0000", 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9629999999999997e-06 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.172913+0000", 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5000000000000002e-05 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.172918+0000", 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9599999999999999e-06 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37337 4.19 4.df98c259 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.898 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.207361+0000", 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.56135195299999996, 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.56238034800000003, 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37337 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207361+0000", 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207361+0000", 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207360+0000", 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207373+0000", 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.331e-05 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207388+0000", 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4528999999999999e-05 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207396+0000", 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0919999999999998e-06 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207423+0000", 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6778e-05 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.207427+0000", 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3649999999999997e-06 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37379 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.902 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.225364+0000", 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.54334856300000001, 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54441167599999996, 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37379 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.225364+0000", 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.225364+0000", 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.225364+0000", 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.225375+0000", 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1473e-05 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.225383+0000", 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.225e-06 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.225387+0000", 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.861e-06 2024-04-26T12:32:36.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.225415+0000", 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7509999999999999e-05 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.225420+0000", 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2650000000000004e-06 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37416 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.239235+0000", 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52947770000000005, 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.53058165499999999, 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37416 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.907 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239235+0000", 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239235+0000", 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239235+0000", 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239254+0000", 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9338e-05 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239261+0000", 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6900000000000003e-06 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239265+0000", 2024-04-26T12:32:36.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239291+0000", 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6446999999999999e-05 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239296+0000", 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1089999999999997e-06 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.910 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37459 4.14 4.faeb14d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.254995+0000", 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51371746299999999, 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51485779700000001, 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37459 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.911 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.254995+0000", 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.254995+0000", 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.254994+0000", 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.255016+0000", 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1477000000000001e-05 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.255027+0000", 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0963e-05 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.255034+0000", 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:32:36.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.255068+0000", 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3834999999999997e-05 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.255073+0000", 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2789999999999998e-06 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37492 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.267607+0000", 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50110611900000002, 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50228138300000003, 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37492 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267607+0000", 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267607+0000", 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267606+0000", 2024-04-26T12:32:36.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267623+0000", 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7422e-05 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267631+0000", 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.481e-06 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267635+0000", 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1169999999999997e-06 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267659+0000", 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3875000000000001e-05 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.267664+0000", 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6149999999999999e-06 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.918 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36975 4.19 4.df98c259 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.120056+0000", 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64865633199999995, 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64986657000000003, 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36975 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120056+0000", 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120056+0000", 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120056+0000", 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120074+0000", 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8354000000000001e-05 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120083+0000", 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0459999999999994e-06 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120089+0000", 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120409+0000", 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032060900000000002 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120417+0000", 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7379999999999994e-06 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.922 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4.df98c259 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64558278300000005, 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64682827200000004, 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:32:36.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:32:36.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37183 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.141520+0000", 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62719270199999999, 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62847266999999996, 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37183 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141520+0000", 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141520+0000", 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141519+0000", 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141530+0000", 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.06e-05 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141540+0000", 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0285000000000001e-05 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141546+0000", 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6200000000000004e-06 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141572+0000", 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6373999999999999e-05 2024-04-26T12:32:36.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141578+0000", 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7520000000000002e-06 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37225 4.12 4.c58a7d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.157798+0000", 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61091511099999996, 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.61222962199999997, 2024-04-26T12:32:36.930 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37225 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157798+0000", 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157798+0000", 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157797+0000", 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157813+0000", 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5772000000000001e-05 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157819+0000", 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2779999999999999e-06 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157823+0000", 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8419999999999998e-06 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157863+0000", 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0036000000000001e-05 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.157872+0000", 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5129999999999996e-06 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37265 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.173684+0000", 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.595028581, 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.596377932, 2024-04-26T12:32:36.934 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37265 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.173684+0000", 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.173684+0000", 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.173683+0000", 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.173694+0000", 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0641e-05 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.173703+0000", 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6680000000000007e-06 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.173708+0000", 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.814e-06 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.173732+0000", 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3896e-05 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.173736+0000", 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1019999999999999e-06 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37306 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.192671+0000", 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.57604157899999997, 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57742581800000004, 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.938 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37306 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.192671+0000", 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.192671+0000", 2024-04-26T12:32:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.192670+0000", 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.192684+0000", 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3657e-05 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.192695+0000", 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1292e-05 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.192704+0000", 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7669999999999992e-06 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.192738+0000", 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3692000000000002e-05 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.192742+0000", 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.882e-06 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37417 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.239608+0000", 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52910493999999997, 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.53052396599999996, 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.942 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37417 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239608+0000", 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239608+0000", 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239607+0000", 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239616+0000", 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3799999999999994e-06 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239623+0000", 2024-04-26T12:32:36.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2790000000000001e-06 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239627+0000", 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4089999999999996e-06 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239660+0000", 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2780000000000001e-05 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.239667+0000", 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4529999999999996e-06 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36887 4.6 4.8232b686 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118341+0000", 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65037170499999997, 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65182628499999995, 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.946 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36887 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118341+0000", 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118341+0000", 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118340+0000", 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118352+0000", 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2081e-05 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118361+0000", 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0869999999999996e-06 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118369+0000", 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2910000000000007e-06 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121640+0000", 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0032705690000000001 2024-04-26T12:32:36.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121648+0000", 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.276e-06 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36976 4.37 4.4df0fd37 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.120100+0000", 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64861233600000001, 2024-04-26T12:32:36.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.650102446, 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36976 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120100+0000", 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120100+0000", 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120100+0000", 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120114+0000", 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3864e-05 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120121+0000", 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3499999999999999e-06 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120127+0000", 2024-04-26T12:32:36.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6960000000000002e-06 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122073+0000", 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001946286 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122080+0000", 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.686e-06 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.954 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37052 4.3b 4.fa83033b (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64538572500000002, 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64691050299999997, 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37052 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.955 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123326+0000", 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123342+0000", 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5586e-05 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123351+0000", 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9900000000000003e-06 2024-04-26T12:32:36.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123357+0000", 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9780000000000002e-06 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123384+0000", 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7297999999999999e-05 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123390+0000", 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.49e-06 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4.948ede99 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64270739399999999, 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64428984199999995, 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.959 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:36.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37184 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.141913+0000", 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62680011599999996, 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62841889900000003, 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.963 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37184 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141913+0000", 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141913+0000", 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141912+0000", 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141921+0000", 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8149999999999995e-06 2024-04-26T12:32:36.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141928+0000", 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5749999999999997e-06 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141931+0000", 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5269999999999999e-06 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141966+0000", 2024-04-26T12:32:36.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4697999999999999e-05 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.141969+0000", 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6169999999999998e-06 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37227 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.967 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.158759+0000", 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60995340399999998, 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.61160871999999999, 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37227 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.158759+0000", 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.158759+0000", 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.158758+0000", 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.158769+0000", 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0829000000000001e-05 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.158780+0000", 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0947999999999999e-05 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.158803+0000", 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2459e-05 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.158842+0000", 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9609e-05 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.158850+0000", 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0260000000000007e-06 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37307 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.193448+0000", 2024-04-26T12:32:36.971 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.575265201, 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57695691299999996, 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37307 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.193448+0000", 2024-04-26T12:32:36.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.193448+0000", 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.193447+0000", 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.193465+0000", 2024-04-26T12:32:36.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8751999999999999e-05 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.193476+0000", 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0993e-05 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.193483+0000", 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7939999999999997e-06 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.193523+0000", 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0172000000000001e-05 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.193533+0000", 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3610000000000007e-06 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36891 4.28 4.d91d77a8 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118381+0000", 2024-04-26T12:32:36.975 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65033153700000002, 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65206000600000003, 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36891 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118381+0000", 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118381+0000", 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118378+0000", 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999967 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118396+0000", 2024-04-26T12:32:36.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8227999999999999e-05 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118404+0000", 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4410000000000004e-06 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118410+0000", 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2550000000000003e-06 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118648+0000", 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000237765 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118656+0000", 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2390000000000002e-06 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.979 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36980 4.f 4.7fb0154f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.120133+0000", 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64857981499999995, 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65034524900000001, 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36980 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120133+0000", 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120133+0000", 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120132+0000", 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120145+0000", 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2808e-05 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120152+0000", 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.120157+0000", 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3349999999999997e-06 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122100+0000", 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001943141 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122107+0000", 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2009999999999996e-06 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37058 4.36 4.670445b6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123365+0000", 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64534723699999996, 2024-04-26T12:32:36.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64714903499999998, 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37058 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123365+0000", 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123365+0000", 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123365+0000", 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123376+0000", 2024-04-26T12:32:36.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1399e-05 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123382+0000", 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8780000000000003e-06 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123387+0000", 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4920000000000004e-06 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123426+0000", 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9128999999999998e-05 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123434+0000", 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37144 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126670+0000", 2024-04-26T12:32:36.987 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64204271099999999, 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64389737700000005, 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37144 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126670+0000", 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126670+0000", 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126669+0000", 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126684+0000", 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4936000000000001e-05 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126694+0000", 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6709999999999994e-06 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126699+0000", 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5110000000000003e-06 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126724+0000", 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5057000000000001e-05 2024-04-26T12:32:36.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126729+0000", 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2150000000000003e-06 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37185 4.1c 4.f7421d9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.142263+0000", 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62644996100000006, 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62833935200000002, 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.991 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37185 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142263+0000", 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142263+0000", 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142262+0000", 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142273+0000", 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1163e-05 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142280+0000", 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142284+0000", 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.551e-06 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142322+0000", 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8656999999999999e-05 2024-04-26T12:32:36.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142331+0000", 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7690000000000002e-06 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37309 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.194479+0000", 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.57423401900000004, 2024-04-26T12:32:36.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57615808099999999, 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37309 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.194479+0000", 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.194479+0000", 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.194478+0000", 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.194507+0000", 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8541e-05 2024-04-26T12:32:36.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.194513+0000", 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1680000000000001e-06 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.194517+0000", 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7840000000000001e-06 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.194546+0000", 2024-04-26T12:32:36.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9833e-05 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.194551+0000", 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5009999999999998e-06 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37343 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.209921+0000", 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55879217199999998, 2024-04-26T12:32:36.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.56075114400000003, 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37343 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.209921+0000", 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.209921+0000", 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.209920+0000", 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.209931+0000", 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1635e-05 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.209943+0000", 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1317e-05 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.209948+0000", 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5369999999999997e-06 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.209997+0000", 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8736999999999998e-05 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.210002+0000", 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3530000000000002e-06 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37384 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.227148+0000", 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.54156437499999999, 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54355810599999999, 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.003 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37384 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.227148+0000", 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.227148+0000", 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.227148+0000", 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.227161+0000", 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3526999999999999e-05 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.227168+0000", 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2140000000000001e-06 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.227172+0000", 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4610000000000001e-06 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.227214+0000", 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2011999999999997e-05 2024-04-26T12:32:37.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.227222+0000", 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37421 4.33 4.365eb6f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.241069+0000", 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52764334700000004, 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52967197399999999, 2024-04-26T12:32:37.007 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37421 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241069+0000", 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241069+0000", 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241069+0000", 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241079+0000", 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0913999999999999e-05 2024-04-26T12:32:37.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241092+0000", 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2315e-05 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241098+0000", 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3430000000000001e-06 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241130+0000", 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2317000000000002e-05 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241136+0000", 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2290000000000002e-06 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37462 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.256161+0000", 2024-04-26T12:32:37.011 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51255143299999995, 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51461455, 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37462 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256161+0000", 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256161+0000", 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256160+0000", 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256189+0000", 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8291999999999999e-05 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256200+0000", 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.165e-05 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256208+0000", 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7800000000000001e-06 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256258+0000", 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9625e-05 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256267+0000", 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5440000000000004e-06 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37496 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.015 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.269269+0000", 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.49944365299999999, 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50154156800000005, 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37496 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.269269+0000", 2024-04-26T12:32:37.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.269269+0000", 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.269268+0000", 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.269287+0000", 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8708000000000001e-05 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.269298+0000", 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1381e-05 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.269304+0000", 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.682e-06 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.269343+0000", 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9062e-05 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.269349+0000", 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36893 4.2e 4.6cf07dae (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118422+0000", 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65029029599999999, 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65242297500000002, 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36893 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118422+0000", 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118422+0000", 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118422+0000", 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118437+0000", 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5427e-05 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118444+0000", 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9419999999999998e-06 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118450+0000", 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6550000000000001e-06 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122879+0000", 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044293459999999998 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122886+0000", 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8700000000000003e-06 2024-04-26T12:32:37.023 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36982 4.23 4.46209f63 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121011+0000", 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64770128800000004, 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64988766200000003, 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36982 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121011+0000", 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121011+0000", 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121011+0000", 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121027+0000", 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5897999999999999e-05 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121329+0000", 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00030194800000000002 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121337+0000", 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6619999999999994e-06 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121686+0000", 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034839099999999998 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121690+0000", 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0579999999999999e-06 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37059 4.36 4.8d2c3936 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123392+0000", 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64532035300000001, 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64754240100000005, 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37059 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123392+0000", 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123392+0000", 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123392+0000", 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123403+0000", 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0560000000000001e-05 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123409+0000", 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123414+0000", 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1580000000000004e-06 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123448+0000", 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4400000000000003e-05 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123454+0000", 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37186 4.14 4.faeb14d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.142638+0000", 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.626074248, 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62833115100000003, 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.032 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37186 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142638+0000", 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142638+0000", 2024-04-26T12:32:37.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142638+0000", 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142646+0000", 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.571e-06 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142652+0000", 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.908e-06 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142655+0000", 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2329999999999998e-06 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142692+0000", 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7630999999999999e-05 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.142697+0000", 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3810000000000001e-06 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37230 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.159935+0000", 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60877799700000002, 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.61106992299999996, 2024-04-26T12:32:37.036 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37230 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.159935+0000", 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.159935+0000", 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.159934+0000", 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.159944+0000", 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0275000000000001e-05 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.159962+0000", 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8182e-05 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.159969+0000", 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9809999999999997e-06 2024-04-26T12:32:37.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.160004+0000", 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4665000000000001e-05 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.160012+0000", 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0760000000000003e-06 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.040 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37269 4.28 4.d91d77a8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.175463+0000", 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.59324935599999995, 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59557593499999995, 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37269 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.175463+0000", 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.175463+0000", 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.175463+0000", 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.175491+0000", 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8572e-05 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.175501+0000", 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0149999999999999e-05 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.175507+0000", 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9920000000000004e-06 2024-04-26T12:32:37.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.175539+0000", 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1693999999999998e-05 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.175544+0000", 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2320000000000001e-06 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37344 4.1c 4.f7421d9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.210136+0000", 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55857670100000001, 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.56093778699999997, 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37344 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.210136+0000", 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.210136+0000", 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.210135+0000", 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.210145+0000", 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.217e-06 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.210153+0000", 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3420000000000008e-06 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.210157+0000", 2024-04-26T12:32:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0520000000000003e-06 2024-04-26T12:32:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.210180+0000", 2024-04-26T12:32:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3346e-05 2024-04-26T12:32:37.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.210185+0000", 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2189999999999998e-06 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37422 4.28 4.8275ca8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.241358+0000", 2024-04-26T12:32:37.050 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52735450299999997, 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52975045700000001, 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37422 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241358+0000", 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241358+0000", 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241358+0000", 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241384+0000", 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6145000000000001e-05 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241392+0000", 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8550000000000002e-06 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241396+0000", 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1459999999999998e-06 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241428+0000", 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1922999999999999e-05 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.241434+0000", 2024-04-26T12:32:37.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5180000000000001e-06 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37463 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.256486+0000", 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51222678799999999, 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51465768499999998, 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.055 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37463 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256486+0000", 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256486+0000", 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256485+0000", 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256518+0000", 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2490000000000002e-05 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256526+0000", 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5949999999999999e-06 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256534+0000", 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1960000000000002e-06 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256583+0000", 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8872000000000002e-05 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.256596+0000", 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3297e-05 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36899 4.3f 4.a34187bf (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118455+0000", 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65025775299999999, 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65272385600000005, 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.059 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36899 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118455+0000", 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118455+0000", 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118455+0000", 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118471+0000", 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.641e-05 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118479+0000", 2024-04-26T12:32:37.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7190000000000001e-06 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118488+0000", 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0399999999999998e-06 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121888+0000", 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033999780000000001 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121896+0000", 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8890000000000002e-06 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36984 4.19 4.df98c259 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121351+0000", 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64736168500000002, 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64986271900000003, 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.063 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36984 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121351+0000", 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121351+0000", 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121350+0000", 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121366+0000", 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5073e-05 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121373+0000", 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8080000000000005e-06 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121379+0000", 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7100000000000004e-06 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121639+0000", 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00026044099999999998 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121647+0000", 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9019999999999999e-06 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.066 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37064 4.f 4.4dc19b0f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123419+0000", 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64529366300000002, 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64785043399999998, 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37064 2024-04-26T12:32:37.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123419+0000", 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123419+0000", 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123419+0000", 2024-04-26T12:32:37.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123430+0000", 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1657e-05 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123437+0000", 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4119999999999998e-06 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123442+0000", 2024-04-26T12:32:37.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3870000000000003e-06 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123469+0000", 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7033999999999999e-05 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123473+0000", 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7440000000000001e-06 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37187 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.143188+0000", 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62552441599999997, 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62812431800000001, 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37187 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.143188+0000", 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.143188+0000", 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.143188+0000", 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.143196+0000", 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9000000000000006e-06 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.143202+0000", 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1029999999999998e-06 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.143206+0000", 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6899999999999998e-06 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.143226+0000", 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0009000000000001e-05 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.143230+0000", 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37271 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.074 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.176181+0000", 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.59253165799999996, 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59516864800000002, 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37271 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.176181+0000", 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.176181+0000", 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.176181+0000", 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.176191+0000", 2024-04-26T12:32:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8879999999999992e-06 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.176198+0000", 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4529999999999996e-06 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.176202+0000", 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8999999999999999e-06 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.176228+0000", 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6196000000000001e-05 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.176233+0000", 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8420000000000004e-06 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37311 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.195347+0000", 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.57336551700000005, 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57603903400000001, 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37311 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.195347+0000", 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.195347+0000", 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.195346+0000", 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.195375+0000", 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8646999999999999e-05 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.195385+0000", 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0274e-05 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.195391+0000", 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9059999999999999e-06 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.195434+0000", 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3158999999999998e-05 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.195444+0000", 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3200000000000006e-06 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37347 4.28 4.d91d77a8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.211498+0000", 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55721475899999995, 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55992465800000002, 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37347 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.211498+0000", 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.211498+0000", 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.211497+0000", 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.211507+0000", 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0159e-05 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.211519+0000", 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1895e-05 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.211525+0000", 2024-04-26T12:32:37.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1349999999999997e-06 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.211557+0000", 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1683999999999997e-05 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.211567+0000", 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0436e-05 2024-04-26T12:32:37.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36909 4.2e 4.6cf07dae (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118494+0000", 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65021911799999998, 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65296577099999997, 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36909 2024-04-26T12:32:37.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118494+0000", 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118494+0000", 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118493+0000", 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118504+0000", 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0777e-05 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118510+0000", 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.387e-06 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118516+0000", 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5269999999999998e-06 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122976+0000", 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004460599 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122983+0000", 2024-04-26T12:32:37.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.652e-06 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36986 4.23 4.46209f63 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121389+0000", 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64732383199999999, 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65010705499999999, 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36986 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121389+0000", 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121389+0000", 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121388+0000", 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121401+0000", 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2418999999999999e-05 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121407+0000", 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5989999999999998e-06 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121414+0000", 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121701+0000", 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028730599999999998 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121707+0000", 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5119999999999999e-06 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4.df98c259 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64526178499999998, 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64808180999999998, 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.095 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:32:37.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:32:37.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37425 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.242408+0000", 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52630456400000003, 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52917661500000002, 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.099 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37425 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242408+0000", 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242408+0000", 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242407+0000", 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242421+0000", 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3141e-05 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242430+0000", 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242438+0000", 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242479+0000", 2024-04-26T12:32:37.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0802e-05 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242487+0000", 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1280000000000008e-06 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36917 4.37 4.4df0fd37 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118520+0000", 2024-04-26T12:32:37.103 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65019241000000005, 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65310110700000001, 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36917 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118520+0000", 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118520+0000", 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118520+0000", 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118532+0000", 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1969e-05 2024-04-26T12:32:37.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118545+0000", 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118550+0000", 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4840000000000003e-06 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121911+0000", 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033610010000000002 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6200000000000001e-06 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36987 4.37 4.4df0fd37 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.107 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121419+0000", 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64729386300000002, 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65023744500000002, 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36987 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121419+0000", 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121419+0000", 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121419+0000", 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121429+0000", 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0434e-05 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121435+0000", 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.224e-06 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121441+0000", 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8159999999999999e-06 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122129+0000", 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00068813299999999995 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122719+0000", 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00058947600000000002 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37073 4.36 4.61fa15f6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123495+0000", 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64521741499999996, 2024-04-26T12:32:37.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64819589700000002, 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37073 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123495+0000", 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123495+0000", 2024-04-26T12:32:37.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123495+0000", 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123509+0000", 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4022000000000001e-05 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5310000000000001e-06 2024-04-26T12:32:37.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123522+0000", 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8250000000000004e-06 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123816+0000", 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00029379900000000002 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123824+0000", 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2199999999999992e-06 2024-04-26T12:32:37.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37234 4.12 4.7bd9d512 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.161454+0000", 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60725906100000004, 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.61027231199999998, 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37234 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.161454+0000", 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.161454+0000", 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.161453+0000", 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.161468+0000", 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4834000000000001e-05 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.161482+0000", 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.429e-05 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.161493+0000", 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1354e-05 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.161524+0000", 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0719000000000002e-05 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.161529+0000", 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9200000000000003e-06 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37314 4.12 4.7bd9d512 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.118 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.196676+0000", 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.57203627000000001, 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57508438200000001, 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37314 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.196676+0000", 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.196676+0000", 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.196676+0000", 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.196685+0000", 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8289999999999997e-06 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.196691+0000", 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4099999999999996e-06 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.196695+0000", 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0210000000000001e-06 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.196728+0000", 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2597e-05 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.196734+0000", 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.353e-06 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37350 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.212868+0000", 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55584469700000005, 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55892812199999997, 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.122 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37350 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.212868+0000", 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.212868+0000", 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.123 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.212867+0000", 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.212878+0000", 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0753e-05 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.212885+0000", 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.124 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.212890+0000", 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8600000000000001e-06 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.212921+0000", 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1285000000000003e-05 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.212927+0000", 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.964e-06 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.125 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37426 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.242710+0000", 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52600318199999996, 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52912135199999999, 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37426 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.126 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242710+0000", 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242710+0000", 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242709+0000", 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242722+0000", 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3129000000000001e-05 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242733+0000", 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0718e-05 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242738+0000", 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0560000000000004e-06 2024-04-26T12:32:37.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242771+0000", 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3664000000000002e-05 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.242783+0000", 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.131e-05 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.129 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36918 4.f 4.7fb0154f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118557+0000", 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65015608899999999, 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65330918800000004, 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36918 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118557+0000", 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118557+0000", 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118556+0000", 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118572+0000", 2024-04-26T12:32:37.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5447999999999998e-05 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118578+0000", 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.443e-06 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118584+0000", 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1990000000000003e-06 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121934+0000", 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033493799999999999 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121940+0000", 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9329999999999998e-06 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36990 4.37 4.54009ff7 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121446+0000", 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.647266283, 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65045419299999996, 2024-04-26T12:32:37.133 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36990 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121446+0000", 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121446+0000", 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121446+0000", 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121459+0000", 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2598e-05 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121465+0000", 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1850000000000001e-06 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121470+0000", 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1259999999999997e-06 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122750+0000", 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001280244 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122757+0000", 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1539999999999996e-06 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37075 4.3f 4.a34187bf (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123529+0000", 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64518362500000004, 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64840661600000005, 2024-04-26T12:32:37.137 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37075 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123529+0000", 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123529+0000", 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123529+0000", 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123541+0000", 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2031000000000001e-05 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123816+0000", 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000275474 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123825+0000", 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9469999999999992e-06 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123860+0000", 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5111999999999999e-05 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123867+0000", 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6089999999999997e-06 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37149 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.128393+0000", 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64031970999999999, 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64357743999999995, 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.141 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37149 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.128393+0000", 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.128393+0000", 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.128392+0000", 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.128419+0000", 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7393e-05 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.128429+0000", 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9490000000000008e-06 2024-04-26T12:32:37.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.128437+0000", 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6890000000000004e-06 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.128474+0000", 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6878999999999997e-05 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.128481+0000", 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9469999999999997e-06 2024-04-26T12:32:37.144 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37236 4.28 4.8275ca8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.162147+0000", 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60656576699999998, 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60985851000000002, 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37236 2024-04-26T12:32:37.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162147+0000", 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162147+0000", 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162146+0000", 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162159+0000", 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2622999999999999e-05 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162171+0000", 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2636999999999999e-05 2024-04-26T12:32:37.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162181+0000", 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4350000000000003e-06 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162210+0000", 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9292999999999999e-05 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162215+0000", 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1730000000000003e-06 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37276 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.178358+0000", 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.590354779, 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.593682288, 2024-04-26T12:32:37.149 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37276 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.178358+0000", 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.178358+0000", 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.178357+0000", 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.178367+0000", 2024-04-26T12:32:37.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9289999999999993e-06 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.178376+0000", 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9609999999999994e-06 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.178382+0000", 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.575e-06 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.178419+0000", 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7515000000000003e-05 2024-04-26T12:32:37.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.178424+0000", 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9899999999999997e-06 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37428 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.243334+0000", 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52537827800000003, 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52874069700000004, 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.153 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37428 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243334+0000", 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243334+0000", 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243334+0000", 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243343+0000", 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6780000000000006e-06 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243349+0000", 2024-04-26T12:32:37.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3609999999999997e-06 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243353+0000", 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9140000000000001e-06 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243383+0000", 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0239999999999998e-05 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243391+0000", 2024-04-26T12:32:37.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4989999999999997e-06 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36919 4.6 4.692017c6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118592+0000", 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65012051800000004, 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65351765299999998, 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36919 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118592+0000", 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118592+0000", 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118592+0000", 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118616+0000", 2024-04-26T12:32:37.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4022000000000001e-05 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118622+0000", 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4670000000000001e-06 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118629+0000", 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2359999999999998e-06 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042822249999999997 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122918+0000", 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9869999999999996e-06 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.161 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36991 4.19 4.948ede99 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121474+0000", 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64723825199999996, 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65067035200000001, 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36991 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121474+0000", 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121474+0000", 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121474+0000", 2024-04-26T12:32:37.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121486+0000", 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.152e-05 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121493+0000", 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6550000000000004e-06 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121499+0000", 2024-04-26T12:32:37.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4709999999999998e-06 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121666+0000", 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000166937 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121669+0000", 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3390000000000001e-06 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37079 4.3f 4.a34187bf (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123836+0000", 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.644877178, 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64834419600000004, 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37079 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.166 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123836+0000", 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123836+0000", 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123835+0000", 2024-04-26T12:32:37.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123851+0000", 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5625e-05 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123865+0000", 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4236000000000001e-05 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123871+0000", 2024-04-26T12:32:37.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5180000000000001e-06 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123905+0000", 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3484e-05 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123911+0000", 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6900000000000003e-06 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37151 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.129081+0000", 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63963194899999998, 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64313355500000002, 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37151 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129081+0000", 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129081+0000", 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129080+0000", 2024-04-26T12:32:37.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129093+0000", 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3182e-05 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129102+0000", 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129108+0000", 2024-04-26T12:32:37.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3960000000000003e-06 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129151+0000", 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2562999999999999e-05 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129159+0000", 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7369999999999995e-06 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37237 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.162543+0000", 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.606170192, 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60972885700000001, 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37237 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162543+0000", 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162543+0000", 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162542+0000", 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162554+0000", 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2128e-05 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162566+0000", 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2323999999999999e-05 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162573+0000", 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1359999999999999e-06 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162611+0000", 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7450000000000002e-05 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.162616+0000", 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1089999999999997e-06 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.177 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37316 4.14 4.faeb14d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.197501+0000", 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.57121133099999999, 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57481115400000005, 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.178 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37316 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.197501+0000", 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.197501+0000", 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.197501+0000", 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.197511+0000", 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9750000000000002e-06 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.197518+0000", 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.197524+0000", 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7520000000000002e-06 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.197558+0000", 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4248999999999997e-05 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.197567+0000", 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4579999999999993e-06 2024-04-26T12:32:37.181 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37429 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.243601+0000", 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52511134199999998, 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52874800600000005, 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37429 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243601+0000", 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243601+0000", 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243601+0000", 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243615+0000", 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3491e-05 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243620+0000", 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0259999999999998e-06 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243623+0000", 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2430000000000001e-06 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243653+0000", 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0102000000000001e-05 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.243659+0000", 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0449999999999997e-06 2024-04-26T12:32:37.185 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37468 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.258529+0000", 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51018402100000004, 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51385709000000002, 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.186 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37468 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.258529+0000", 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.258529+0000", 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.258528+0000", 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.258544+0000", 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6186999999999999e-05 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.258563+0000", 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9182999999999999e-05 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.258570+0000", 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0389999999999999e-06 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.258610+0000", 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9567999999999998e-05 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.258620+0000", 2024-04-26T12:32:37.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7499999999999998e-06 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4.46209f63 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65007803500000005, 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65378778699999995, 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.190 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:32:37.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:32:37.193 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37000 4.2f 4.da61f9af (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121503+0000", 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64720939499999997, 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65095567399999998, 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.194 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37000 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121503+0000", 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121503+0000", 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121503+0000", 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121514+0000", 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1161999999999999e-05 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121520+0000", 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3579999999999999e-06 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121526+0000", 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4709999999999998e-06 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122778+0000", 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001252115 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122785+0000", 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3050000000000004e-06 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.197 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37085 4.33 4.365eb6f3 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123879+0000", 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64483407500000001, 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64861700700000002, 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37085 2024-04-26T12:32:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123879+0000", 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123879+0000", 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123878+0000", 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123890+0000", 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2279999999999999e-05 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123897+0000", 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9929999999999998e-06 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.200 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1090000000000003e-06 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123938+0000", 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4530999999999999e-05 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123947+0000", 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:32:37.201 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37239 4.28 4.8275ca8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.163458+0000", 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60525488699999996, 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60907434400000005, 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.202 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37239 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163458+0000", 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163458+0000", 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163457+0000", 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163468+0000", 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1011e-05 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163479+0000", 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1294999999999999e-05 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163485+0000", 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6949999999999997e-06 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163512+0000", 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6834000000000001e-05 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163517+0000", 2024-04-26T12:32:37.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1290000000000004e-06 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37353 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.214655+0000", 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55405806599999996, 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55792957700000001, 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.206 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37353 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.214655+0000", 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.214655+0000", 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.207 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.214654+0000", 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.214668+0000", 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4168999999999999e-05 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.214677+0000", 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0839999999999998e-06 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.208 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.214685+0000", 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.214722+0000", 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7076999999999998e-05 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.214728+0000", 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7640000000000002e-06 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.209 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37392 4.33 4.365eb6f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.229997+0000", 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.53871604699999998, 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54262244900000001, 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37392 2024-04-26T12:32:37.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.229997+0000", 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.229997+0000", 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.229996+0000", 2024-04-26T12:32:37.211 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230007+0000", 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1182000000000001e-05 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230016+0000", 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9160000000000007e-06 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230024+0000", 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9030000000000004e-06 2024-04-26T12:32:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230062+0000", 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7722999999999998e-05 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230070+0000", 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0029999999999994e-06 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37430 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.213 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.244004+0000", 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52470910900000001, 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52865054600000005, 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37430 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.214 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244004+0000", 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244004+0000", 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244003+0000", 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.215 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244016+0000", 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.344e-05 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244028+0000", 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1306e-05 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244033+0000", 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.216 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244058+0000", 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4428999999999999e-05 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244063+0000", 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0599999999999998e-06 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.217 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37470 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.259233+0000", 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50948018100000003, 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51345620800000003, 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37470 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.218 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259233+0000", 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259233+0000", 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259232+0000", 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259256+0000", 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3975e-05 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259265+0000", 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2119999999999992e-06 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259271+0000", 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0780000000000001e-06 2024-04-26T12:32:37.220 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259299+0000", 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7350000000000001e-05 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259303+0000", 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.498e-06 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36927 4.6 4.8232b686 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118673+0000", 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.65003969900000003, 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65405077099999998, 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36927 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118673+0000", 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118673+0000", 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118673+0000", 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118690+0000", 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7669999999999999e-05 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118697+0000", 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2940000000000002e-06 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118703+0000", 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:32:37.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122940+0000", 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042374029999999998 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122946+0000", 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0689999999999998e-06 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.225 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37001 4.36 4.8d2c3936 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121530+0000", 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64718271699999996, 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65122854799999996, 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37001 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121530+0000", 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121530+0000", 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121530+0000", 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121541+0000", 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1440999999999999e-05 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121547+0000", 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1940000000000003e-06 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121552+0000", 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.198e-06 2024-04-26T12:32:37.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123225+0000", 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001672076 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123230+0000", 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0479999999999998e-06 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37087 4.36 4.670445b6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123912+0000", 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64480044199999997, 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64888108899999997, 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37087 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.230 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123912+0000", 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123912+0000", 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123912+0000", 2024-04-26T12:32:37.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123924+0000", 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2628e-05 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123931+0000", 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6649999999999997e-06 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123937+0000", 2024-04-26T12:32:37.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4199999999999998e-06 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123964+0000", 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7716999999999999e-05 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123971+0000", 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2999999999999998e-06 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37153 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.129749+0000", 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63896350899999999, 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64307905899999995, 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37153 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.234 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129749+0000", 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129749+0000", 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129748+0000", 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129759+0000", 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1028e-05 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129771+0000", 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1307e-05 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129779+0000", 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9559999999999997e-06 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129802+0000", 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3598999999999999e-05 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.129806+0000", 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9779999999999999e-06 2024-04-26T12:32:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37240 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.163925+0000", 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60478731799999996, 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60893753399999995, 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37240 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163925+0000", 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163925+0000", 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163925+0000", 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163935+0000", 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0591000000000001e-05 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163946+0000", 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1141000000000001e-05 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163952+0000", 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163982+0000", 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0386999999999999e-05 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.163986+0000", 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0380000000000001e-06 2024-04-26T12:32:37.241 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37279 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.179544+0000", 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58916824199999995, 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59335323100000004, 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.242 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37279 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.179544+0000", 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.179544+0000", 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.179544+0000", 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.179562+0000", 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7693000000000002e-05 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.179574+0000", 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2078e-05 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.179590+0000", 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6517000000000001e-05 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.179633+0000", 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2954999999999998e-05 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.179642+0000", 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1249999999999999e-06 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.245 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37354 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.215227+0000", 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55348607000000005, 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55770601900000005, 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37354 2024-04-26T12:32:37.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.215227+0000", 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.215227+0000", 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.215226+0000", 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.215235+0000", 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0410000000000003e-06 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.215250+0000", 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5455999999999999e-05 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.215258+0000", 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2259999999999999e-06 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.215307+0000", 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9502999999999997e-05 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.215316+0000", 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7360000000000007e-06 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.249 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37431 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.244294+0000", 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52441872700000003, 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52869737299999997, 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37431 2024-04-26T12:32:37.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244294+0000", 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244294+0000", 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244294+0000", 2024-04-26T12:32:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244304+0000", 2024-04-26T12:32:37.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.005e-05 2024-04-26T12:32:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244314+0000", 2024-04-26T12:32:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0767999999999999e-05 2024-04-26T12:32:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244319+0000", 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.155e-06 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244349+0000", 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0196e-05 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244354+0000", 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2689999999999999e-06 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.254 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37506 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.272733+0000", 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.49598019799999998, 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.50029417300000001, 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37506 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.272733+0000", 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.272733+0000", 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.272732+0000", 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.272756+0000", 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4604999999999999e-05 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.272767+0000", 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0917999999999999e-05 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.272775+0000", 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9389999999999997e-06 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.272808+0000", 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2873000000000002e-05 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.272813+0000", 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.258 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36928 4.37 4.4df0fd37 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118732+0000", 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64998120000000004, 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65433032000000002, 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36928 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118732+0000", 2024-04-26T12:32:37.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118732+0000", 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118731+0000", 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118745+0000", 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4095e-05 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118752+0000", 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9990000000000002e-06 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118758+0000", 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9050000000000002e-06 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121966+0000", 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003208097 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121972+0000", 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.93e-06 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37002 4.36 4.8d2c3936 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121558+0000", 2024-04-26T12:32:37.262 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64715497399999999, 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65153924100000005, 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37002 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121558+0000", 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121558+0000", 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121557+0000", 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121569+0000", 2024-04-26T12:32:37.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1454000000000001e-05 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121576+0000", 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8510000000000001e-06 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121580+0000", 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8199999999999996e-06 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123257+0000", 2024-04-26T12:32:37.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00167654 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123262+0000", 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0100000000000003e-06 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4.c27a5b55 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64476951999999998, 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64918887300000006, 2024-04-26T12:32:37.266 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:32:37.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37242 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.164514+0000", 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60419888399999999, 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60865325800000003, 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37242 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.164514+0000", 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.164514+0000", 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.164513+0000", 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.164524+0000", 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1291000000000001e-05 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.164536+0000", 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1338000000000001e-05 2024-04-26T12:32:37.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.164542+0000", 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.84e-06 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.164571+0000", 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9322000000000001e-05 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.164575+0000", 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6500000000000004e-06 2024-04-26T12:32:37.273 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37393 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.230332+0000", 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.53838066200000001, 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54286992199999995, 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.274 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37393 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230332+0000", 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230332+0000", 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230331+0000", 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230344+0000", 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2826000000000001e-05 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230354+0000", 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0278999999999999e-05 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230360+0000", 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3550000000000004e-06 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230409+0000", 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8863000000000003e-05 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.230418+0000", 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:32:37.277 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37432 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.244645+0000", 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52406777800000004, 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52859218799999996, 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.278 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37432 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244645+0000", 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244645+0000", 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244644+0000", 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244672+0000", 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7503000000000001e-05 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244681+0000", 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3749999999999992e-06 2024-04-26T12:32:37.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244686+0000", 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7500000000000003e-06 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244725+0000", 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9357999999999998e-05 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.244734+0000", 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0420000000000008e-06 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37508 4.28 4.8275ca8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.273526+0000", 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.49518715899999999, 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.499774155, 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.282 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37508 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.273526+0000", 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.273526+0000", 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.273525+0000", 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.273541+0000", 2024-04-26T12:32:37.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6407999999999999e-05 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.273554+0000", 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.276e-05 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.273563+0000", 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7730000000000005e-06 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.273620+0000", 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7021000000000002e-05 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.273625+0000", 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.767e-06 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4.61fa15f6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:37.286 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64994982199999995, 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65457394199999996, 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:32:37.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:32:37.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37005 4.15 4.c27a5b55 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121585+0000", 2024-04-26T12:32:37.290 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64712782899999999, 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65178889799999995, 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37005 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121585+0000", 2024-04-26T12:32:37.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121585+0000", 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121584+0000", 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121594+0000", 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.696e-06 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121600+0000", 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2770000000000002e-06 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121607+0000", 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2299999999999996e-06 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121864+0000", 2024-04-26T12:32:37.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00025724500000000002 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121872+0000", 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0979999999999994e-06 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37089 4.37 4.917a9cf7 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123973+0000", 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64473947600000003, 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.649436974, 2024-04-26T12:32:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37089 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123973+0000", 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123973+0000", 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123973+0000", 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3355e-05 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123992+0000", 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1099999999999999e-06 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123998+0000", 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3410000000000002e-06 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124030+0000", 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2614000000000003e-05 2024-04-26T12:32:37.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124037+0000", 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5289999999999997e-06 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37155 4.33 4.365eb6f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.130444+0000", 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63826875100000002, 2024-04-26T12:32:37.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64300272800000002, 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37155 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.130444+0000", 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.130444+0000", 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.130443+0000", 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.130465+0000", 2024-04-26T12:32:37.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1759e-05 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.130475+0000", 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7659999999999993e-06 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.130482+0000", 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6040000000000004e-06 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.130513+0000", 2024-04-26T12:32:37.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0930999999999999e-05 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.130519+0000", 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37197 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.147095+0000", 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62161727300000003, 2024-04-26T12:32:37.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62638777800000001, 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37197 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147095+0000", 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147095+0000", 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147095+0000", 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147108+0000", 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3368e-05 2024-04-26T12:32:37.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147124+0000", 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.577e-05 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147151+0000", 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7375000000000001e-05 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147187+0000", 2024-04-26T12:32:37.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.612e-05 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147192+0000", 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1449999999999999e-06 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37281 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.306 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.180842+0000", 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58787086, 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59267800299999995, 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37281 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.180842+0000", 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.180842+0000", 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.180841+0000", 2024-04-26T12:32:37.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.180852+0000", 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1080000000000001e-05 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.180863+0000", 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0361e-05 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.180869+0000", 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6619999999999999e-06 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.180899+0000", 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9298e-05 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.180904+0000", 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9460000000000003e-06 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.310 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37433 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.245165+0000", 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52354772900000002, 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52839141300000003, 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37433 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.245165+0000", 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.245165+0000", 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.245164+0000", 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.245179+0000", 2024-04-26T12:32:37.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5014999999999999e-05 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.245192+0000", 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2785e-05 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.245198+0000", 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7749999999999998e-06 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.245222+0000", 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4295999999999999e-05 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.245227+0000", 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6099999999999999e-06 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.315 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37472 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.259858+0000", 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50885475700000005, 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51374995499999998, 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37472 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259858+0000", 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259858+0000", 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259857+0000", 2024-04-26T12:32:37.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259888+0000", 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0531000000000003e-05 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259895+0000", 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.579e-06 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259900+0000", 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7520000000000002e-06 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259924+0000", 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4150000000000001e-05 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.259929+0000", 2024-04-26T12:32:37.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37510 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.274236+0000", 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.49447623000000002, 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.49940647500000002, 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.320 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37510 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.274236+0000", 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.274236+0000", 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.274236+0000", 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.274260+0000", 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4824000000000002e-05 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.274269+0000", 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8140000000000007e-06 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.274274+0000", 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0320000000000003e-06 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.274305+0000", 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0457999999999999e-05 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.274310+0000", 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:32:37.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36931 4.2e 4.6cf07dae (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118808+0000", 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64990448300000003, 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65486976900000005, 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.324 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36931 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118808+0000", 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118808+0000", 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118808+0000", 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118816+0000", 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8849999999999999e-06 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118820+0000", 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5990000000000004e-06 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118823+0000", 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123009+0000", 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041861240000000003 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123016+0000", 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.883e-06 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37008 4.23 4.46209f63 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64708601399999999, 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65208850799999996, 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.328 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37008 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121626+0000", 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121644+0000", 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8444000000000002e-05 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121655+0000", 2024-04-26T12:32:37.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1068e-05 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121663+0000", 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8739999999999995e-06 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121727+0000", 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3756000000000004e-05 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121733+0000", 2024-04-26T12:32:37.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0619999999999997e-06 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37097 4.3b 4.fa83033b (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124006+0000", 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64470664200000005, 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.649743921, 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37097 2024-04-26T12:32:37.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124006+0000", 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124006+0000", 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124006+0000", 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3036e-05 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124025+0000", 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9680000000000003e-06 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124029+0000", 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6070000000000001e-06 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124058+0000", 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9002000000000001e-05 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124062+0000", 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0829999999999997e-06 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37198 4.3b 4.fa83033b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.147542+0000", 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62117034400000004, 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62624257299999997, 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37198 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147542+0000", 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147542+0000", 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147542+0000", 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147553+0000", 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1640999999999999e-05 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147565+0000", 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2116000000000001e-05 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147583+0000", 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7320999999999999e-05 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147611+0000", 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8034999999999998e-05 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.147616+0000", 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2939999999999996e-06 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37282 4.1c 4.f7421d9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.181286+0000", 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58742624499999996, 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59253330599999998, 2024-04-26T12:32:37.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37282 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.181286+0000", 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.181286+0000", 2024-04-26T12:32:37.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.181286+0000", 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.181306+0000", 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9814e-05 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.181313+0000", 2024-04-26T12:32:37.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3649999999999998e-06 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.181318+0000", 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4649999999999996e-06 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.181347+0000", 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9787000000000001e-05 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.181353+0000", 2024-04-26T12:32:37.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0759999999999999e-06 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37320 4.2d 4.9760552d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.199298+0000", 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.56941496300000005, 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57455668599999998, 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.343 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37320 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199298+0000", 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199298+0000", 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199297+0000", 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199315+0000", 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8193e-05 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199324+0000", 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199330+0000", 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3199999999999996e-06 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199357+0000", 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6529999999999998e-05 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199362+0000", 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2480000000000004e-06 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.346 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37357 4.12 4.c58a7d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.216543+0000", 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55216965100000004, 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55734614199999999, 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37357 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.216543+0000", 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.216543+0000", 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.216542+0000", 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.216552+0000", 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0278999999999999e-05 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.216559+0000", 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9789999999999996e-06 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.216565+0000", 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.216601+0000", 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5379999999999997e-05 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.216609+0000", 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3580000000000003e-06 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37396 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.231468+0000", 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.53724514899999998, 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54245684199999999, 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37396 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231468+0000", 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231468+0000", 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231467+0000", 2024-04-26T12:32:37.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231484+0000", 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7516e-05 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231495+0000", 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0344e-05 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231503+0000", 2024-04-26T12:32:37.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4130000000000006e-06 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231535+0000", 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1900000000000003e-05 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231540+0000", 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1909999999999999e-06 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37473 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.260302+0000", 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50841035899999998, 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51365681299999999, 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.355 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37473 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.260302+0000", 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.260302+0000", 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.260302+0000", 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.260331+0000", 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9689999999999999e-05 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.260342+0000", 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0719e-05 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.260350+0000", 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.554e-06 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.260388+0000", 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8315999999999997e-05 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.260401+0000", 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.347e-05 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.358 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36933 4.2e 4.6cf07dae (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118826+0000", 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64988680300000001, 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65516826900000003, 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36933 2024-04-26T12:32:37.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118826+0000", 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118826+0000", 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118826+0000", 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118848+0000", 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2022999999999999e-05 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118852+0000", 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4440000000000001e-06 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118855+0000", 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.326e-06 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123037+0000", 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041814629999999998 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123043+0000", 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8089999999999998e-06 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.362 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37009 4.36 4.61fa15f6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121669+0000", 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64704359499999997, 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65235982400000003, 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37009 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121669+0000", 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121669+0000", 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121669+0000", 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121682+0000", 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3414999999999999e-05 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121689+0000", 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4050000000000003e-06 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121695+0000", 2024-04-26T12:32:37.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7019999999999998e-06 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123281+0000", 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001585864 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123286+0000", 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.989e-06 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.366 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4.6cf07dae (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64467662800000003, 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65002767800000005, 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.367 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:32:37.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.370 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37200 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.148161+0000", 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62055202799999998, 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62593780499999996, 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37200 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.371 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148161+0000", 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148161+0000", 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148160+0000", 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148173+0000", 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3019e-05 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148182+0000", 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5289999999999997e-06 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148187+0000", 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0690000000000001e-06 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148220+0000", 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2104000000000003e-05 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148225+0000", 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3090000000000003e-06 2024-04-26T12:32:37.374 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37284 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.182260+0000", 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58645236899999997, 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59187252499999998, 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.375 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37284 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182260+0000", 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182260+0000", 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182260+0000", 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182268+0000", 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3799999999999994e-06 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182274+0000", 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0959999999999997e-06 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182278+0000", 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.574e-06 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182316+0000", 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7898000000000002e-05 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182324+0000", 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3760000000000008e-06 2024-04-26T12:32:37.378 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37321 4.14 4.faeb14d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.199861+0000", 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.56885195, 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57430678199999996, 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.379 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37321 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199861+0000", 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199861+0000", 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199860+0000", 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199874+0000", 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3794e-05 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199889+0000", 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5478999999999999e-05 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199897+0000", 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9789999999999993e-06 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199922+0000", 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4562999999999998e-05 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.199926+0000", 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7500000000000001e-06 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37358 4.3b 4.fa83033b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.217133+0000", 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55157924400000002, 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55706995800000003, 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37358 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217133+0000", 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217133+0000", 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217133+0000", 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217142+0000", 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6449999999999994e-06 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217149+0000", 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2640000000000002e-06 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217153+0000", 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2089999999999999e-06 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217195+0000", 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1922000000000003e-05 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217207+0000", 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1610999999999999e-05 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.386 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36936 4.37 4.4df0fd37 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118859+0000", 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64985412600000003, 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65538523500000001, 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36936 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118859+0000", 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118859+0000", 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118858+0000", 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118866+0000", 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1709999999999996e-06 2024-04-26T12:32:37.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118869+0000", 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.331e-06 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118872+0000", 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9869999999999999e-06 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121993+0000", 2024-04-26T12:32:37.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031210029999999998 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122000+0000", 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2729999999999997e-06 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37010 4.f 4.95fbf64f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121704+0000", 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64700866700000004, 2024-04-26T12:32:37.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65261328299999999, 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37010 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121704+0000", 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121704+0000", 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121704+0000", 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121715+0000", 2024-04-26T12:32:37.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0933e-05 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121721+0000", 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3840000000000002e-06 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121726+0000", 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2650000000000004e-06 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122799+0000", 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001072291 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122806+0000", 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6380000000000004e-06 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37101 4.f 4.7fb0154f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124075+0000", 2024-04-26T12:32:37.394 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64463763200000002, 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65028003499999998, 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37101 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124075+0000", 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124075+0000", 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124075+0000", 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124089+0000", 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3991e-05 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124095+0000", 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5590000000000002e-06 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124101+0000", 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0279999999999997e-06 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124135+0000", 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3908000000000001e-05 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124142+0000", 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4590000000000003e-06 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37159 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.132095+0000", 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63661731700000002, 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64229641100000001, 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.398 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37159 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132095+0000", 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132095+0000", 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132095+0000", 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132109+0000", 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4681000000000001e-05 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132119+0000", 2024-04-26T12:32:37.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2059999999999996e-06 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132124+0000", 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132167+0000", 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3244999999999997e-05 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132176+0000", 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37201 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.148507+0000", 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62020557799999998, 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62592119999999996, 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.402 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37201 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148507+0000", 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148507+0000", 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148507+0000", 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148517+0000", 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0242e-05 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148523+0000", 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:37.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148529+0000", 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0379999999999996e-06 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148558+0000", 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8430000000000001e-05 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.148562+0000", 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1679999999999997e-06 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.405 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37246 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.166235+0000", 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60247786000000003, 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.608230088, 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.406 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37246 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166235+0000", 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166235+0000", 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166234+0000", 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166262+0000", 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7528000000000001e-05 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166271+0000", 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8279999999999998e-06 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166278+0000", 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5899999999999996e-06 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166318+0000", 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0364000000000002e-05 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166328+0000", 2024-04-26T12:32:37.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4259999999999992e-06 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37285 4.2d 4.9760552d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.182629+0000", 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58608396399999996, 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59187270800000003, 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37285 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182629+0000", 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182629+0000", 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182628+0000", 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182638+0000", 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5859999999999994e-06 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182643+0000", 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9609999999999996e-06 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182646+0000", 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0620000000000001e-06 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182677+0000", 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1105000000000001e-05 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.182685+0000", 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.576e-06 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37322 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.200367+0000", 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.56834604799999999, 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57417122499999995, 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37322 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.200367+0000", 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.200367+0000", 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.200366+0000", 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.200384+0000", 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8077e-05 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.200394+0000", 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0445000000000001e-05 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.200400+0000", 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2349999999999999e-06 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.200428+0000", 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8345000000000001e-05 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.200432+0000", 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37359 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.217611+0000", 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55110138900000005, 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55697845099999999, 2024-04-26T12:32:37.417 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37359 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217611+0000", 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217611+0000", 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217611+0000", 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217618+0000", 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5950000000000001e-06 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217624+0000", 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0399999999999998e-06 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217628+0000", 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.692e-06 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217659+0000", 2024-04-26T12:32:37.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0868000000000003e-05 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217665+0000", 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0050000000000001e-06 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37397 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.231854+0000", 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.53685892599999996, 2024-04-26T12:32:37.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54277041699999995, 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37397 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231854+0000", 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231854+0000", 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231853+0000", 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231866+0000", 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2523e-05 2024-04-26T12:32:37.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231878+0000", 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2058999999999999e-05 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231883+0000", 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7289999999999997e-06 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231924+0000", 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0138000000000001e-05 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.231931+0000", 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8469999999999996e-06 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37439 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.247470+0000", 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52124252299999996, 2024-04-26T12:32:37.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52718821100000002, 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37439 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247470+0000", 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247470+0000", 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247469+0000", 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247482+0000", 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2629999999999999e-05 2024-04-26T12:32:37.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247493+0000", 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0806e-05 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247498+0000", 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.716e-06 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247548+0000", 2024-04-26T12:32:37.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9261000000000002e-05 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247554+0000", 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9819999999999996e-06 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4.46209f63 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.649837938, 2024-04-26T12:32:37.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65581838599999998, 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:32:37.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37011 4.28 4.d91d77a8 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121731+0000", 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64698195000000003, 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65299689800000005, 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37011 2024-04-26T12:32:37.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121731+0000", 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121731+0000", 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121730+0000", 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121742+0000", 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1535999999999999e-05 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121749+0000", 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1019999999999999e-06 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121755+0000", 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7760000000000003e-06 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121816+0000", 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1471999999999997e-05 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121824+0000", 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:32:37.436 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37103 4.12 4.c58a7d2 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124109+0000", 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64460384299999995, 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65065370899999997, 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.437 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37103 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124109+0000", 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124109+0000", 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124108+0000", 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124124+0000", 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5894000000000001e-05 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124132+0000", 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4930000000000001e-06 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124137+0000", 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.31e-06 2024-04-26T12:32:37.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124164+0000", 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6761999999999999e-05 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37161 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.132805+0000", 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63590765100000002, 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64199217799999997, 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37161 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.442 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132805+0000", 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132805+0000", 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132805+0000", 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132817+0000", 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2373e-05 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132826+0000", 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6670000000000002e-06 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132830+0000", 2024-04-26T12:32:37.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9790000000000004e-06 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132857+0000", 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.703e-05 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.132861+0000", 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8300000000000003e-06 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37247 4.2d 4.9760552d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.166569+0000", 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60214412299999998, 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.608263216, 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37247 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166569+0000", 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166569+0000", 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166568+0000", 2024-04-26T12:32:37.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166577+0000", 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6689999999999995e-06 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166583+0000", 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0569999999999998e-06 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166587+0000", 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6830000000000001e-06 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166617+0000", 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0443e-05 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166623+0000", 2024-04-26T12:32:37.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9089999999999997e-06 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37286 4.14 4.faeb14d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.183001+0000", 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58571185000000003, 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.591865435, 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.450 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37286 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.183001+0000", 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.183001+0000", 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.183001+0000", 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.183007+0000", 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0619999999999997e-06 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.183012+0000", 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0919999999999997e-06 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.183015+0000", 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3809999999999999e-06 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.183045+0000", 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9587999999999999e-05 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.183051+0000", 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3049999999999998e-06 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37360 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.217966+0000", 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55074715699999999, 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55693533100000003, 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.454 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37360 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217966+0000", 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217966+0000", 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217965+0000", 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217980+0000", 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.465e-05 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217986+0000", 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9359999999999996e-06 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.217989+0000", 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4800000000000001e-06 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218017+0000", 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7881e-05 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218022+0000", 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2209999999999996e-06 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37440 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.247844+0000", 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52086858700000005, 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52709143999999997, 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37440 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247844+0000", 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247844+0000", 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247843+0000", 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247855+0000", 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1214e-05 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247864+0000", 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9240000000000002e-06 2024-04-26T12:32:37.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247871+0000", 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0260000000000002e-06 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247903+0000", 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1479000000000001e-05 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.247908+0000", 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0409999999999997e-06 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4.46209f63 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64982058399999998, 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.656078088, 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.462 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:37.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:32:37.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:32:37.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37021 4.2f 4.da61f9af (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121765+0000", 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64694764299999996, 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.653239774, 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37021 2024-04-26T12:32:37.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121765+0000", 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121765+0000", 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121765+0000", 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121776+0000", 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.181e-05 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121783+0000", 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3400000000000003e-06 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121792+0000", 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9590000000000001e-06 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122811+0000", 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010194469999999999 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122816+0000", 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.057e-06 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4.df98c259 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64456818699999996, 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65089462899999995, 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.470 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:32:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.473 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37248 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.166934+0000", 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60177881, 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60813983299999996, 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37248 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166934+0000", 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166934+0000", 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166933+0000", 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166943+0000", 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6160000000000008e-06 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166951+0000", 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3429999999999996e-06 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166956+0000", 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.831e-06 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.166992+0000", 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5698999999999998e-05 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167001+0000", 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1209999999999996e-06 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.477 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37361 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.218493+0000", 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.55021938500000001, 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55661496399999999, 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37361 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218493+0000", 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218493+0000", 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218493+0000", 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218522+0000", 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9496e-05 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218528+0000", 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6579999999999999e-06 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218531+0000", 2024-04-26T12:32:37.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2830000000000002e-06 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218571+0000", 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9968000000000001e-05 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.218576+0000", 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8919999999999999e-06 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.481 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37516 4.12 4.c58a7d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.276187+0000", 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.49252578600000002, 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.49895615900000001, 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37516 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.276187+0000", 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.276187+0000", 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.276186+0000", 2024-04-26T12:32:37.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.276203+0000", 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7418000000000002e-05 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.276215+0000", 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1798e-05 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.276223+0000", 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9610000000000005e-06 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.276265+0000", 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1352e-05 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.276270+0000", 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7989999999999999e-06 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4.61fa15f6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64977362500000002, 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.656238663, 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.486 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:37.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:37.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:32:37.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37022 4.19 4.df98c259 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121796+0000", 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64691626800000002, 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65341594700000005, 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.490 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37022 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121796+0000", 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121796+0000", 2024-04-26T12:32:37.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121796+0000", 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121810+0000", 2024-04-26T12:32:37.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4416000000000001e-05 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121818+0000", 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9340000000000006e-06 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121825+0000", 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.365e-06 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122714+0000", 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00088876000000000005 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122718+0000", 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9010000000000002e-06 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.494 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37109 4.f 4.7fb0154f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124180+0000", 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64453316999999999, 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65109519900000001, 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37109 2024-04-26T12:32:37.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124180+0000", 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124180+0000", 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124179+0000", 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124200+0000", 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1169999999999999e-05 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124207+0000", 2024-04-26T12:32:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8719999999999996e-06 2024-04-26T12:32:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124212+0000", 2024-04-26T12:32:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0950000000000003e-06 2024-04-26T12:32:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124234+0000", 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1452000000000001e-05 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124238+0000", 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7890000000000001e-06 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.499 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37207 4.3b 4.fa83033b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.151043+0000", 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61766981200000004, 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62426896700000001, 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37207 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.500 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151043+0000", 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151043+0000", 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151042+0000", 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151052+0000", 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0032e-05 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151063+0000", 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1052e-05 2024-04-26T12:32:37.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151071+0000", 2024-04-26T12:32:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7970000000000001e-06 2024-04-26T12:32:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151114+0000", 2024-04-26T12:32:37.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2602000000000003e-05 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151122+0000", 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7779999999999996e-06 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37249 4.28 4.d91d77a8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.167455+0000", 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60125737599999995, 2024-04-26T12:32:37.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.607892977, 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37249 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167455+0000", 2024-04-26T12:32:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167455+0000", 2024-04-26T12:32:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167455+0000", 2024-04-26T12:32:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167496+0000", 2024-04-26T12:32:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1362999999999997e-05 2024-04-26T12:32:37.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167503+0000", 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6139999999999997e-06 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167507+0000", 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2640000000000002e-06 2024-04-26T12:32:37.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167536+0000", 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9436000000000001e-05 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167541+0000", 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7249999999999997e-06 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37362 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.219015+0000", 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.54969809599999997, 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55637033000000002, 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37362 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.510 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219015+0000", 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219015+0000", 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219014+0000", 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219026+0000", 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1753000000000001e-05 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219036+0000", 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0711e-05 2024-04-26T12:32:37.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219059+0000", 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2575999999999999e-05 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219087+0000", 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7959000000000001e-05 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219090+0000", 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6739999999999999e-06 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37442 4.12 4.7bd9d512 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.248419+0000", 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.52029422000000003, 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52700308600000001, 2024-04-26T12:32:37.514 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37442 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248419+0000", 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248419+0000", 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248418+0000", 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248431+0000", 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2984e-05 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248440+0000", 2024-04-26T12:32:37.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6569999999999992e-06 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248446+0000", 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.259e-06 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248478+0000", 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1795999999999998e-05 2024-04-26T12:32:37.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248483+0000", 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.519 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37479 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.262374+0000", 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50633900200000004, 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51308418899999997, 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37479 2024-04-26T12:32:37.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.262374+0000", 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.262374+0000", 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.262373+0000", 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.262404+0000", 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0873000000000001e-05 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.262414+0000", 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0266e-05 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.262421+0000", 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5339999999999996e-06 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.262460+0000", 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9601999999999998e-05 2024-04-26T12:32:37.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.262467+0000", 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8889999999999996e-06 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4.46209f63 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:37.524 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64975363900000005, 2024-04-26T12:32:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65653549700000002, 2024-04-26T12:32:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:32:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:37.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:32:37.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4.d91d77a8 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64682884200000001, 2024-04-26T12:32:37.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65364731600000003, 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:32:37.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:32:37.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37111 4.36 4.8d2c3936 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124219+0000", 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64449343999999997, 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65136370300000002, 2024-04-26T12:32:37.533 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37111 2024-04-26T12:32:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124219+0000", 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124219+0000", 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124219+0000", 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124235+0000", 2024-04-26T12:32:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6092000000000001e-05 2024-04-26T12:32:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124246+0000", 2024-04-26T12:32:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.093e-05 2024-04-26T12:32:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124251+0000", 2024-04-26T12:32:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3419999999999998e-06 2024-04-26T12:32:37.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124281+0000", 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9638e-05 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124285+0000", 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:32:37.538 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37163 4.12 4.c58a7d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.133643+0000", 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63506986899999995, 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64197485200000004, 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.539 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37163 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.133643+0000", 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.133643+0000", 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.133642+0000", 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.133656+0000", 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3345e-05 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.133666+0000", 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0142999999999999e-05 2024-04-26T12:32:37.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.133673+0000", 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.133716+0000", 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3582999999999999e-05 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.133725+0000", 2024-04-26T12:32:37.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2410000000000001e-06 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37208 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.151368+0000", 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.617344432, 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62428364700000005, 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.543 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37208 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151368+0000", 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151368+0000", 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151368+0000", 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151381+0000", 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3433e-05 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151387+0000", 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151392+0000", 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151432+0000", 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9347000000000001e-05 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.151438+0000", 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1310000000000003e-06 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37250 4.15 4.c27a5b55 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.167851+0000", 2024-04-26T12:32:37.547 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.60086170000000005, 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60783542300000004, 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37250 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167851+0000", 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167851+0000", 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167850+0000", 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167858+0000", 2024-04-26T12:32:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4549999999999998e-06 2024-04-26T12:32:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167863+0000", 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167867+0000", 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4819999999999999e-06 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167894+0000", 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7050999999999999e-05 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.167899+0000", 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4589999999999997e-06 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37324 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.201530+0000", 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.56718269700000001, 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57419079200000001, 2024-04-26T12:32:37.552 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37324 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.201530+0000", 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.201530+0000", 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.201529+0000", 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.201543+0000", 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3935e-05 2024-04-26T12:32:37.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.201551+0000", 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.503e-06 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.201558+0000", 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0589999999999997e-06 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.201590+0000", 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1566000000000002e-05 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.201596+0000", 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9989999999999997e-06 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.556 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37364 4.28 4.d91d77a8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.219893+0000", 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.54881991399999996, 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55586231399999997, 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37364 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219893+0000", 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219893+0000", 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219892+0000", 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219907+0000", 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.483e-05 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219917+0000", 2024-04-26T12:32:37.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.062e-05 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219940+0000", 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2915e-05 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219965+0000", 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4156999999999999e-05 2024-04-26T12:32:37.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.219969+0000", 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1420000000000003e-06 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37400 4.12 4.7bd9d512 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.233490+0000", 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.535223106, 2024-04-26T12:32:37.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54229980499999997, 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37400 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.233490+0000", 2024-04-26T12:32:37.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.233490+0000", 2024-04-26T12:32:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.233489+0000", 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.233500+0000", 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1501000000000001e-05 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.233509+0000", 2024-04-26T12:32:37.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9800000000000004e-06 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.233514+0000", 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5199999999999999e-06 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.233551+0000", 2024-04-26T12:32:37.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6820999999999999e-05 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.233560+0000", 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3559999999999999e-06 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37443 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.248754+0000", 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51995868999999995, 2024-04-26T12:32:37.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.527069911, 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37443 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248754+0000", 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248754+0000", 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248754+0000", 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248768+0000", 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4436e-05 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248774+0000", 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.336e-06 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248778+0000", 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9149999999999998e-06 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248819+0000", 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0638e-05 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.248827+0000", 2024-04-26T12:32:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2400000000000007e-06 2024-04-26T12:32:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37519 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.571 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.277305+0000", 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.49140787499999999, 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.49855361999999998, 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37519 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277305+0000", 2024-04-26T12:32:37.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277305+0000", 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277304+0000", 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277322+0000", 2024-04-26T12:32:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.734e-05 2024-04-26T12:32:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277331+0000", 2024-04-26T12:32:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3300000000000005e-06 2024-04-26T12:32:37.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277336+0000", 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3820000000000003e-06 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277364+0000", 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7764e-05 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277369+0000", 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7099999999999998e-06 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36954 4.19 4.948ede99 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118989+0000", 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64972323099999996, 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.656903499, 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.576 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36954 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118989+0000", 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118989+0000", 2024-04-26T12:32:37.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118989+0000", 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118998+0000", 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5109999999999992e-06 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119004+0000", 2024-04-26T12:32:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7799999999999997e-06 2024-04-26T12:32:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119008+0000", 2024-04-26T12:32:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9670000000000003e-06 2024-04-26T12:32:37.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119030+0000", 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1997999999999998e-05 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119034+0000", 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1189999999999999e-06 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37025 4.f 4.7fb0154f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121925+0000", 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64678813300000004, 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65400298400000001, 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37025 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121925+0000", 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121925+0000", 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121924+0000", 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121937+0000", 2024-04-26T12:32:37.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2826000000000001e-05 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121943+0000", 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.455e-06 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121949+0000", 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4240000000000001e-06 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.584 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122831+0000", 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00088167300000000003 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122836+0000", 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6999999999999996e-06 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37115 4.6 4.2d31fac6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124258+0000", 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64445490000000005, 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65170423, 2024-04-26T12:32:37.585 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37115 2024-04-26T12:32:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124258+0000", 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124258+0000", 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124257+0000", 2024-04-26T12:32:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124272+0000", 2024-04-26T12:32:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4581e-05 2024-04-26T12:32:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124277+0000", 2024-04-26T12:32:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1440000000000002e-06 2024-04-26T12:32:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124281+0000", 2024-04-26T12:32:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:32:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124311+0000", 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9879e-05 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124318+0000", 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6839999999999999e-06 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4.365eb6f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63439488899999996, 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64167854999999996, 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.591 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:37.592 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:32:37.593 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.594 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37210 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.152201+0000", 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61651182199999999, 2024-04-26T12:32:37.595 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62382989899999997, 2024-04-26T12:32:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.596 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37210 2024-04-26T12:32:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152201+0000", 2024-04-26T12:32:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152201+0000", 2024-04-26T12:32:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.598 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152200+0000", 2024-04-26T12:32:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.599 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152218+0000", 2024-04-26T12:32:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7155000000000001e-05 2024-04-26T12:32:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.600 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152224+0000", 2024-04-26T12:32:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0360000000000003e-06 2024-04-26T12:32:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152227+0000", 2024-04-26T12:32:37.601 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.794e-06 2024-04-26T12:32:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152263+0000", 2024-04-26T12:32:37.602 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5243999999999997e-05 2024-04-26T12:32:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152270+0000", 2024-04-26T12:32:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2089999999999999e-06 2024-04-26T12:32:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.603 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37252 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.168845+0000", 2024-04-26T12:32:37.604 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.59986816899999995, 2024-04-26T12:32:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60722111199999995, 2024-04-26T12:32:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.605 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37252 2024-04-26T12:32:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.606 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.168845+0000", 2024-04-26T12:32:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.168845+0000", 2024-04-26T12:32:37.607 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.168843+0000", 2024-04-26T12:32:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999981 2024-04-26T12:32:37.608 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.168870+0000", 2024-04-26T12:32:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7353000000000001e-05 2024-04-26T12:32:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.609 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.168898+0000", 2024-04-26T12:32:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8535999999999999e-05 2024-04-26T12:32:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.168914+0000", 2024-04-26T12:32:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5336999999999999e-05 2024-04-26T12:32:37.610 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.168993+0000", 2024-04-26T12:32:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8844000000000006e-05 2024-04-26T12:32:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169001+0000", 2024-04-26T12:32:37.611 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8359999999999992e-06 2024-04-26T12:32:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37291 4.14 4.faeb14d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.185157+0000", 2024-04-26T12:32:37.612 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58355553500000001, 2024-04-26T12:32:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59094317100000004, 2024-04-26T12:32:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.613 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37291 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.185157+0000", 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.614 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.185157+0000", 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.185156+0000", 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.185169+0000", 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2995e-05 2024-04-26T12:32:37.615 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.185180+0000", 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1165000000000001e-05 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.185188+0000", 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5209999999999997e-06 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.185225+0000", 2024-04-26T12:32:37.616 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6918000000000001e-05 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.185233+0000", 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1850000000000004e-06 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37325 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.202064+0000", 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.56664882100000002, 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57407098199999995, 2024-04-26T12:32:37.617 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37325 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.202064+0000", 2024-04-26T12:32:37.618 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.202064+0000", 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.202063+0000", 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.619 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.202078+0000", 2024-04-26T12:32:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5285e-05 2024-04-26T12:32:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.202087+0000", 2024-04-26T12:32:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3210000000000005e-06 2024-04-26T12:32:37.620 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.202091+0000", 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1080000000000003e-06 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.202117+0000", 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5930000000000001e-05 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.621 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.202121+0000", 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4950000000000002e-06 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37365 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.220199+0000", 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.54851359600000005, 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55597027899999996, 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.622 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37365 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220199+0000", 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.623 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220199+0000", 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220199+0000", 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220248+0000", 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9262999999999999e-05 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.624 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220254+0000", 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220258+0000", 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.929e-06 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.625 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220284+0000", 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5412999999999999e-05 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220288+0000", 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5770000000000004e-06 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.626 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37445 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.249594+0000", 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51911839299999996, 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52660965599999998, 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.627 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37445 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.249594+0000", 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.249594+0000", 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.628 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.249593+0000", 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.249607+0000", 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3448999999999999e-05 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.629 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.249618+0000", 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.132e-05 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.249624+0000", 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7230000000000001e-06 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.249655+0000", 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1062000000000002e-05 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.249661+0000", 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2539999999999998e-06 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4.670445b6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64969929999999998, 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65724975500000005, 2024-04-26T12:32:37.631 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:37.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37027 4.36 4.8d2c3936 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121971+0000", 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64674158999999998, 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65433493300000001, 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37027 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.636 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121971+0000", 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121971+0000", 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121971+0000", 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121983+0000", 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2305e-05 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121990+0000", 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0090000000000001e-06 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121996+0000", 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123304+0000", 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001308086 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123308+0000", 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8239999999999999e-06 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.639 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37120 4.2f 4.da61f9af (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124285+0000", 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64442722600000002, 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65205764499999996, 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37120 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124285+0000", 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124285+0000", 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124285+0000", 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124297+0000", 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1800999999999999e-05 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124301+0000", 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.461e-06 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124304+0000", 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0869999999999998e-06 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8834e-05 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4510000000000001e-06 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.643 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37167 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.135053+0000", 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63366006399999997, 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64132693600000001, 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37167 2024-04-26T12:32:37.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135053+0000", 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135053+0000", 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135052+0000", 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135066+0000", 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3787e-05 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135078+0000", 2024-04-26T12:32:37.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.221e-05 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135084+0000", 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135112+0000", 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7971999999999999e-05 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135117+0000", 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2989999999999996e-06 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37211 4.19 4.948ede99 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.152494+0000", 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61621899000000002, 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62392207099999997, 2024-04-26T12:32:37.648 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37211 2024-04-26T12:32:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152494+0000", 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152494+0000", 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152493+0000", 2024-04-26T12:32:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152504+0000", 2024-04-26T12:32:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0900999999999999e-05 2024-04-26T12:32:37.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152511+0000", 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1890000000000001e-06 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152531+0000", 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9466e-05 2024-04-26T12:32:37.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152570+0000", 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9604000000000002e-05 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.152576+0000", 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5049999999999998e-06 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.653 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37403 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.234504+0000", 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.53420861799999997, 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54194814899999999, 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.654 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37403 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234504+0000", 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234504+0000", 2024-04-26T12:32:37.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234503+0000", 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234518+0000", 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.435e-05 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234531+0000", 2024-04-26T12:32:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3422e-05 2024-04-26T12:32:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234537+0000", 2024-04-26T12:32:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:32:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234576+0000", 2024-04-26T12:32:37.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8615000000000002e-05 2024-04-26T12:32:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234585+0000", 2024-04-26T12:32:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3190000000000001e-06 2024-04-26T12:32:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37520 4.14 4.faeb14d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.661 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.277732+0000", 2024-04-26T12:32:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.49098107400000002, 2024-04-26T12:32:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.498757436, 2024-04-26T12:32:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.662 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37520 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277732+0000", 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277732+0000", 2024-04-26T12:32:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277731+0000", 2024-04-26T12:32:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277746+0000", 2024-04-26T12:32:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5029e-05 2024-04-26T12:32:37.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277759+0000", 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3488e-05 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277765+0000", 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.84e-06 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277806+0000", 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0487e-05 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.277820+0000", 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.433e-05 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36957 4.6 4.13f6ab46 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119030+0000", 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64968281900000002, 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65749597599999998, 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36957 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119030+0000", 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119030+0000", 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119030+0000", 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:37.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119053+0000", 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3291000000000001e-05 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119059+0000", 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1709999999999999e-06 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119064+0000", 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2320000000000001e-06 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123119+0000", 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040549050000000001 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123125+0000", 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.818e-06 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37028 4.19 4.df98c259 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122002+0000", 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64671029999999996, 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65457559899999995, 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37028 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122002+0000", 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122002+0000", 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122002+0000", 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122013+0000", 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1061e-05 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122019+0000", 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3670000000000002e-06 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122025+0000", 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4040000000000003e-06 2024-04-26T12:32:37.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122759+0000", 2024-04-26T12:32:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00073374400000000004 2024-04-26T12:32:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122766+0000", 2024-04-26T12:32:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6790000000000005e-06 2024-04-26T12:32:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37121 4.36 4.8d2c3936 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124308+0000", 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64440518599999996, 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65230497700000001, 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.677 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37121 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124308+0000", 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124308+0000", 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124307+0000", 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124317+0000", 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124321+0000", 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2239999999999997e-06 2024-04-26T12:32:37.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124324+0000", 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.044e-06 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7095000000000001e-05 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124344+0000", 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.253e-06 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37169 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.135689+0000", 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63302327300000005, 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64095738000000002, 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.681 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37169 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135689+0000", 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135689+0000", 2024-04-26T12:32:37.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135689+0000", 2024-04-26T12:32:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135708+0000", 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9318e-05 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135716+0000", 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135721+0000", 2024-04-26T12:32:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0130000000000001e-06 2024-04-26T12:32:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135751+0000", 2024-04-26T12:32:37.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9748e-05 2024-04-26T12:32:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.135757+0000", 2024-04-26T12:32:37.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1009999999999997e-06 2024-04-26T12:32:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37212 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.153184+0000", 2024-04-26T12:32:37.687 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61552883999999997, 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62349716600000005, 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37212 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153184+0000", 2024-04-26T12:32:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153184+0000", 2024-04-26T12:32:37.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153183+0000", 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153193+0000", 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9040000000000004e-06 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153204+0000", 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0644e-05 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153226+0000", 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2682000000000001e-05 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153256+0000", 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9240000000000001e-05 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153260+0000", 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4889999999999997e-06 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37254 4.3b 4.fa83033b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.169532+0000", 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.59918057400000002, 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60718346999999995, 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37254 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169532+0000", 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169532+0000", 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169532+0000", 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169541+0000", 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2839999999999995e-06 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169547+0000", 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169551+0000", 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.783e-06 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169588+0000", 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6996000000000003e-05 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169596+0000", 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5780000000000001e-06 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37367 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.220910+0000", 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.54780278999999998, 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55584029800000001, 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.696 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37367 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220910+0000", 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220910+0000", 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220910+0000", 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220919+0000", 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9870000000000005e-06 2024-04-26T12:32:37.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220925+0000", 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9059999999999996e-06 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220929+0000", 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6610000000000002e-06 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220969+0000", 2024-04-26T12:32:37.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0367000000000002e-05 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.220976+0000", 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37404 4.15 4.c27a5b55 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.234863+0000", 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.53385016799999996, 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54192203800000005, 2024-04-26T12:32:37.700 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37404 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234863+0000", 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234863+0000", 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234862+0000", 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234875+0000", 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3318e-05 2024-04-26T12:32:37.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234886+0000", 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1319e-05 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234896+0000", 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3649999999999993e-06 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234930+0000", 2024-04-26T12:32:37.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4004999999999997e-05 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.234936+0000", 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.348e-06 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37448 4.33 4.365eb6f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.250488+0000", 2024-04-26T12:32:37.704 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51822479700000001, 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52633099000000005, 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37448 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.250488+0000", 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.250488+0000", 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.250487+0000", 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.250518+0000", 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1096999999999997e-05 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.250530+0000", 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.223e-05 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.250539+0000", 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3639999999999999e-06 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.250578+0000", 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9471999999999997e-05 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.250585+0000", 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2389999999999996e-06 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.708 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36959 4.6 4.13f6ab46 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119069+0000", 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64964372100000001, 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65778433400000003, 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36959 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119069+0000", 2024-04-26T12:32:37.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119069+0000", 2024-04-26T12:32:37.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119069+0000", 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119079+0000", 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0862e-05 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119086+0000", 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119092+0000", 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1930000000000001e-06 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123144+0000", 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00405215 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123150+0000", 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1630000000000001e-06 2024-04-26T12:32:37.712 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4.8275ca8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64438505800000001, 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.652560103, 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.713 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.716 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37213 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.153583+0000", 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.615129492, 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62333869500000005, 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37213 2024-04-26T12:32:37.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153583+0000", 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153583+0000", 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153582+0000", 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153593+0000", 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0718e-05 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153604+0000", 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.092e-05 2024-04-26T12:32:37.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153624+0000", 2024-04-26T12:32:37.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9958000000000001e-05 2024-04-26T12:32:37.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153667+0000", 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2744000000000003e-05 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.153676+0000", 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.499e-06 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.721 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37255 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.169994+0000", 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.59871835399999995, 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60696180099999997, 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.722 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37255 2024-04-26T12:32:37.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.723 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169994+0000", 2024-04-26T12:32:37.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169994+0000", 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.169994+0000", 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170004+0000", 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0063e-05 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170014+0000", 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0719e-05 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170023+0000", 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1699999999999997e-06 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170057+0000", 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4350000000000001e-05 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170063+0000", 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9560000000000002e-06 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37295 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.186936+0000", 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58177670299999995, 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59005440600000003, 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.726 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37295 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.186936+0000", 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.186936+0000", 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.186935+0000", 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.186947+0000", 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2296000000000001e-05 2024-04-26T12:32:37.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.186958+0000", 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0669999999999999e-05 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.186964+0000", 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1600000000000003e-06 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187011+0000", 2024-04-26T12:32:37.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6542999999999998e-05 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187019+0000", 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1380000000000007e-06 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.731 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37329 4.19 4.948ede99 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.731 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.203874+0000", 2024-04-26T12:32:37.731 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.56483864699999997, 2024-04-26T12:32:37.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57315054700000001, 2024-04-26T12:32:37.731 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.731 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37329 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.203874+0000", 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.203874+0000", 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.203873+0000", 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.203893+0000", 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9887000000000001e-05 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.203904+0000", 2024-04-26T12:32:37.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0614999999999999e-05 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.203911+0000", 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.486e-06 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.203952+0000", 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0983999999999999e-05 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.203959+0000", 2024-04-26T12:32:37.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4699999999999999e-06 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37405 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.235144+0000", 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.53356910599999996, 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54191524700000004, 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.735 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37405 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.235144+0000", 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.235144+0000", 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.235143+0000", 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.235153+0000", 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0477e-05 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.235161+0000", 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6329999999999996e-06 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.235165+0000", 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.031e-06 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.235193+0000", 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8235e-05 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.235198+0000", 2024-04-26T12:32:37.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.87e-06 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37483 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.264114+0000", 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.50459859799999995, 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.51297907099999995, 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.739 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37483 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.264114+0000", 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.264114+0000", 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.264113+0000", 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.264138+0000", 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4453000000000001e-05 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.264148+0000", 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0282000000000001e-05 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.264157+0000", 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8000000000000004e-06 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.264196+0000", 2024-04-26T12:32:37.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9072999999999997e-05 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.264201+0000", 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2320000000000001e-06 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37523 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.278774+0000", 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.48993823800000003, 2024-04-26T12:32:37.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.49867779600000001, 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37523 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.278774+0000", 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.278774+0000", 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.278774+0000", 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.278793+0000", 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9001e-05 2024-04-26T12:32:37.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.278802+0000", 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9670000000000007e-06 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.278807+0000", 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.278835+0000", 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7991e-05 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.278842+0000", 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3600000000000001e-06 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.747 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36961 4.6 4.8232b686 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119096+0000", 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64961668100000003, 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65839434500000005, 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36961 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119096+0000", 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119096+0000", 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119096+0000", 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119126+0000", 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0803999999999998e-05 2024-04-26T12:32:37.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119134+0000", 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7449999999999995e-06 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119140+0000", 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4960000000000004e-06 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123175+0000", 2024-04-26T12:32:37.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040355829999999997 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123180+0000", 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2800000000000003e-06 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.751 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37030 4.15 4.c27a5b55 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122734+0000", 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64597896600000004, 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65479517899999995, 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37030 2024-04-26T12:32:37.752 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122734+0000", 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122734+0000", 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122733+0000", 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122746+0000", 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2996999999999999e-05 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122757+0000", 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0705e-05 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122766+0000", 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122910+0000", 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014385600000000001 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122915+0000", 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2429999999999996e-06 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.755 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4.d91d77a8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64436625000000003, 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65321921400000005, 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.756 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:32:37.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:32:37.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37171 4.23 4.46209f63 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.136919+0000", 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.6317933, 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64068383500000003, 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37171 2024-04-26T12:32:37.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.136919+0000", 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.136919+0000", 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.136919+0000", 2024-04-26T12:32:37.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.136931+0000", 2024-04-26T12:32:37.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2574e-05 2024-04-26T12:32:37.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.136940+0000", 2024-04-26T12:32:37.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6629999999999999e-06 2024-04-26T12:32:37.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.136945+0000", 2024-04-26T12:32:37.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.48e-06 2024-04-26T12:32:37.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.136984+0000", 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8244999999999997e-05 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.136992+0000", 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9480000000000008e-06 2024-04-26T12:32:37.764 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37215 4.3b 4.fa83033b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.154325+0000", 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61438783600000002, 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62331502800000005, 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.765 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37215 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154325+0000", 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154325+0000", 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154324+0000", 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154338+0000", 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4259e-05 2024-04-26T12:32:37.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154349+0000", 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1072e-05 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154355+0000", 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8690000000000001e-06 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154390+0000", 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4620999999999999e-05 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154397+0000", 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37256 4.1c 4.f7421d9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.769 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.170262+0000", 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.59845052600000004, 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60741627899999995, 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37256 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170262+0000", 2024-04-26T12:32:37.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170262+0000", 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170262+0000", 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170331+0000", 2024-04-26T12:32:37.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8921e-05 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170337+0000", 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7769999999999997e-06 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170341+0000", 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1250000000000003e-06 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170376+0000", 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4817000000000002e-05 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170385+0000", 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6370000000000005e-06 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.773 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37296 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.187580+0000", 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.58113248900000003, 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.59013607800000001, 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37296 2024-04-26T12:32:37.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187580+0000", 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187580+0000", 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187579+0000", 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187589+0000", 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7880000000000001e-06 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187600+0000", 2024-04-26T12:32:37.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1181e-05 2024-04-26T12:32:37.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187608+0000", 2024-04-26T12:32:37.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.182e-06 2024-04-26T12:32:37.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187643+0000", 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5902000000000003e-05 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.187652+0000", 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37369 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.221712+0000", 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.54700026700000004, 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.55604039500000002, 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37369 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.221712+0000", 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.221712+0000", 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.221712+0000", 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.221762+0000", 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9863e-05 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.221771+0000", 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7429999999999997e-06 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.221776+0000", 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3170000000000003e-06 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.221802+0000", 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6335000000000001e-05 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.221807+0000", 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0080000000000002e-06 2024-04-26T12:32:37.782 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36962 4.2d 4.9760552d (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119145+0000", 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64956820299999996, 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65864613699999996, 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.783 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36962 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119145+0000", 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119145+0000", 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119144+0000", 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119155+0000", 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0849999999999999e-05 2024-04-26T12:32:37.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119161+0000", 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3790000000000003e-06 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119167+0000", 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8429999999999998e-06 2024-04-26T12:32:37.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119296+0000", 2024-04-26T12:32:37.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012866700000000001 2024-04-26T12:32:37.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119303+0000", 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1600000000000001e-06 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4.ac5990ed (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64581783400000004, 2024-04-26T12:32:37.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65494825300000004, 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37127 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124365+0000", 2024-04-26T12:32:37.792 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.644347322, 2024-04-26T12:32:37.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65351342400000001, 2024-04-26T12:32:37.793 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.793 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.793 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.793 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.793 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.793 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37127 2024-04-26T12:32:37.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.794 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124365+0000", 2024-04-26T12:32:37.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124365+0000", 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124365+0000", 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124373+0000", 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8280000000000003e-06 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124376+0000", 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.207e-06 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124379+0000", 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7350000000000001e-06 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124396+0000", 2024-04-26T12:32:37.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7371e-05 2024-04-26T12:32:37.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124399+0000", 2024-04-26T12:32:37.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.157e-06 2024-04-26T12:32:37.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.798 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.798 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.63140513600000003, 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64060544799999997, 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.799 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:32:37.802 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37258 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.170954+0000", 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.59775915700000004, 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.606995756, 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.803 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37258 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170954+0000", 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170954+0000", 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170953+0000", 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170963+0000", 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0546e-05 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170974+0000", 2024-04-26T12:32:37.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1204e-05 2024-04-26T12:32:37.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.170982+0000", 2024-04-26T12:32:37.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2269999999999996e-06 2024-04-26T12:32:37.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171012+0000", 2024-04-26T12:32:37.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0778000000000002e-05 2024-04-26T12:32:37.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171019+0000", 2024-04-26T12:32:37.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0920000000000003e-06 2024-04-26T12:32:37.808 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.808 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.808 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.808 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37331 4.19 4.df98c259 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.809 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.205008+0000", 2024-04-26T12:32:37.809 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.563705189, 2024-04-26T12:32:37.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.57297947999999999, 2024-04-26T12:32:37.809 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.809 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37331 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.205008+0000", 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.205008+0000", 2024-04-26T12:32:37.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.205007+0000", 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.205045+0000", 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8500000000000001e-05 2024-04-26T12:32:37.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.205054+0000", 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8980000000000002e-06 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.205059+0000", 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1290000000000004e-06 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.205097+0000", 2024-04-26T12:32:37.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7452e-05 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.205105+0000", 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3569999999999998e-06 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37452 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.252261+0000", 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51645126699999999, 2024-04-26T12:32:37.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52576037499999995, 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37452 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.252261+0000", 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.252261+0000", 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.252261+0000", 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.252273+0000", 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2295e-05 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.252282+0000", 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8340000000000005e-06 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.252287+0000", 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3920000000000002e-06 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.252360+0000", 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2786000000000004e-05 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.252375+0000", 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5308999999999999e-05 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.817 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.818 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37526 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.818 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.279878+0000", 2024-04-26T12:32:37.818 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.488834714, 2024-04-26T12:32:37.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.49818020299999999, 2024-04-26T12:32:37.818 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.819 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.819 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37526 2024-04-26T12:32:37.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.819 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.279878+0000", 2024-04-26T12:32:37.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.279878+0000", 2024-04-26T12:32:37.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.279877+0000", 2024-04-26T12:32:37.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.279895+0000", 2024-04-26T12:32:37.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8277000000000001e-05 2024-04-26T12:32:37.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.279914+0000", 2024-04-26T12:32:37.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8252000000000001e-05 2024-04-26T12:32:37.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.279923+0000", 2024-04-26T12:32:37.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8770000000000005e-06 2024-04-26T12:32:37.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.279957+0000", 2024-04-26T12:32:37.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3213000000000002e-05 2024-04-26T12:32:37.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.279966+0000", 2024-04-26T12:32:37.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3910000000000004e-06 2024-04-26T12:32:37.825 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.826 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.826 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.826 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36964 4.f 4.4dc19b0f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.826 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119198+0000", 2024-04-26T12:32:37.827 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64951507200000003, 2024-04-26T12:32:37.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65889539100000005, 2024-04-26T12:32:37.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.827 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.828 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36964 2024-04-26T12:32:37.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.828 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119198+0000", 2024-04-26T12:32:37.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119198+0000", 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119197+0000", 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119212+0000", 2024-04-26T12:32:37.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4506e-05 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119218+0000", 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7000000000000002e-06 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3482999999999999e-05 2024-04-26T12:32:37.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122020+0000", 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027882440000000001 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122026+0000", 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9699999999999996e-06 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37128 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124383+0000", 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64432992200000005, 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65374655500000001, 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.832 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37128 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124383+0000", 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124383+0000", 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124383+0000", 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124390+0000", 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124393+0000", 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1039999999999998e-06 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124396+0000", 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.835e-06 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124426+0000", 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0490000000000001e-05 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124433+0000", 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2990000000000002e-06 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37173 4.15 4.c27a5b55 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137655+0000", 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.631057965, 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.64050907000000001, 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.836 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37173 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137655+0000", 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137655+0000", 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137654+0000", 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137677+0000", 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.2707000000000001e-05 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137682+0000", 2024-04-26T12:32:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.524e-06 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137686+0000", 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4910000000000001e-06 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137706+0000", 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.054e-05 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137710+0000", 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7019999999999999e-06 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37216 4.1c 4.f7421d9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.154801+0000", 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61391132599999998, 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62339847599999998, 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37216 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154801+0000", 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154801+0000", 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154801+0000", 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154812+0000", 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1327e-05 2024-04-26T12:32:37.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154827+0000", 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5413999999999998e-05 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154836+0000", 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2689999999999999e-06 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154886+0000", 2024-04-26T12:32:37.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0118999999999999e-05 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.154894+0000", 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5750000000000001e-06 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37409 4.3b 4.fa83033b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.844 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.236638+0000", 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.53207488700000005, 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.54159802999999995, 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37409 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.236638+0000", 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.236638+0000", 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.236637+0000", 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.236648+0000", 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0583e-05 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.236658+0000", 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0390999999999999e-05 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.236664+0000", 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.874e-06 2024-04-26T12:32:37.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.236699+0000", 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5031999999999999e-05 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.236705+0000", 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0599999999999996e-06 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37528 4.19 4.df98c259 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.280752+0000", 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.48796091200000002, 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.49754203800000002, 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37528 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.280752+0000", 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.280752+0000", 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.280751+0000", 2024-04-26T12:32:37.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.280762+0000", 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0648999999999999e-05 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.280773+0000", 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1139e-05 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.280778+0000", 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.626e-06 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.280817+0000", 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8339e-05 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.280822+0000", 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5509999999999999e-06 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.852 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36967 4.3b 4.fa83033b (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119237+0000", 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64947537099999997, 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65909492199999997, 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.853 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36967 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119237+0000", 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119237+0000", 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119237+0000", 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119277+0000", 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0395000000000002e-05 2024-04-26T12:32:37.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119284+0000", 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0740000000000004e-06 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119291+0000", 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4239999999999998e-06 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119913+0000", 2024-04-26T12:32:37.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062236699999999997 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119921+0000", 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6510000000000001e-06 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37035 4.37 4.54009ff7 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.857 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122956+0000", 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64575633499999996, 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65541257399999997, 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37035 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122956+0000", 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122956+0000", 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122956+0000", 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122971+0000", 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4823e-05 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9840000000000001e-06 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122985+0000", 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.088e-06 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123013+0000", 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8085e-05 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123017+0000", 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.968e-06 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.862 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37135 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.862 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124399+0000", 2024-04-26T12:32:37.862 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.64431366000000001, 2024-04-26T12:32:37.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.65400872799999998, 2024-04-26T12:32:37.862 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.862 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.862 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.862 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37135 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124399+0000", 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124399+0000", 2024-04-26T12:32:37.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124399+0000", 2024-04-26T12:32:37.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:37.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124405+0000", 2024-04-26T12:32:37.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1759999999999998e-06 2024-04-26T12:32:37.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124408+0000", 2024-04-26T12:32:37.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1039999999999998e-06 2024-04-26T12:32:37.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124411+0000", 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.689e-06 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124445+0000", 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4411e-05 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124448+0000", 2024-04-26T12:32:37.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1690000000000001e-06 2024-04-26T12:32:37.869 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.869 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.869 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.869 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37176 4.12 4.c58a7d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.869 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.138805+0000", 2024-04-26T12:32:37.869 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.62990748399999996, 2024-04-26T12:32:37.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.63963994599999996, 2024-04-26T12:32:37.870 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.870 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.870 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.870 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.870 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.870 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37176 2024-04-26T12:32:37.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.138805+0000", 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.138805+0000", 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.138805+0000", 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.138839+0000", 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4094000000000003e-05 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.138845+0000", 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9510000000000003e-06 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.138848+0000", 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5700000000000001e-06 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.138886+0000", 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.714e-05 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.138895+0000", 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6260000000000007e-06 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.873 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37217 4.12 4.c58a7d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.155114+0000", 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.61359892500000002, 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.62336936799999998, 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37217 2024-04-26T12:32:37.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155114+0000", 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155114+0000", 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155113+0000", 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155120+0000", 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8229999999999997e-06 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155126+0000", 2024-04-26T12:32:37.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2060000000000004e-06 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155130+0000", 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7139999999999999e-06 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155172+0000", 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1739999999999997e-05 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.155178+0000", 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1e-06 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37260 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.171580+0000", 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.597132624, 2024-04-26T12:32:37.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.60694078600000001, 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37260 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171580+0000", 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171580+0000", 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171579+0000", 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171606+0000", 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6585e-05 2024-04-26T12:32:37.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171616+0000", 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308e-05 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171628+0000", 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1678999999999999e-05 2024-04-26T12:32:37.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171657+0000", 2024-04-26T12:32:37.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9093000000000001e-05 2024-04-26T12:32:37.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.171662+0000", 2024-04-26T12:32:37.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9910000000000002e-06 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37300 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.189838+0000", 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.57887494299999998, 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.58873613899999999, 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37300 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.189838+0000", 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.189838+0000", 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.189837+0000", 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.189848+0000", 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1066999999999999e-05 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.189859+0000", 2024-04-26T12:32:37.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1221e-05 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.189866+0000", 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7390000000000002e-06 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.189906+0000", 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0120999999999998e-05 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.189915+0000", 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0229999999999998e-06 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37455 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.253525+0000", 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.51518775100000003, 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.52508553899999999, 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for peered", 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:37.887 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37455 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253525+0000", 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253525+0000", 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253524+0000", 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253536+0000", 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2160999999999999e-05 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253546+0000", 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0138e-05 2024-04-26T12:32:37.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253561+0000", 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4389000000000001e-05 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253606+0000", 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4870999999999998e-05 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.253615+0000", 2024-04-26T12:32:37.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1779999999999992e-06 2024-04-26T12:32:37.891 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.891 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:37.891 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.891 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:37.891 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:37.891 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 256 2024-04-26T12:32:37.891 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:37.892 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:32:37.893 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:37.891+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:37.893 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:37.893 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:37.894 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:37.895 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:37.895 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:37.895 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:37.896 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:37.896 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:37.998 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:37.998+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:38.094 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:38.093+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:38.095 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:38.095 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:38.113 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:38.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-26T12:32:38.195 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:38.194+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:38.296 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:38.295+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:38.358 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:38.358 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:38.367 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:38.396 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:38.396+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:38.497 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:38.496+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:38.545 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:38.545 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:38.558 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:38.599 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:38.598+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:38.700 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:38.700+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:38.753 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:38.753 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:38.766 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:38.810 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:38.809+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:38.902 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:38.902+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:38.936 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:38.937 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:38.948 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:39.003 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:39.002+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:39.104 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:39.103+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:39.145 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:39.145 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:39.159 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:39.180 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:32:39.205 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:39.205+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:39.306 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:39.305+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:39.355 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:39.355 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:39.371 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:39.406 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:39.406+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:39.508 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:39.507+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:39.596 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:39.596 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:39.610 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:39.610 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:39.609+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:39.711 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:39.710+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:39.775 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:39.776 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:39.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:39.811 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:39.811+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:39.897 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:39.912 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:39.912+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:39.993 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:39.993 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:40.009 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:40.051 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:40.050+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:40.098 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:40.114 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:40.113+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:40.121 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:40.121 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:40.121 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:40.121 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:40.124 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:40.125 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:40.216 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:40.215+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:40.218 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:40.218 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:40.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:40.218 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:40.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.218 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:40.218 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.1410973779999996, 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:40.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:32:40.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:32:40.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.1340232290000003, 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.226 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:32:40.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.232 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.1268617489999997, 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:32:40.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:40.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.1264731460000004, 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:32:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:32:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.126143441, 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:32:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.1243008750000003, 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:32:40.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.1199481699999998, 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.257 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:32:40.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:32:40.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:32:40.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0962625389999996, 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:32:40.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0961148139999999, 2024-04-26T12:32:40.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:40.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:32:40.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.275 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0960577300000001, 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.276 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:32:40.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.096030453, 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.281 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.282 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:32:40.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:32:40.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0959887569999998, 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.287 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:32:40.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:32:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.292 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0959425219999996, 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.293 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:32:40.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:32:40.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.095909238, 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:40.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0958791640000003, 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.304 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0958429000000001, 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.310 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:40.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:32:40.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.315 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0957884289999997, 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:32:40.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0957630209999998, 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:32:40.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:40.327 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0957391919999999, 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:32:40.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:32:40.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:32:40.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:32:40.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:32:40.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:32:40.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4.0915908720000003, 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.334 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:32:40.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:40.339 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:40.340 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:40.340+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:40.341 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:40.441 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:40.441+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:40.523 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:40.523 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:40.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.523 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:47223 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 1191936~4096 in=4096b,write 1355776~4096 in=4096b,write 1597440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:40.523 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:40.515933+0000", 2024-04-26T12:32:40.523 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.006116883, 2024-04-26T12:32:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061460710000000003, 2024-04-26T12:32:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 47223 2024-04-26T12:32:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.524 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.515933+0000", 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.515933+0000", 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.515933+0000", 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.515946+0000", 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3322999999999999e-05 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.515952+0000", 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.515955+0000", 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7459999999999998e-06 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.518173+0000", 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022174410000000001 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.518253+0000", 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0149999999999997e-05 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:47226 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2478080~4096 in=4096b,write 2494464~4096 in=4096b,write 2662400~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:40.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:40.517834+0000", 2024-04-26T12:32:40.529 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.004215941, 2024-04-26T12:32:40.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004343787, 2024-04-26T12:32:40.529 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.529 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:40.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 47226 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.517834+0000", 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.517834+0000", 2024-04-26T12:32:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.517834+0000", 2024-04-26T12:32:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.517846+0000", 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2754e-05 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.517855+0000", 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9979999999999992e-06 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.517862+0000", 2024-04-26T12:32:40.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5390000000000004e-06 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.517904+0000", 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2361000000000003e-05 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.517993+0000", 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8490000000000001e-05 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:47229 4.25 e66/13 4:a76ff001:::100000001f8.0000002b:head v 66'742, mlcod=66'739)", 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:40.519770+0000", 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.002280051, 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002490295, 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519770+0000", 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519770+0000", 2024-04-26T12:32:40.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519770+0000", 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519790+0000", 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0268999999999999e-05 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519801+0000", 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0954999999999999e-05 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519808+0000", 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6839999999999999e-06 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519845+0000", 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7561999999999997e-05 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519861+0000", 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6334e-05 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.538 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:47230 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3100672~4096 in=4096b,write 3268608~4096 in=4096b,write 3317760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:40.538 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:40.519810+0000", 2024-04-26T12:32:40.538 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0022406570000000001, 2024-04-26T12:32:40.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025152680000000002, 2024-04-26T12:32:40.538 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.538 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 47230 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519810+0000", 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519810+0000", 2024-04-26T12:32:40.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519809+0000", 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519820+0000", 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1351e-05 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519830+0000", 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8749999999999995e-06 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519838+0000", 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7360000000000001e-06 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519875+0000", 2024-04-26T12:32:40.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6758999999999998e-05 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.519925+0000", 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0207000000000002e-05 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.542 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:47231 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3633152~4096 in=4096b,write 3661824~4096 in=4096b,write 3694592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:40.520235+0000", 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001815515, 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002160389, 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 47231 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.520235+0000", 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.520235+0000", 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.520234+0000", 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.520253+0000", 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9270999999999999e-05 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.520264+0000", 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0910999999999999e-05 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.520271+0000", 2024-04-26T12:32:40.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1130000000000003e-06 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521915+0000", 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0016439460000000001 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521969+0000", 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4073999999999998e-05 2024-04-26T12:32:40.546 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:47233 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3502080~4096 in=4096b,write 3629056~4096 in=4096b,write 3657728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:40.521423+0000", 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00062712, 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001040193, 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.547 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 47233 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521423+0000", 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521423+0000", 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521423+0000", 2024-04-26T12:32:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521432+0000", 2024-04-26T12:32:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8789999999999998e-06 2024-04-26T12:32:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521440+0000", 2024-04-26T12:32:40.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4710000000000001e-06 2024-04-26T12:32:40.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521445+0000", 2024-04-26T12:32:40.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.361e-06 2024-04-26T12:32:40.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521480+0000", 2024-04-26T12:32:40.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5094e-05 2024-04-26T12:32:40.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521533+0000", 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2369e-05 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.552 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:47234 4.19 4:997b7129:::100000001f8.00000000:head [write 667648~4096 in=4096b,write 790528~4096 in=4096b,write 802816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:40.521927+0000", 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.000123189, 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060345500000000003, 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 47234 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521927+0000", 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521927+0000", 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521926+0000", 2024-04-26T12:32:40.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521938+0000", 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1943000000000001e-05 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521947+0000", 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2949999999999999e-06 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521954+0000", 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8680000000000001e-06 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.521998+0000", 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4175999999999999e-05 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:40.522052+0000", 2024-04-26T12:32:40.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3749999999999999e-05 2024-04-26T12:32:40.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.557 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.557 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:40.557 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 7 2024-04-26T12:32:40.557 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:40.558 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:40.559 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:40.557+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:40.659 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:40.659+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:40.738 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:32:40.748 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:40.748 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:40.749 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:40.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:40.798 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:40.798+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:40.848 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-26T12:32:40.861 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:40.861+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:40.934 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:40.934 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:40.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:40.934 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:40.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.934 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.934 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:40.934 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8111510319999997, 2024-04-26T12:32:40.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:32:40.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:32:40.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:32:40.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:32:40.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:32:40.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:32:40.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.940 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8110228189999997, 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:32:40.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8109109349999999, 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.945 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:40.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:40.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:40.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:32:40.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:32:40.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:32:40.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:32:40.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:32:40.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:32:40.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:32:40.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:32:40.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:32:40.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:32:40.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:32:40.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:32:40.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:40.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:32:40.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:32:40.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.954 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.954 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.955 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.955 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:40.955 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8108935810000002, 2024-04-26T12:32:40.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:32:40.955 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.955 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.955 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.956 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.956 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.956 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:32:40.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.956 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:40.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:40.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:40.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:32:40.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:32:40.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:32:40.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:32:40.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:32:40.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:32:40.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:32:40.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:32:40.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:40.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:32:40.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:32:40.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:32:40.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:40.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:32:40.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:32:40.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.964 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.964 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.964 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.965 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:40.965 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8108466219999997, 2024-04-26T12:32:40.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:32:40.965 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.965 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.965 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.966 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.966 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:32:40.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.966 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:40.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:40.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:40.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:32:40.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:32:40.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:32:40.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:32:40.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:40.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:32:40.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.971 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.971 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:32:40.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:32:40.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:32:40.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:32:40.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:32:40.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:32:40.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:40.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:32:40.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:32:40.974 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.974 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.974 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.975 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.975 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:40.975 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8108266359999998, 2024-04-26T12:32:40.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:32:40.976 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.976 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.976 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.976 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:32:40.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.977 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:40.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:40.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:40.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:40.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:32:40.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:32:40.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:32:40.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:32:40.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:32:40.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:32:40.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:32:40.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:32:40.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:32:40.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.982 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8107722969999998, 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:40.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:32:40.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8079018390000003, 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:32:40.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:32:40.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:40.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:40.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8068908310000005, 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.993 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:40.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:40.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:32:40.998 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8067905270000004, 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:32:40.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:41.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8066557799999998, 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.005 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8063347820000004, 2024-04-26T12:32:41.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:32:41.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:32:41.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:32:41.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8058425170000003, 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:32:41.017 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:32:41.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:32:41.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:32:41.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8057496249999998, 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:32:41.024 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:32:41.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:32:41.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:32:41.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8056411839999997, 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.031 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:32:41.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.037 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.037 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.037 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.037 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:41.037 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8054580549999999, 2024-04-26T12:32:41.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:32:41.038 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.038 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.038 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.038 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.038 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.038 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:32:41.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.038 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:41.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:41.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:32:41.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:41.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:32:41.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:32:41.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:32:41.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:32:41.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:32:41.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:32:41.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:32:41.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:32:41.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:32:41.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:32:41.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:32:41.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:32:41.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:32:41.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:32:41.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8054392469999998, 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:32:41.046 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:32:41.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.8037803910000001, 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.052 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.053 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:32:41.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:32:41.057 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.795467886, 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.058 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:32:41.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4.7924781330000004, 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.069 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:41.071 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:41.072 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:41.070+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:41.171 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:41.171+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:41.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:32:41.235 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:48635 4.13 4:caef1406:::100000001f8.00000031:head [write 1773568~4096 in=4096b,write 1798144~4096 in=4096b,write 2330624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:41.232827+0000", 2024-04-26T12:32:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0020837820000000002, 2024-04-26T12:32:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0021058890000000001, 2024-04-26T12:32:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.235 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 48635 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.232827+0000", 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.232827+0000", 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.232826+0000", 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.232835+0000", 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7159999999999992e-06 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.232841+0000", 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6189999999999996e-06 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.232845+0000", 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9689999999999996e-06 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.232877+0000", 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1254999999999998e-05 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.232924+0000", 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7552000000000001e-05 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.233022+0000", 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7921e-05 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.239 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:48637 4.13 4:caef1406:::100000001f8.00000031:head [write 794624~4096 in=4096b,write 847872~4096 in=4096b,write 946176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:41.233964+0000", 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00094650799999999998, 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0010300470000000001, 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 48637 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.233964+0000", 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.233964+0000", 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.233963+0000", 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.233973+0000", 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7170000000000003e-06 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.233982+0000", 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1719999999999996e-06 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.233988+0000", 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5219999999999998e-06 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.234019+0000", 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1636e-05 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.234063+0000", 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3798000000000003e-05 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.234147+0000", 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4347999999999999e-05 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.243 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop_reply(client.4532.0:48631 4.13 e66/13)", 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:41.234411+0000", 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.000498994, 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000622706, 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "queued for pg", 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.234411+0000", 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.234411+0000", 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.234411+0000", 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.234414+0000", 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.234422+0000", 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.605e-06 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.234426+0000", 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5850000000000001e-06 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:48631 4.13 4:caef1406:::100000001f8.00000031:head [write 3760128~4096 in=4096b,write 3792896~4096 in=4096b,write 3813376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:41.230631+0000", 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0042790199999999997, 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0044331209999999999, 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 48631 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.230631+0000", 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.230631+0000", 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.230631+0000", 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.230648+0000", 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7147999999999999e-05 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.230658+0000", 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0694e-05 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.230665+0000", 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8340000000000001e-06 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.230696+0000", 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0913e-05 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.230747+0000", 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0659999999999999e-05 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.230835+0000", 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8467000000000005e-05 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:41.231834+0000", 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0009987310000000001 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 4 2024-04-26T12:32:41.251 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:41.252 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:41.272 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:41.272+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:41.373 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:41.373+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:41.420 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:41.420 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:41.420 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:41.420 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:41.420 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:41.434 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:41.474 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:41.474+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:41.575 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:41.574+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:41.605 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:41.605 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:41.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.5280376789999996, 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:32:41.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.607 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:41.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:32:41.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:32:41.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:32:41.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:41.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:32:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.5209635299999995, 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.613 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:32:41.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:32:41.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:32:41.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:41.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:32:41.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:32:41.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:32:41.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.5138020499999998, 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.620 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:32:41.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.5134134469999996, 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:32:41.626 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:32:41.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:32:41.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:32:41.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.5130837420000001, 2024-04-26T12:32:41.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:32:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:32:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:32:41.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:41.638 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.5112411760000004, 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:32:41.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.644 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.5068884709999999, 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:32:41.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:32:41.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.650 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4832028399999997, 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.651 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.483055115, 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:32:41.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:32:41.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:32:41.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:32:41.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:32:41.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4829980310000002, 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.663 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.665 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:32:41.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4829707540000001, 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.669 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:32:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:32:41.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:32:41.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4829290579999999, 2024-04-26T12:32:41.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:32:41.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:32:41.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:32:41.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4828828229999997, 2024-04-26T12:32:41.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.683 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.482849539, 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.687 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:32:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:32:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4828194650000004, 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.693 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:41.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:32:41.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:32:41.696 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.698 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4827832010000002, 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.699 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:32:41.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:32:41.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:41.704 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4827287299999998, 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:32:41.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:32:41.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4827033219999999, 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:32:41.710 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:32:41.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:32:41.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.716 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.482679493, 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.717 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:32:41.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.722 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 5.4785311730000004, 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.723 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:32:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:32:41.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:41.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:41.728 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:41.730 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:41.729+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:41.730 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:41.830 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:41.830+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:41.912 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:41.912 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:50193 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2609152~4096 in=4096b,write 3035136~4096 in=4096b,write 3092480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.905205+0000", 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0061164169999999999, 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061486930000000002, 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50193 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.905205+0000", 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.905205+0000", 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.905205+0000", 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.905238+0000", 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3101e-05 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.905257+0000", 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9729999999999999e-05 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.905265+0000", 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7510000000000008e-06 2024-04-26T12:32:41.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906376+0000", 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00111126 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906425+0000", 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8692000000000001e-05 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.916 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:50195 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3219456~4096 in=4096b,write 3264512~4096 in=4096b,write 3690496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.905989+0000", 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0053324310000000003, 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054489100000000004, 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50195 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.905989+0000", 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.905989+0000", 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.905989+0000", 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906006+0000", 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7606000000000001e-05 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906017+0000", 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0589e-05 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906029+0000", 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2292e-05 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906361+0000", 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00033195700000000002 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906410+0000", 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9236000000000001e-05 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:50196 4.8 e66/52 4:11ee3b64:::100000001f8.0000003e:head v 66'803, mlcod=66'801)", 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.906787+0000", 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0045344039999999997, 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0047258609999999996, 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.921 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906787+0000", 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906787+0000", 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906787+0000", 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906810+0000", 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.3105999999999999e-05 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906817+0000", 2024-04-26T12:32:41.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3649999999999998e-06 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906823+0000", 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.959e-06 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.907287+0000", 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000463645 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.907299+0000", 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2303000000000001e-05 2024-04-26T12:32:41.924 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:50197 4.23 4:c6f90462:::100000001f8.00000037:head [write 3244032~4096 in=4096b,write 3428352~4096 in=4096b,write 3436544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.906831+0000", 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0044903490000000002, 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0047498150000000001, 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50197 2024-04-26T12:32:41.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906831+0000", 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906831+0000", 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906831+0000", 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906843+0000", 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1873e-05 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906854+0000", 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1428e-05 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906859+0000", 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1290000000000004e-06 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906901+0000", 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1953000000000003e-05 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.906976+0000", 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4793e-05 2024-04-26T12:32:41.928 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:50198 4.13 e66/13 4:caef1406:::100000001f8.00000031:head v 66'1585, mlcod=66'1582)", 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.908167+0000", 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.003154862, 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034695540000000001, 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908167+0000", 2024-04-26T12:32:41.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908167+0000", 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908166+0000", 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908186+0000", 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9672000000000001e-05 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908194+0000", 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9880000000000004e-06 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908200+0000", 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3400000000000003e-06 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908226+0000", 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5698999999999999e-05 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908238+0000", 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1892999999999999e-05 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:50199 4.28 4:15eeb89b:::100000001f8.00000032:head [write 245760~4096 in=4096b,write 311296~4096 in=4096b,write 483328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.908290+0000", 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0030316940000000001, 2024-04-26T12:32:41.932 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003383437, 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50199 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908290+0000", 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.933 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908290+0000", 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908289+0000", 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908304+0000", 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4737e-05 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.934 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908316+0000", 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1623999999999999e-05 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908322+0000", 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6590000000000001e-06 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908352+0000", 2024-04-26T12:32:41.935 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9465999999999999e-05 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.908408+0000", 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6354000000000003e-05 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:50201 4.15 4:aada5e43:::100000001f8.00000028:head [write 2682880~4096 in=4096b,write 2723840~4096 in=4096b,write 2842624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.909426+0000", 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0018953100000000001, 2024-04-26T12:32:41.936 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022872449999999998, 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50201 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.909426+0000", 2024-04-26T12:32:41.937 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.909426+0000", 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.909426+0000", 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.938 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.909436+0000", 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0166999999999999e-05 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.909444+0000", 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1790000000000008e-06 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.939 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.909450+0000", 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6250000000000004e-06 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.909484+0000", 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3759e-05 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.909541+0000", 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7095000000000001e-05 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.940 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:50202 4.28 4:15eeb89b:::100000001f8.00000032:head [write 995328~4096 in=4096b,write 1155072~4096 in=4096b,write 1175552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.910162+0000", 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0011598089999999999, 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001593615, 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50202 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.941 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910162+0000", 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910162+0000", 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910161+0000", 2024-04-26T12:32:41.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910175+0000", 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3871e-05 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910190+0000", 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5430999999999998e-05 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910201+0000", 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1075e-05 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910298+0000", 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6652999999999998e-05 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910368+0000", 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9657000000000001e-05 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.944 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:50203 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3936256~4096 in=4096b,write 3948544~4096 in=4096b,write 4067328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.910303+0000", 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0010189520000000001, 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014925680000000001, 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.945 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50203 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910303+0000", 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910303+0000", 2024-04-26T12:32:41.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910302+0000", 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910316+0000", 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3451e-05 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910325+0000", 2024-04-26T12:32:41.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1290000000000002e-06 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910332+0000", 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910502+0000", 2024-04-26T12:32:41.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016993499999999999 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.910578+0000", 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6647e-05 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:50205 4.25 e66/13 4:a76ff001:::100000001f8.0000002b:head v 66'783, mlcod=66'781)", 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.911425+0000", 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9998965, 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040794900000000001, 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.911425+0000", 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.911425+0000", 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.911425+0000", 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.911440+0000", 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5461e-05 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.911451+0000", 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0369e-05 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.911457+0000", 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6710000000000002e-06 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.911486+0000", 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8442e-05 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.911500+0000", 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3959e-05 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:50188 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2637824~4096 in=4096b,write 2736128~4096 in=4096b,write 2994176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:41.903366+0000", 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0079562409999999993, 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0085048139999999994, 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 50188 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:41.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.903366+0000", 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.903366+0000", 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.903365+0000", 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.903392+0000", 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7546e-05 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.903402+0000", 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2629999999999992e-06 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.903408+0000", 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5169999999999996e-06 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.903537+0000", 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012915600000000001 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:41.903608+0000", 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0333000000000006e-05 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:41.957 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 11 2024-04-26T12:32:41.958 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:41.959 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:41.958+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:41.959 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:42.059 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:42.059+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:42.126 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:42.160 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:42.160+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:42.165 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:42.165 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:42.165 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:42.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:42.165 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:42.182 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:42.188 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:32:42.261 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:42.260+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:42.333 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:42.357 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:42.357 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:42.357 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:42.358 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:42.361 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:42.361 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:42.362 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:42.361+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:42.370 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:42.370 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:42.387 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:42.464 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:42.463+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:42.555 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:42.555 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:42.564 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:42.564+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:42.569 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:42.665 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:42.665+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:42.738 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:42.738 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:42.753 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:42.796 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:42.796+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:42.867 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:42.867+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:42.921 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:42.921 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:42.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:42.980 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:42.980+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:43.069 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:43.069+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:43.112 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:43.113 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:43.123 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:43.169 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:43.169+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:43.271 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:43.271+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:43.338 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:43.339 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:43.353 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:43.394 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:43.394+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:43.472 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:43.472+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:43.569 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:43.569 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:43.573 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:43.572+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:43.585 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:43.674 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:43.674+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:43.757 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:43.757 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:43.770 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:43.813 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:43.813+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:43.875 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:43.874+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:43.939 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:43.940 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:43.954 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:43.976 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:43.976+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:44.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~7s 2024-04-26T12:32:44.077 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:44.077+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:44.148 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:44.148 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:44.161 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:44.206 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:44.205+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:44.207 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:32:44.279 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:44.278+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:44.347 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:44.347 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:44.362 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:44.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:44.405 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:44.405+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:44.481 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:44.481+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:44.561 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:44.581 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:44.581+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:44.585 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:44.585 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:44.585 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:44.586 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:44.587 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:44.587 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:44.587 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:44.589 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:44.589 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:44.600 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:44.682 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:44.681+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:44.783 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:44.782+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:44.824 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:44.824 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7030887680000006, 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.825 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:32:44.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7029605550000007, 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.830 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:32:44.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.834 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.837 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.837 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.837 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7028486709999999, 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:44.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:32:44.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7028313169999993, 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:32:44.842 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:32:44.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:32:44.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7027843580000006, 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:32:44.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:32:44.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7027643720000007, 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:32:44.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:32:44.855 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.7027100330000007, 2024-04-26T12:32:44.856 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.857 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:32:44.858 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.859 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.860 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6998395750000004, 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.861 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.862 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.863 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.864 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.865 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.866 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6988285669999996, 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.867 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.868 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:32:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:32:44.870 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:32:44.871 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6987282629999996, 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.872 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.873 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.874 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.875 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.876 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6985935160000007, 2024-04-26T12:32:44.877 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.878 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.879 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.880 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.881 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.882 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6982725179999996, 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.883 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.884 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.885 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.886 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.887 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6977802529999995, 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.888 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.889 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.890 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.891 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.892 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.893 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6976873609999998, 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.894 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.895 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.896 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.897 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.898 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.899 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6975789199999998, 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.900 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:32:44.901 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:32:44.902 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.903 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.904 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6973957909999999, 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.905 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:44.906 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:32:44.907 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.908 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.909 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.910 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6973769829999998, 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.911 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:32:44.912 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.913 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.914 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.915 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6957181269999992, 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.916 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:44.917 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:32:44.918 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:32:44.919 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:32:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.687405622, 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.921 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.922 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:32:44.923 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.924 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.925 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.926 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 8.6844158690000004, 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.927 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:44.928 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:32:44.929 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:32:44.930 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:32:44.931 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:32:44.932 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.932 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.932 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.932 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:44.932 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:44.932 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:44.932 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:32:44.943 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:44.944 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:44.942+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:45.042 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-26T12:32:45.043 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:45.042+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:45.108 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:45.108 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:45.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.108 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:56851 4.2c 4:36128e15:::100000001f8.00000008:head [write 303104~4096 in=4096b,write 385024~4096 in=4096b,write 393216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:32:45.108 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:45.106887+0000", 2024-04-26T12:32:45.108 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00057531599999999998, 2024-04-26T12:32:45.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00059811, 2024-04-26T12:32:45.108 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 56851 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106887+0000", 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106887+0000", 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106886+0000", 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106902+0000", 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5318000000000001e-05 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106915+0000", 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3225e-05 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106922+0000", 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2450000000000001e-06 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106967+0000", 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4780000000000002e-05 2024-04-26T12:32:45.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.107047+0000", 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9901999999999995e-05 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:56847 4.34 4:2d2c9530:::100000001f8.00000036:head [write 2670592~4096 in=4096b,write 2691072~4096 in=4096b,write 2703360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:45.105268+0000", 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.002194054, 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002265876, 2024-04-26T12:32:45.112 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 56847 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105268+0000", 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105268+0000", 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105267+0000", 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105281+0000", 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3461e-05 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105293+0000", 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1836e-05 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105301+0000", 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1510000000000004e-06 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105330+0000", 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9017e-05 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105376+0000", 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6383e-05 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105461+0000", 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4806000000000001e-05 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.107501+0000", 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0020400829999999998 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:56848 4.27 4:e68799fb:::100000001f8.00000018:head [write 585728~4096 in=4096b,write 815104~4096 in=4096b,write 823296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:45.105633+0000", 2024-04-26T12:32:45.117 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00182906, 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001949281, 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 56848 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105633+0000", 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105633+0000", 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105633+0000", 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105646+0000", 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3234999999999999e-05 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105654+0000", 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3170000000000002e-06 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105659+0000", 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0830000000000003e-06 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105687+0000", 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7645e-05 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105735+0000", 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7818999999999997e-05 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.105822+0000", 2024-04-26T12:32:45.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7202999999999998e-05 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:56849 4.29 4:94178d8a:::100000001f8.00000006:head [write 491520~4096 in=4096b,write 512000~4096 in=4096b,write 618496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:45.106083+0000", 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0013792019999999999, 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015494479999999999, 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.122 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 56849 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106083+0000", 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106083+0000", 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106083+0000", 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106095+0000", 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2448e-05 2024-04-26T12:32:45.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106101+0000", 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4759999999999997e-06 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106104+0000", 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.49e-06 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106134+0000", 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0094e-05 2024-04-26T12:32:45.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:45.106183+0000", 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8863000000000003e-05 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 4 2024-04-26T12:32:45.126 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:45.127 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:45.143 INFO:teuthology.orchestra.console.smithi098:Power off completed 2024-04-26T12:32:45.173 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:45.172+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:45.246 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:45.246+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:45.290 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:45.290 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:45.290 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:45.290 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:45.290 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:45.304 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:45.346 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:45.346+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:45.447 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:45.447+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:45.520 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:45.521 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:45.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:45.521 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:45.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.521 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:45.522 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:45.522 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.4430283450000001, 2024-04-26T12:32:45.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:32:45.522 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.522 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:45.522 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.523 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.523 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.523 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:32:45.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.523 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:45.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:45.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:32:45.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:32:45.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:32:45.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:32:45.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:32:45.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:32:45.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:32:45.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:32:45.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.530 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.4359541960000008, 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:32:45.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:32:45.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.4287927160000002, 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:32:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.4284041129999991, 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:32:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:32:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:32:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.4280744080000005, 2024-04-26T12:32:45.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:32:45.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:32:45.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.426231842, 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:32:45.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:45.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.561 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.4218791369999995, 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:32:45.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:32:45.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.566 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3981935060000001, 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.568 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:45.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:32:45.573 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3980457810000004, 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.574 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:32:45.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:32:45.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:32:45.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:32:45.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:32:45.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:32:45.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:32:45.581 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.581 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.581 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.581 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.581 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:45.581 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3979886970000006, 2024-04-26T12:32:45.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:32:45.582 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.582 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.582 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.582 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.582 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.582 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:32:45.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.583 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:45.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:45.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:45.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:32:45.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.589 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3979614199999997, 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:32:45.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3979197239999994, 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:32:45.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3978734890000002, 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.601 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.602 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:32:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3978402049999996, 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:32:45.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:32:45.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:32:45.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:32:45.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.397810131, 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.613 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:32:45.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:32:45.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3977738669999997, 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.619 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:32:45.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3977193959999994, 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:32:45.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:32:45.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.630 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3976939880000003, 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:45.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3976701590000005, 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.636 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:32:45.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:32:45.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 9.3935218389999999, 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:45.642 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:32:45.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:32:45.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:32:45.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.647 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.648 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:45.648 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:45.648 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:45.649 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:45.649+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:45.650 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:32:45.650 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:45.750 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:45.749+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:45.824 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:58294 4.24 4:27adda6e:::100000001f8.0000000f:head [write 733184~4096 in=4096b,write 802816~4096 in=4096b,write 872448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T12:32:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:45.819932+0000", 2024-04-26T12:32:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0036101129999999999, 2024-04-26T12:32:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036400870000000002, 2024-04-26T12:32:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58294 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.819932+0000", 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:45.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.819932+0000", 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.819931+0000", 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.819941+0000", 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0185e-05 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.819951+0000", 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.819959+0000", 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.858e-06 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820004+0000", 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4468999999999997e-05 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820093+0000", 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9061999999999995e-05 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820257+0000", 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016460800000000001 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.822895+0000", 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026374279999999998 2024-04-26T12:32:45.828 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:58296 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1495040~4096 in=4096b,write 1523712~4096 in=4096b,write 1589248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:45.820804+0000", 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0027381139999999998, 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0028587840000000001, 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58296 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.829 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820804+0000", 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820804+0000", 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820803+0000", 2024-04-26T12:32:45.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820817+0000", 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.399e-05 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820833+0000", 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6351e-05 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820840+0000", 2024-04-26T12:32:45.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9600000000000003e-06 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820890+0000", 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9530000000000002e-05 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.820987+0000", 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6997999999999995e-05 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:45.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:58299 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 1269760~4096 in=4096b,write 1306624~4096 in=4096b,write 1363968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:45.822126+0000", 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0014160749999999999, 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0016213130000000001, 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 58299 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.822126+0000", 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.822126+0000", 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.822125+0000", 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.822137+0000", 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2125e-05 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.822147+0000", 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0189e-05 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.822155+0000", 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0309999999999998e-06 2024-04-26T12:32:45.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.822197+0000", 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1378000000000003e-05 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.822297+0000", 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000100598 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:58301 4.25 e68/13 4:a76ff001:::100000001f8.0000002b:head v 68'907, mlcod=68'905)", 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:45.823263+0000", 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.000278452, 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00055891800000000004, 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.823263+0000", 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.823263+0000", 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.823263+0000", 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.823277+0000", 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4559000000000001e-05 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.823293+0000", 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5483999999999999e-05 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.823298+0000", 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9010000000000002e-06 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.823328+0000", 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0131999999999999e-05 2024-04-26T12:32:45.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:45.823344+0000", 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6503000000000001e-05 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 4 2024-04-26T12:32:45.840 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:45.841 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:45.887 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:45.886+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:45.952 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:45.951+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:46.014 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:46.014 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:46.015 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:46.015 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:46.015 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:46.027 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:46.053 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:46.052+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:46.154 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:46.154+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:46.243 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.122228594999999, 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.244 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:32:46.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.122100381999999, 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:46.249 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:32:46.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:32:46.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:32:46.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.121988498, 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.254 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:32:46.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:32:46.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:32:46.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:32:46.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:32:46.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:32:46.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.258 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.258 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:32:46.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:32:46.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.121971144, 2024-04-26T12:32:46.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:32:46.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.265 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.121924184999999, 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.266 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.270 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.121904198999999, 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:32:46.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:32:46.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.121849859999999, 2024-04-26T12:32:46.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:32:46.276 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.276 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:46.276 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.276 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.277 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.281 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.118979402000001, 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.282 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:32:46.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:32:46.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:32:46.286 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.288 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.288 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:46.288 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.117968394, 2024-04-26T12:32:46.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:32:46.288 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.288 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.289 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.289 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.289 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.289 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:32:46.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.289 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:46.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:46.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:32:46.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:32:46.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:32:46.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:32:46.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:32:46.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:32:46.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:32:46.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:32:46.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:32:46.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:32:46.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:32:46.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:32:46.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:32:46.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:32:46.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:32:46.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:32:46.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:32:46.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:32:46.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:32:46.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:32:46.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:32:46.299 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.300 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.300 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.300 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.300 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:46.301 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.11786809, 2024-04-26T12:32:46.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:32:46.301 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.301 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.302 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:32:46.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.302 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:46.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:46.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:46.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:32:46.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:32:46.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:32:46.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:32:46.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:32:46.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:32:46.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:32:46.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:32:46.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:32:46.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:32:46.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:46.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:32:46.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:32:46.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:32:46.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:32:46.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:32:46.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:32:46.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:32:46.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:32:46.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:32:46.312 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.312 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.312 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.313 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.313 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:46.313 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.117733342999999, 2024-04-26T12:32:46.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:32:46.314 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.314 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.314 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.314 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.314 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.315 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:32:46.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.315 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:46.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:46.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:32:46.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:32:46.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:32:46.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:32:46.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:32:46.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:32:46.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:32:46.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:32:46.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:32:46.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:32:46.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:32:46.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:32:46.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:32:46.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:32:46.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:32:46.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:32:46.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:32:46.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:32:46.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:32:46.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.324 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.117412345, 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:46.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:46.330 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.11692008, 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:46.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:32:46.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:32:46.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:32:46.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:32:46.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:32:46.336 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.116827188, 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:32:46.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:32:46.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:32:46.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:32:46.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.116718747, 2024-04-26T12:32:46.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:32:46.344 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.344 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.344 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:32:46.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.344 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:46.349 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.116535618, 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:32:46.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.11651681, 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:32:46.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.114857954, 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.361 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:32:46.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:32:46.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:32:46.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.106545449, 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:32:46.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:32:46.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 10.103555696000001, 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:46.372 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:46.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.377 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.378 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.378 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:46.378 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:46.378 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:46.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:46.380 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:46.378+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:46.482 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:46.482+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:46.547 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:46.547 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:46.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:59772 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 3121152~4096 in=4096b,write 3436544~4096 in=4096b,write 3637248~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:46.544562+0000", 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0026269409999999998, 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0026490929999999999, 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 59772 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:46.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.544562+0000", 2024-04-26T12:32:46.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:46.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:46.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.544562+0000", 2024-04-26T12:32:46.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:46.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.544561+0000", 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.544576+0000", 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5350999999999999e-05 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.544586+0000", 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0328e-05 2024-04-26T12:32:46.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.544594+0000", 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.544640+0000", 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5689000000000003e-05 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.544729+0000", 2024-04-26T12:32:46.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9338000000000004e-05 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:59774 4.35 4:af28909f:::100000001f8.0000001b:head [write 3244032~4096 in=4096b,write 3317760~4096 in=4096b,write 3325952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:46.545630+0000", 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0015583560000000001, 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001628127, 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:46.552 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 59774 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.545630+0000", 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.545630+0000", 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.545629+0000", 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.545640+0000", 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1163e-05 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.545650+0000", 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8509999999999994e-06 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.545655+0000", 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9239999999999998e-06 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.545685+0000", 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0355e-05 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.545737+0000", 2024-04-26T12:32:46.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2015999999999998e-05 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:59775 4.d 4:b1164065:::100000001f8.00000035:head [write 2834432~4096 in=4096b,write 2916352~4096 in=4096b,write 2945024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:46.546263+0000", 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00092556300000000002, 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001035649, 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:46.556 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 59775 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.546263+0000", 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.546263+0000", 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:46.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.546262+0000", 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.546279+0000", 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6458000000000001e-05 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.546288+0000", 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7240000000000004e-06 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.546295+0000", 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6630000000000004e-06 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.546347+0000", 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1782e-05 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.546433+0000", 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6691000000000001e-05 2024-04-26T12:32:46.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:46.546576+0000", 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014307400000000001 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 3 2024-04-26T12:32:46.560 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:46.562 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:46.583 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:46.583+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:46.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:46.685 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:46.685+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:46.735 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:46.735 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:46.735 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:46.735 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:46.736 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:46.749 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:46.785 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:46.793 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:46.792+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:46.809 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:46.813 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:46.813 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:46.886 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:46.886+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:46.947 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:46.947 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:46.947 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:46.992 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:46.992+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:47.088 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:47.088+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:47.132 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:47.132 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:47.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:47.231 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:47.230+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:47.290 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:47.290+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:47.376 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:47.376 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:47.390 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:47.431 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:47.431+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:47.493 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:47.493+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:47.592 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:47.592+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:47.610 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:47.610 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:47.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:47.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:32:47.693 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:47.693+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:47.786 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:47.786 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:47.794 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:47.795+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:47.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:47.896 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:47.895+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:47.996 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:47.996+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:48.017 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:48.017 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:48.030 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:48.115 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:48.114+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:48.198 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:48.197+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:48.226 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:48.226 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:48.240 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:48.299 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:48.298+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:48.400 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:48.399+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:48.420 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:48.420 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:48.434 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:48.500 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:48.499+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:48.601 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:48.600+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:48.617 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:48.617 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:48.632 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:48.644 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:32:48.702 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:48.701+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:48.803 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:48.802+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:48.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:48.852 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:48.852 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:48.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:48.903 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:48.902+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:49.004 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:49.003+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:49.016 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:49.038 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:49.038 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:49.042 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:49.042 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:49.042 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:49.043 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:49.046 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:49.046 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:49.053 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:49.106 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:49.105+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:49.207 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:49.206+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:49.221 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:49.222 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:49.222 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:49.222 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:49.222 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:49.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:49.317 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:49.316+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:49.409 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:49.408+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:49.453 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:49.453 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:49.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:49.453 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:49.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.453 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:49.453 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:49.454 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.37547679, 2024-04-26T12:32:49.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:32:49.454 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.454 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:49.454 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.454 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.454 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.454 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:32:49.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.455 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:49.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:49.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:32:49.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:32:49.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:32:49.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:32:49.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:32:49.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:32:49.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:32:49.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:32:49.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:32:49.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:32:49.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:32:49.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:49.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:32:49.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:32:49.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:32:49.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:32:49.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:49.464 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.368402640999999, 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:49.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:49.470 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.361241161000001, 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:32:49.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.360852557999999, 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.477 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:49.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:49.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:32:49.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:32:49.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:32:49.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.360522852999999, 2024-04-26T12:32:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:32:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:32:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:32:49.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:32:49.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:32:49.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:32:49.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:32:49.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:32:49.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:32:49.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:32:49.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:32:49.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:32:49.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:32:49.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:49.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:32:49.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:32:49.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:32:49.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:32:49.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:32:49.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:32:49.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:32:49.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:32:49.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:32:49.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:32:49.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:32:49.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:32:49.495 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.495 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.495 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.496 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:49.496 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:49.496 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.358680287, 2024-04-26T12:32:49.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:32:49.496 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.496 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:49.496 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.496 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.496 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:32:49.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.354327582, 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:49.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:32:49.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330641951, 2024-04-26T12:32:49.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:49.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:32:49.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330494226000001, 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.515 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:49.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:32:49.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:32:49.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330437141999999, 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.521 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:32:49.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:32:49.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:32:49.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330409865, 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.527 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:32:49.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:32:49.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.532 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330368169, 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:32:49.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:32:49.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:32:49.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:32:49.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:32:49.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.539 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:49.541 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330321934000001, 2024-04-26T12:32:49.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:32:49.541 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.541 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.541 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:32:49.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:32:49.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.547 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.33028865, 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:32:49.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:32:49.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:49.553 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330258576, 2024-04-26T12:32:49.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:32:49.554 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.554 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.554 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.554 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.554 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.554 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:32:49.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.555 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:49.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:49.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:49.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:32:49.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:32:49.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.558 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.558 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:32:49.558 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:32:49.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.559 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.559 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:32:49.559 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:32:49.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:32:49.560 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:32:49.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.560 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.560 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:32:49.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:32:49.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.561 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.561 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:32:49.561 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:32:49.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.562 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.562 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:32:49.562 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:32:49.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.563 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:32:49.563 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:32:49.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.563 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:32:49.564 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:32:49.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.564 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.564 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:32:49.565 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:32:49.565 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.565 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.565 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.566 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.566 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:49.566 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330222312, 2024-04-26T12:32:49.566 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:32:49.566 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.566 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.566 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.567 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.567 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.567 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:32:49.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.567 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:49.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.568 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.568 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:49.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:49.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:32:49.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:32:49.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:32:49.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:32:49.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:32:49.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:49.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:32:49.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:32:49.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.573 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.573 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:32:49.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:32:49.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:32:49.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:32:49.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:32:49.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:32:49.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:32:49.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:32:49.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:32:49.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:32:49.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.577 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.577 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:32:49.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:32:49.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.578 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.578 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.578 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.578 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:49.578 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330167841, 2024-04-26T12:32:49.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:32:49.579 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.579 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.579 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.579 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.579 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.579 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:32:49.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.579 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:49.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:49.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.581 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.581 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:32:49.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:32:49.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:32:49.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.585 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:32:49.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:32:49.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:32:49.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:32:49.587 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.587 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.587 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.587 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.587 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:49.587 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330142433000001, 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:49.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:32:49.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:32:49.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:32:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.593 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.330118604000001, 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:49.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:49.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:49.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:32:49.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:32:49.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:32:49.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:32:49.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.598 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.598 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:32:49.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:32:49.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:32:49.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:32:49.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.601 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 13.325970284, 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:49.602 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:32:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:49.606 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:32:49.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:49.608 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:49.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:49.610 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:49.608+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:49.710 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:49.709+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:49.787 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:49.787 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:49.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.787 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:66720 4.d e69/13 4:b1164065:::100000001f8.00000035:head v 69'1072, mlcod=69'1070)", 2024-04-26T12:32:49.787 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.781189+0000", 2024-04-26T12:32:49.787 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0046654879999999998, 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046851640000000003, 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.781189+0000", 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.781189+0000", 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.781188+0000", 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.781202+0000", 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3552e-05 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.781211+0000", 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7110000000000007e-06 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.781216+0000", 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.781269+0000", 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3043e-05 2024-04-26T12:32:49.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.781281+0000", 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2452e-05 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:66723 4.6 4:616d4c41:::100000001f8.00000034:head [write 200704~4096 in=4096b,write 221184~4096 in=4096b,write 253952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.782447+0000", 2024-04-26T12:32:49.791 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0034073979999999999, 2024-04-26T12:32:49.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034716590000000002, 2024-04-26T12:32:49.792 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.792 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:49.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:49.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:49.792 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.792 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66723 2024-04-26T12:32:49.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.782447+0000", 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.782447+0000", 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.782446+0000", 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.782456+0000", 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0278000000000001e-05 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.782470+0000", 2024-04-26T12:32:49.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3380999999999999e-05 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.782475+0000", 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4469999999999997e-06 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.782515+0000", 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0083999999999998e-05 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.782592+0000", 2024-04-26T12:32:49.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6673000000000003e-05 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:66725 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 3305472~4096 in=4096b,write 3575808~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.783293+0000", 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0025609740000000001, 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026703349999999998, 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.796 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66725 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783293+0000", 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783293+0000", 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783292+0000", 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783309+0000", 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6297e-05 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783325+0000", 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6375000000000002e-05 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783333+0000", 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3489999999999992e-06 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783606+0000", 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027211500000000002 2024-04-26T12:32:49.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783663+0000", 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7429999999999997e-05 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:66724 4.3d e69/13 4:bd3afb9d:::100000001f8.00000009:head v 69'2102, mlcod=69'2100)", 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.783379+0000", 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.002475082, 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002630702, 2024-04-26T12:32:49.800 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783379+0000", 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783379+0000", 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783378+0000", 2024-04-26T12:32:49.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783391+0000", 2024-04-26T12:32:49.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3013999999999999e-05 2024-04-26T12:32:49.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783402+0000", 2024-04-26T12:32:49.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0946e-05 2024-04-26T12:32:49.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783409+0000", 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2580000000000001e-06 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783443+0000", 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4561000000000003e-05 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783470+0000", 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6999999999999999e-05 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:66726 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2576384~4096 in=4096b,write 2830336~4096 in=4096b,write 2904064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.783842+0000", 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0020124539999999999, 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002236062, 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:49.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66726 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783842+0000", 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783842+0000", 2024-04-26T12:32:49.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783841+0000", 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783853+0000", 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2472e-05 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783865+0000", 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1949e-05 2024-04-26T12:32:49.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783872+0000", 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9020000000000002e-06 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783912+0000", 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0062999999999999e-05 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.783997+0000", 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4572000000000003e-05 2024-04-26T12:32:49.808 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:66727 4.28 4:15eeb89b:::100000001f8.00000032:head [write 24576~4096 in=4096b,write 61440~4096 in=4096b,write 98304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.784252+0000", 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0016025189999999999, 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001906018, 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:49.809 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66727 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784252+0000", 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784252+0000", 2024-04-26T12:32:49.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784251+0000", 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784264+0000", 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2663000000000001e-05 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784274+0000", 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0366e-05 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784284+0000", 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.91e-06 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784335+0000", 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1462999999999998e-05 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784423+0000", 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7756999999999993e-05 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:66728 4.6 4:63e80496:::100000001f8.0000001e:head [write 557056~4096 in=4096b,write 925696~4096 in=4096b,write 983040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.784611+0000", 2024-04-26T12:32:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001242815, 2024-04-26T12:32:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001625682, 2024-04-26T12:32:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66728 2024-04-26T12:32:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784611+0000", 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784611+0000", 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784611+0000", 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784623+0000", 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2468e-05 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784632+0000", 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2390000000000008e-06 2024-04-26T12:32:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784639+0000", 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1330000000000001e-06 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784683+0000", 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3729000000000001e-05 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.784779+0000", 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6099000000000003e-05 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:66732 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.786122+0000", 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9997325, 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020043400000000001, 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66732 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.786122+0000", 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.786122+0000", 2024-04-26T12:32:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.786121+0000", 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.786141+0000", 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0128000000000001e-05 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.786152+0000", 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0961999999999999e-05 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.786159+0000", 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.888e-06 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.822 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:66715 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2228224~4096 in=4096b,write 2244608~4096 in=4096b,write 2650112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:49.822 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.778402+0000", 2024-04-26T12:32:49.822 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.007452261, 2024-04-26T12:32:49.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079894800000000002, 2024-04-26T12:32:49.822 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.822 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:49.822 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:49.822 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:49.823 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.823 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66715 2024-04-26T12:32:49.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.823 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.778402+0000", 2024-04-26T12:32:49.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.778402+0000", 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.778401+0000", 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.778412+0000", 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0778000000000001e-05 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.778421+0000", 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0610000000000002e-06 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.778427+0000", 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4169999999999997e-06 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.778457+0000", 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9074e-05 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.778514+0000", 2024-04-26T12:32:49.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7765e-05 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.786113+0000", 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0075982419999999998 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:66718 4.15 4:aada5e43:::100000001f8.00000028:head [write 2048000~4096 in=4096b,write 2174976~4096 in=4096b,write 2195456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:49.779529+0000", 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0063246739999999997, 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069405109999999999, 2024-04-26T12:32:49.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 66718 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.779529+0000", 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.779529+0000", 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.779529+0000", 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.779540+0000", 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1365e-05 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.779550+0000", 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7610000000000002e-06 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:49.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.779556+0000", 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7350000000000001e-06 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.779586+0000", 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.991e-05 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:49.779635+0000", 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9733e-05 2024-04-26T12:32:49.831 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.832 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:49.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.832 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:49.832 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:49.832 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 10 2024-04-26T12:32:49.832 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:49.834 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:49.834 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:49.832+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:49.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~13s 2024-04-26T12:32:49.935 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:49.933+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:50.035 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:50.034+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:50.056 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:50.056 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:50.056 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:50.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:50.136 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:50.135+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:50.237 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:50.237+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:50.246 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T12:32:50.246 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-04-26T12:32:50.246 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T12:32:50.246 INFO:teuthology.orchestra.console.smithi098:Power on 2024-04-26T12:32:50.247 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T12:32:50.271 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2024-04-26T12:32:50.271 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:32:50.285 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:50.285 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:50.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:50.285 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:50.285 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.285 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.285 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:50.285 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.163457712, 2024-04-26T12:32:50.285 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.286 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.163329499, 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:32:50.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.295 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.163217615000001, 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:32:50.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.300 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.163200261, 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:32:50.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:32:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:32:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.163153302, 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.306 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:32:50.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:32:50.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.163133316, 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:50.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:32:50.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.163078977, 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:32:50.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:32:50.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.160208518999999, 2024-04-26T12:32:50.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.325 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.159197511, 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.326 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:32:50.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:32:50.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.331 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.159097207, 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.332 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:50.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:32:50.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.337 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.15896246, 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:32:50.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.158641462, 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.343 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:50.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:32:50.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:32:50.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.158149197, 2024-04-26T12:32:50.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.158056305000001, 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:32:50.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:32:50.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.157947864, 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:32:50.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:32:50.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:32:50.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:32:50.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:32:50.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.157764735000001, 2024-04-26T12:32:50.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:32:50.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.157745927000001, 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.373 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.378 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.156087071, 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:32:50.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:32:50.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.147774566000001, 2024-04-26T12:32:50.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:32:50.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:32:50.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:32:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:32:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 14.144784812999999, 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:32:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:50.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:50.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:50.395 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:50.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:50.398 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:50.395+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:50.399 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-26T12:32:50.498 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:50.497+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68348 4.13 4:cbf33e86:::100000001f8.00000026:head [write 3248128~4096 in=4096b,write 3407872~4096 in=4096b,write 3534848~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.561487+0000", 2024-04-26T12:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0047844230000000003, 2024-04-26T12:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0048037339999999996, 2024-04-26T12:32:50.568 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68348 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561487+0000", 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.569 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561487+0000", 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561486+0000", 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561500+0000", 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4294000000000001e-05 2024-04-26T12:32:50.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561510+0000", 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561516+0000", 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8539999999999999e-06 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.571 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562748+0000", 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0012317960000000001 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562817+0000", 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9215999999999996e-05 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562969+0000", 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000151643 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.572 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68351 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 516096~4096 in=4096b,write 1658880~4096 in=4096b,write 1687552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.562641+0000", 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.003630627, 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0037008729999999999, 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68351 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.573 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562641+0000", 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562641+0000", 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.574 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562640+0000", 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562653+0000", 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3302000000000001e-05 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562663+0000", 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0147e-05 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.575 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562671+0000", 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4830000000000002e-06 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562731+0000", 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0534e-05 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.562809+0000", 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7995000000000001e-05 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.576 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68352 4.27 4:e68799fb:::100000001f8.00000018:head [write 1163264~4096 in=4096b,write 1282048~4096 in=4096b,write 1335296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.563191+0000", 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0030802770000000002, 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0031907250000000002, 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68352 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563191+0000", 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563191+0000", 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563190+0000", 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563213+0000", 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3108999999999998e-05 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563223+0000", 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.013e-05 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563229+0000", 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5319999999999997e-06 2024-04-26T12:32:50.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563260+0000", 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1485000000000001e-05 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563310+0000", 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.922e-05 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563394+0000", 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4232000000000003e-05 2024-04-26T12:32:50.580 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68356 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1155072~4096 in=4096b,write 1249280~4096 in=4096b,write 1409024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.565013+0000", 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0012582050000000001, 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001411689, 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.581 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68356 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565013+0000", 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565013+0000", 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.582 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565012+0000", 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565030+0000", 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7589999999999999e-05 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565043+0000", 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3312999999999999e-05 2024-04-26T12:32:50.583 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565051+0000", 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1529999999999997e-06 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565084+0000", 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2668e-05 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565138+0000", 2024-04-26T12:32:50.584 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3924000000000001e-05 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68317 4.38 4:1dcf718c:::100000001f8.00000022:head [write 1667072~4096 in=4096b,write 1781760~4096 in=4096b,write 1888256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.549452+0000", 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.016818870999999999, 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017016791, 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.585 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68317 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549452+0000", 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549452+0000", 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.586 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549452+0000", 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549464+0000", 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2554e-05 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549475+0000", 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0507e-05 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.587 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549481+0000", 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8839999999999997e-06 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.551038+0000", 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015569799999999999 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.551106+0000", 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7905999999999997e-05 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68318 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 1478656~4096 in=4096b,write 1519616~4096 in=4096b,write 1568768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.549797+0000", 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.016474395999999999, 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016713326000000001, 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68318 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549797+0000", 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549797+0000", 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549796+0000", 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549809+0000", 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2758000000000001e-05 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549821+0000", 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.167e-05 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.549828+0000", 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6869999999999994e-06 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.551029+0000", 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0012010499999999999 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.551106+0000", 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6459999999999996e-05 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.551255+0000", 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014909499999999999 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.559696+0000", 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0084413070000000003 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.566422+0000", 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.006725951 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.566474+0000", 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1824999999999999e-05 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.593 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68320 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 442368~4096 in=4096b,write 557056~4096 in=4096b,write 667648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.550875+0000", 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.015396626, 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015698166, 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68320 2024-04-26T12:32:50.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.550875+0000", 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.550875+0000", 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.550874+0000", 2024-04-26T12:32:50.595 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.550885+0000", 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.098e-05 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.550891+0000", 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7270000000000001e-06 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.596 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.550897+0000", 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3700000000000003e-06 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.554763+0000", 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003865757 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.554835+0000", 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2032000000000004e-05 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.597 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68326 4.38 4:1fc350da:::100000001f8.0000002f:head [write 3096576~4096 in=4096b,write 3117056~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.552969+0000", 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.013302589, 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.013647865, 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68326 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.598 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.552969+0000", 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.552969+0000", 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.552968+0000", 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.552979+0000", 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1471000000000001e-05 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.552987+0000", 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8879999999999997e-06 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.552992+0000", 2024-04-26T12:32:50.600 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0939999999999998e-06 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.559691+0000", 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0066986839999999999 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.559780+0000", 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9289000000000005e-05 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68332 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 757760~4096 in=4096b,write 794624~4096 in=4096b,write 806912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.555174+0000", 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.011097589, 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011485446, 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68332 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.555174+0000", 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.555174+0000", 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.555173+0000", 2024-04-26T12:32:50.603 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.555185+0000", 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2553e-05 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.555197+0000", 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1459e-05 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.604 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.555204+0000", 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.798e-06 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561701+0000", 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0064976249999999999 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561788+0000", 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6833e-05 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68337 4.e 4:73e84e43:::100000001f8.00000004:head [write 1241088~4096 in=4096b,write 1654784~4096 in=4096b,write 1736704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.557785+0000", 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0084861889999999999, 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.008912873, 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68337 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.606 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.557785+0000", 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.557785+0000", 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.557784+0000", 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.557794+0000", 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4369999999999996e-06 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.557802+0000", 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3850000000000002e-06 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.557808+0000", 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4009999999999996e-06 2024-04-26T12:32:50.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.557834+0000", 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6726000000000001e-05 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.557881+0000", 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7119000000000001e-05 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.557977+0000", 2024-04-26T12:32:50.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5718999999999996e-05 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.564475+0000", 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.006498233 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68339 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 3731456~4096 in=4096b,write 3772416~4096 in=4096b,write 3874816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.558469+0000", 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0078023349999999997, 2024-04-26T12:32:50.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0082743379999999991, 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68339 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558469+0000", 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558469+0000", 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558469+0000", 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558487+0000", 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8101000000000002e-05 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558494+0000", 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2699999999999999e-06 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558500+0000", 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7289999999999997e-06 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563571+0000", 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050715389999999999 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563623+0000", 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1576999999999998e-05 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.563717+0000", 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4686999999999997e-05 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68340 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 1089536~4096 in=4096b,write 1122304~4096 in=4096b,write 1163264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.614 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.558802+0000", 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0074694009999999996, 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0079828989999999999, 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68340 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558802+0000", 2024-04-26T12:32:50.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558802+0000", 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558801+0000", 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558809+0000", 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5270000000000001e-06 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558814+0000", 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2429999999999996e-06 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558818+0000", 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.794e-06 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558881+0000", 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2879999999999994e-05 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.558938+0000", 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6823999999999997e-05 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68344 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 2596864~4096 in=4096b,write 2658304~4096 in=4096b,write 2723840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.618 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.560294+0000", 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0059776780000000002, 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065294439999999997, 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68344 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560294+0000", 2024-04-26T12:32:50.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560294+0000", 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560293+0000", 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560318+0000", 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5170000000000001e-05 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560327+0000", 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8370000000000003e-06 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560332+0000", 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2499999999999997e-06 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560373+0000", 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0593000000000003e-05 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560444+0000", 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1796000000000002e-05 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560587+0000", 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014254799999999999 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565241+0000", 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0046535750000000001 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68345 4.13 4:caef1406:::100000001f8.00000031:head [write 1187840~4096 in=4096b,write 1282048~4096 in=4096b,write 1363968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.560581+0000", 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0056898970000000002, 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062894029999999998, 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.623 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68345 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560581+0000", 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560581+0000", 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560581+0000", 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560591+0000", 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0774000000000001e-05 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560600+0000", 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4060000000000005e-06 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560605+0000", 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3129999999999998e-06 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561419+0000", 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00081400099999999996 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561464+0000", 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4972000000000002e-05 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.561575+0000", 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000110766 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.565803+0000", 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042284499999999999 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.627 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:68346 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 4169728~4096 in=4096b,write 4186112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:50.560938+0000", 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0053333679999999998, 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0059769799999999998, 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:50.628 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 68346 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560938+0000", 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560938+0000", 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560937+0000", 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560945+0000", 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.238e-06 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560957+0000", 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2629000000000001e-05 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.560961+0000", 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1289999999999998e-06 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.566429+0000", 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0054679289999999998 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:50.566485+0000", 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5371000000000002e-05 2024-04-26T12:32:50.631 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.632 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:50.632 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.632 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:50.632 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:50.632 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 15 2024-04-26T12:32:50.632 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:50.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:50.634 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:50.632+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:50.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:32:50.734 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:50.733+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:50.801 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:50.801 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:50.801 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:50.801 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:50.802 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:50.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:50.856 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:50.855+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:50.935 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:50.934+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:51.036 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:51.035+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.961423055999999, 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:32:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:32:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:32:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.954348907, 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:32:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:32:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:32:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:32:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:32:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:32:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.947187426999999, 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:32:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.946798824, 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:32:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:32:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.946469119, 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:32:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:32:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:32:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:32:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:32:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:32:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.944626552999999, 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:32:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:32:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:32:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:32:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.940273848, 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:32:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:32:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:32:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:32:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916588216999999, 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:32:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:32:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916440492, 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:32:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916383408, 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:32:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:32:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916356131000001, 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916314435, 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:32:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916268199999999, 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:32:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:32:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916234916000001, 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:32:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:32:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916204841999999, 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:32:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:32:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:32:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:32:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:32:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916168578000001, 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:32:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:32:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:32:51.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916114107, 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:32:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:32:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:32:51.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:32:51.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:32:51.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:32:51.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:32:51.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:32:51.148 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.148 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.148 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.149 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.149 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:51.149 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.916088698999999, 2024-04-26T12:32:51.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:32:51.149 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.149 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.149 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.150 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.150 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.150 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:32:51.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.150 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:51.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:51.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:51.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:32:51.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:32:51.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:32:51.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:32:51.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:32:51.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:32:51.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:32:51.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:32:51.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:32:51.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:32:51.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:32:51.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:32:51.159 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.159 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.159 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.91606487, 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.160 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.161 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:32:51.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.161 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:51.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:51.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:51.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:32:51.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:32:51.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:32:51.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:32:51.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:32:51.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:32:51.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:32:51.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:32:51.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:32:51.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:32:51.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:32:51.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:32:51.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:32:51.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:32:51.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:32:51.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:32:51.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:32:51.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:32:51.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:32:51.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:32:51.170 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.171 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.171 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.171 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:51.171 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:51.172 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 14.911916550000001, 2024-04-26T12:32:51.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:32:51.172 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:51.172 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:51.172 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:51.172 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:51.173 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.173 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:32:51.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.173 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:51.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:51.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:51.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:51.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:51.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:51.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:51.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:51.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:51.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:32:51.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:32:51.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:51.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:32:51.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:32:51.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:32:51.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:32:51.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:32:51.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:32:51.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:51.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:32:51.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:32:51.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:51.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:32:51.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:32:51.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:51.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:32:51.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:32:51.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:51.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:32:51.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:32:51.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:51.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:32:51.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:32:51.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:51.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:51.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:51.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:32:51.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:32:51.186 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.186 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:51.187 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:51.187 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:51.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:51.190 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:51.188+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:51.190 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:51.290 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:51.290+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:51.365 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:70125 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 540672~4096 in=4096b,write 552960~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:51.361324+0000", 2024-04-26T12:32:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0033497190000000001, 2024-04-26T12:32:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0033791540000000001, 2024-04-26T12:32:51.365 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 70125 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361324+0000", 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361324+0000", 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361324+0000", 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361338+0000", 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.417e-05 2024-04-26T12:32:51.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361347+0000", 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1819999999999995e-06 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361354+0000", 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1890000000000001e-06 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361383+0000", 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8839e-05 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361449+0000", 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5828999999999996e-05 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:70129 4.32 e69/13 4:4f726a0c:::100000001f8.00000012:head v 69'1120, mlcod=69'1118)", 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:51.363907+0000", 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00076684799999999999, 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00088652100000000003, 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:51.369 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.363907+0000", 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.363907+0000", 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.363907+0000", 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.363922+0000", 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5109999999999999e-05 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.363930+0000", 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0779999999999996e-06 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.363937+0000", 2024-04-26T12:32:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8410000000000002e-06 2024-04-26T12:32:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.363975+0000", 2024-04-26T12:32:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7839000000000001e-05 2024-04-26T12:32:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364000+0000", 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5585999999999999e-05 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:70131 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 2936832~4096 in=4096b,write 2994176~4096 in=4096b,write 3022848~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:51.364150+0000", 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00052416699999999997, 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00071881400000000002, 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:51.373 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 70131 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364150+0000", 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364150+0000", 2024-04-26T12:32:51.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364149+0000", 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364160+0000", 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0696999999999999e-05 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:51.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364226+0000", 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5930000000000001e-05 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364232+0000", 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4690000000000002e-06 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364276+0000", 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4061999999999999e-05 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:51.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364354+0000", 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7557000000000003e-05 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:70130 4.25 e69/13 4:a76ff001:::100000001f8.0000002b:head v 69'1087, mlcod=69'1084)", 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:51.364315+0000", 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00035902599999999997, 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062785399999999996, 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:51.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364315+0000", 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364315+0000", 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:51.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364315+0000", 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364330+0000", 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5176e-05 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364341+0000", 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0795000000000001e-05 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364347+0000", 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6839999999999999e-06 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364382+0000", 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4374e-05 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.364398+0000", 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6461e-05 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:70118 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1159168~4096 in=4096b,write 1273856~4096 in=4096b,write 1392640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:51.358380+0000", 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0062943019999999999, 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006639425, 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 70118 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.381 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.358380+0000", 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.358380+0000", 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.358379+0000", 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.358391+0000", 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1551e-05 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.358400+0000", 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7599999999999997e-06 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.358406+0000", 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6049999999999997e-06 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361427+0000", 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003021386 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.361503+0000", 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5351000000000004e-05 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:51.384 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:70120 4.25 e69/13 4:a76ff001:::100000001f8.0000002b:head v 69'1086, mlcod=69'1084)", 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:51.359662+0000", 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0050124230000000002, 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054202019999999998, 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.359662+0000", 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.359662+0000", 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.359661+0000", 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.359676+0000", 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5407e-05 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.359688+0000", 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1719000000000001e-05 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.359695+0000", 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.216e-06 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.359728+0000", 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2826e-05 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:51.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:51.359743+0000", 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5273000000000001e-05 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 6 2024-04-26T12:32:51.388 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:51.389 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:51.389 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:51.390 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:51.390+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:51.408 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:51.409 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:51.409 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:51.409 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:51.412 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:51.412 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:51.491 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:51.491+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:51.580 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:51.580 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:51.592 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:51.591+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:51.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:51.693 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:51.692+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:51.793 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:51.793+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:51.811 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:51.811 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:51.826 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:51.895 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:51.894+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:51.982 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:51.982 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:51.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:52.035 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:52.034+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:52.068 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:32:52.096 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:52.095+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:52.197 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:52.196+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:52.201 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:52.201 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:52.215 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:52.297 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:52.296+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:52.398 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:52.397+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:52.418 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:52.418 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:52.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:52.502 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:52.501+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:52.601 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:52.600+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:52.621 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:52.622 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:52.636 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:52.722 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:52.721+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:52.803 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:52.802+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:52.874 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:52.874 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:52.880 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:52.903 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:52.902+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:53.005 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:53.003+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:53.103 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:53.103 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:53.105 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:53.103+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:53.119 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:53.206 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:53.205+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:53.283 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:53.283 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:53.294 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:53.338 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:53.336+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:53.408 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:53.406+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:53.413 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:53.468 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:53.468 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:53.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:53.522 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:53.520+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:53.610 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:53.610 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:53.609+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:53.637 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:53.637 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:53.638 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:53.638 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:53.641 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:53.641 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:53.699 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:53.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:53.699 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:53.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.622421215999999, 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:32:53.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:32:53.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:32:53.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.615347066999998, 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:32:53.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.711 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.608185587000001, 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.716 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.607796984, 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:32:53.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:32:53.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.607467279000002, 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:53.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.729 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.605624713000001, 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:32:53.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.735 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.601272007999999, 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.740 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:32:53.741 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577586376999999, 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.742 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:32:53.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577438652000001, 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:32:53.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577381568, 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:32:53.753 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:32:53.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577354290999999, 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.759 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:32:53.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.764 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577312594999999, 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:32:53.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:32:53.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:32:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.770 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577266359999999, 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:32:53.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.773 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:32:53.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:32:53.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577233075999999, 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.777 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.778 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.779 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.780 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577203002000001, 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.783 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:32:53.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:32:53.786 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.787 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:53.788 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577166737999999, 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.790 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.791 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.792 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577112267, 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.794 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:53.795 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.796 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.797 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:32:53.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:32:53.799 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577086859000001, 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.800 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.801 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.802 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.803 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:32:53.804 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.577063030000001, 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.806 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.807 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:32:53.808 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:32:53.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.810 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:53.811 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 17.572914709999999, 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.812 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:32:53.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:32:53.815 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:32:53.816 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:32:53.817 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.817 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.817 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.817 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:53.817 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:53.817 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:53.818 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:53.819 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:53.817+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:53.919 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:53.918+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:53.998 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:75697 4.37 4:ef395e89:::100000001f8.00000020:head [write 606208~4096 in=4096b,write 671744~4096 in=4096b,write 745472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:53.998 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.993259+0000", 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0041370199999999999, 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004160052, 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75697 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:53.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.993259+0000", 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.993259+0000", 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.993258+0000", 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.993271+0000", 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3259e-05 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.993282+0000", 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0043e-05 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.993287+0000", 2024-04-26T12:32:54.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6999999999999996e-06 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.993327+0000", 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9459000000000003e-05 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.993379+0000", 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2376000000000001e-05 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:75700 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 3358720~4096 in=4096b,write 3379200~4096 in=4096b,write 3743744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.994300+0000", 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0030958719999999999, 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031985440000000002, 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75700 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994300+0000", 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994300+0000", 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994300+0000", 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994313+0000", 2024-04-26T12:32:54.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2957e-05 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994323+0000", 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0849999999999999e-05 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994329+0000", 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.66e-06 2024-04-26T12:32:54.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994362+0000", 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3198999999999998e-05 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994416+0000", 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3415999999999998e-05 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.006 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:75699 4.3d e70/13 4:bfffac44:::100000001f8.0000000c:head v 70'2379, mlcod=70'2377)", 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.994529+0000", 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0028674120000000002, 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0030109870000000001, 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994529+0000", 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994529+0000", 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994528+0000", 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994541+0000", 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.258e-05 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994549+0000", 2024-04-26T12:32:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0439999999999996e-06 2024-04-26T12:32:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994555+0000", 2024-04-26T12:32:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3969999999999999e-06 2024-04-26T12:32:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994606+0000", 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0732000000000001e-05 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994623+0000", 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7394e-05 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:75701 4.19 4:997b7129:::100000001f8.00000000:head [write 2453504~4096 in=4096b,write 2514944~4096 in=4096b,write 2707456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.011 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.994676+0000", 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0027196659999999999, 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029000889999999998, 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75701 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994676+0000", 2024-04-26T12:32:54.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994676+0000", 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994676+0000", 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994691+0000", 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4968e-05 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994703+0000", 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2136e-05 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994713+0000", 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.876e-06 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994755+0000", 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2852999999999998e-05 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.994834+0000", 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8678999999999997e-05 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:75702 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2080768~4096 in=4096b,write 2367488~4096 in=4096b,write 2678784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.995406+0000", 2024-04-26T12:32:54.015 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001990426, 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022117450000000002, 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75702 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995406+0000", 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995406+0000", 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995405+0000", 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995418+0000", 2024-04-26T12:32:54.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2702e-05 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995431+0000", 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3244999999999999e-05 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995438+0000", 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5100000000000001e-06 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995478+0000", 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0077000000000003e-05 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995581+0000", 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000102316 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:75703 4.37 4:eff9002a:::100000001f8.00000003:head [write 2932736~4096 in=4096b,write 2973696~4096 in=4096b,write 3780608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.995735+0000", 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001661219, 2024-04-26T12:32:54.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00192421, 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75703 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995735+0000", 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995735+0000", 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995734+0000", 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995746+0000", 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2057e-05 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995758+0000", 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2068e-05 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995769+0000", 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0526000000000001e-05 2024-04-26T12:32:54.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995810+0000", 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1109999999999998e-05 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.995896+0000", 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5740000000000002e-05 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:75704 4.1c 4:39b842ef:::100000001f8.00000029:head [write 12288~4096 in=4096b,write 61440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.996078+0000", 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001318626, 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001620755, 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75704 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996078+0000", 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996078+0000", 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996077+0000", 2024-04-26T12:32:54.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996087+0000", 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0668e-05 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996097+0000", 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6879999999999994e-06 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996104+0000", 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1219999999999997e-06 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996146+0000", 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2259000000000003e-05 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996226+0000", 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9158000000000003e-05 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.027 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:75706 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3194880~4096 in=4096b,write 3280896~4096 in=4096b,write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.996730+0000", 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00066574600000000005, 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001008962, 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75706 2024-04-26T12:32:54.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996730+0000", 2024-04-26T12:32:54.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996730+0000", 2024-04-26T12:32:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996729+0000", 2024-04-26T12:32:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996742+0000", 2024-04-26T12:32:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2344000000000001e-05 2024-04-26T12:32:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996759+0000", 2024-04-26T12:32:54.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7445999999999999e-05 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996767+0000", 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4869999999999996e-06 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996806+0000", 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9517000000000001e-05 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996863+0000", 2024-04-26T12:32:54.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6609e-05 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:75705 4.25 e70/13)", 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.996749+0000", 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00064734700000000005, 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0010251769999999999, 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996749+0000", 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996749+0000", 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996748+0000", 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996760+0000", 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2272999999999999e-05 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996767+0000", 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8569999999999997e-06 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.996772+0000", 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7269999999999998e-06 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.036 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:75708 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:53.997446+0000", 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9999495, 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00035485200000000001, 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 75708 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.037 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.997446+0000", 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.997446+0000", 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.997446+0000", 2024-04-26T12:32:54.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.997458+0000", 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2432999999999999e-05 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.997470+0000", 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2160999999999999e-05 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:53.997478+0000", 2024-04-26T12:32:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9899999999999997e-06 2024-04-26T12:32:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:54.040 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 10 2024-04-26T12:32:54.040 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:54.041 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:54.039+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:54.042 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:54.085 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:32:54.143 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:54.141+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:54.244 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:54.242+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:54.261 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:54.261 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:54.261 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:54.261 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:54.261 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:54.276 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:54.346 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:54.344+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:54.400 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:32:54.447 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:54.445+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:54.455 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:54.455 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:54.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:54.455 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:54.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.455 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.455 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:54.455 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.333351070999999, 2024-04-26T12:32:54.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:32:54.456 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.456 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:54.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.456 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:32:54.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:32:54.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:32:54.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:32:54.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:32:54.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.333222857999999, 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.463 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.467 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.333110974, 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.468 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.469 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:32:54.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.469 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:32:54.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:32:54.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:32:54.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:32:54.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:54.474 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.33309362, 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:32:54.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:32:54.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:32:54.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.333046661000001, 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.479 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.483 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.333026674999999, 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:54.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:32:54.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.332972336000001, 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.488 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:54.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.492 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.330101878000001, 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.493 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:32:54.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:32:54.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.329090870000002, 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:32:54.498 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.328990566000002, 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.504 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:54.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:54.509 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.328855819000001, 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:32:54.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:32:54.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.328534821000002, 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:32:54.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.328042556, 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:54.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:32:54.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:32:54.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:32:54.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:54.526 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.327949663999998, 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:32:54.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:32:54.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:32:54.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:32:54.531 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.327841223, 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:32:54.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:32:54.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.327658094, 2024-04-26T12:32:54.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:32:54.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:32:54.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:32:54.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:32:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:32:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.327639286, 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:32:54.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.549 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.325980430000001, 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:54.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:32:54.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.317667924999999, 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:32:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:32:54.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:32:54.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 18.314678172000001, 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:54.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:54.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:54.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:32:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:32:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:54.566 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:54.568 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:54.565+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:54.568 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:54.569 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-26T12:32:54.668 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:54.666+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:54.741 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.741 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:77322 4.25 4:a76ff001:::100000001f8.0000002b:head [write 3301376~4096 in=4096b,write 3350528~4096 in=4096b,write 3457024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:54.735244+0000", 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0052117029999999998, 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0052429319999999996, 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 77322 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:54.742 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.735244+0000", 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.735244+0000", 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.735243+0000", 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.743 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.735254+0000", 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.735263+0000", 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3729999999999993e-06 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.735269+0000", 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9390000000000002e-06 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.744 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.735302+0000", 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3813999999999998e-05 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.735354+0000", 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1334e-05 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.735443+0000", 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9462999999999994e-05 2024-04-26T12:32:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737491+0000", 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0020483020000000001 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:77325 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 3670016~4096 in=4096b,write 4169728~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:54.736410+0000", 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0040449220000000003, 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0041752380000000004, 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:54.746 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 77325 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736410+0000", 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736410+0000", 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736410+0000", 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736418+0000", 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736424+0000", 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6790000000000002e-06 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736428+0000", 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9999999999999998e-06 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736470+0000", 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1671000000000001e-05 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.749 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736560+0000", 2024-04-26T12:32:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0278999999999994e-05 2024-04-26T12:32:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.750 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:77326 4.31 4:8fb8ba0c:::100000001f8.00000024:head [write 2846720~4096 in=4096b,write 3088384~4096 in=4096b,write 3137536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:54.736782+0000", 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0036734390000000001, 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0038662089999999998, 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 77326 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:54.751 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736782+0000", 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736782+0000", 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736781+0000", 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:54.752 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736800+0000", 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8614000000000002e-05 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736811+0000", 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1365999999999999e-05 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736819+0000", 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3140000000000004e-06 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.753 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736865+0000", 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5096999999999999e-05 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.736924+0000", 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9586000000000002e-05 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737019+0000", 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4759000000000005e-05 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.754 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.740633+0000", 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0036137909999999999 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:77328 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1077248~4096 in=4096b,write 1142784~4096 in=4096b,write 1519616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:54.737410+0000", 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0030454549999999999, 2024-04-26T12:32:54.755 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0032857210000000001, 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 77328 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737410+0000", 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.756 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737410+0000", 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737409+0000", 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737437+0000", 2024-04-26T12:32:54.757 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8402e-05 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737449+0000", 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2028000000000001e-05 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737458+0000", 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7090000000000008e-06 2024-04-26T12:32:54.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737498+0000", 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0027999999999997e-05 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737550+0000", 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1823999999999997e-05 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.737639+0000", 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8542999999999996e-05 2024-04-26T12:32:54.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:32:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.740612+0000", 2024-04-26T12:32:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0029734409999999998 2024-04-26T12:32:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.760 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:77329 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 4014080~4096 in=4096b,write 4042752~4096 in=4096b,write 4132864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:54.738099+0000", 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0023565019999999999, 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002679421, 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 77329 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.761 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.738099+0000", 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.738099+0000", 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.738098+0000", 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.762 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.738115+0000", 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.666e-05 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.738128+0000", 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3188e-05 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.738137+0000", 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8249999999999994e-06 2024-04-26T12:32:54.763 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.738167+0000", 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0383999999999999e-05 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.738241+0000", 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3829000000000001e-05 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.738394+0000", 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015351000000000001 2024-04-26T12:32:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:77332 4.32 4:4f726a0c:::100000001f8.00000012:head [write 851968~4096 in=4096b,write 925696~4096 in=4096b,write 942080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:54.739322+0000", 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0011336860000000001, 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015012210000000001, 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 77332 2024-04-26T12:32:54.765 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739322+0000", 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739322+0000", 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:54.766 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739321+0000", 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739339+0000", 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.8563000000000002e-05 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739353+0000", 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3379e-05 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.767 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739362+0000", 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4450000000000002e-06 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739403+0000", 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0250000000000003e-05 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739478+0000", 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5549999999999993e-05 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.768 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739646+0000", 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016803 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:77333 4.38 4:1d13bf87:::100000001f8.00000030:head [write 2797568~4096 in=4096b,write 2875392~4096 in=4096b,write 3031040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:54.739628+0000", 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00082791500000000003, 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0012386910000000001, 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:54.769 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 77333 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739628+0000", 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:54.770 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739628+0000", 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739627+0000", 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739644+0000", 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7172000000000001e-05 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:54.771 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739657+0000", 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.292e-05 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739664+0000", 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3209999999999999e-06 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739701+0000", 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6483999999999998e-05 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.772 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.739756+0000", 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5220000000000003e-05 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop_reply(client.4532.0:77329 4.3d e70/13)", 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:54.740861+0000", 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4294967295.9995942, 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1088999999999999e-05, 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:54.773 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.740861+0000", 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.740861+0000", 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.740861+0000", 2024-04-26T12:32:54.774 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.740864+0000", 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4189999999999998e-06 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.740871+0000", 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1820000000000003e-06 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.740875+0000", 2024-04-26T12:32:54.775 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0969999999999999e-06 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:54.740902+0000", 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6981000000000001e-05 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 8 2024-04-26T12:32:54.776 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:54.778 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:54.776+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:54.778 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:54.878 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:54.876+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:54.979 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:54.977+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:54.992 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:54.992 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:54.992 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:54.992 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:54.992 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:55.006 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:55.080 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:55.079+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:55.108 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:32:55.181 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:55.179+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:55.220 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.143052328, 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:32:55.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:32:55.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:32:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.135978178999999, 2024-04-26T12:32:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:32:55.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:32:55.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:55.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:32:55.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:32:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:32:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:32:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:32:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.128816699000001, 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.128428096, 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:32:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:32:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:32:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.128098391000002, 2024-04-26T12:32:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:32:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:32:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:32:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.126255825000001, 2024-04-26T12:32:55.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:32:55.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:32:55.255 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.256 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.257 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.121903119999999, 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:32:55.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:32:55.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:32:55.262 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.263 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:55.264 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.098217489, 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:32:55.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:32:55.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:32:55.269 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.098069764000002, 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.270 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:55.271 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:32:55.272 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:32:55.273 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.274 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.275 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:55.276 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.09801268, 2024-04-26T12:32:55.276 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:32:55.276 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.276 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.276 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:32:55.278 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.279 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.280 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.281 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.097985402999999, 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.282 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:32:55.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:32:55.285 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:32:55.286 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.097943706999999, 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.288 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.289 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.290 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.291 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.292 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.097897472, 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.293 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.294 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.295 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.296 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.297 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.097864187999999, 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.299 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.300 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.097834114000001, 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.304 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:32:55.306 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:32:55.307 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:32:55.308 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.097797849999999, 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.310 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.311 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:32:55.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:32:55.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.097743379000001, 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:32:55.315 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:55.316 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.317 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.319 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.097717971000002, 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.321 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.326 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.097694142000002, 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:55.327 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:32:55.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:32:55.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 19.093545821999999, 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:55.332 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:55.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:32:55.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:55.337 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:55.339 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:55.339 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:55.338+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:55.439 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:55.438+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:78898 4.24 4:27adda6e:::100000001f8.0000000f:head [write 1679360~4096 in=4096b,write 1830912~4096 in=4096b,write 1916928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:55.514672+0000", 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0050403649999999998, 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.005071547, 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:55.520 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 78898 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.514672+0000", 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.514672+0000", 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:55.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.514672+0000", 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.514683+0000", 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1878999999999999e-05 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.514693+0000", 2024-04-26T12:32:55.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7620000000000007e-06 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.514701+0000", 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3989999999999998e-06 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.514736+0000", 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5054e-05 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.514813+0000", 2024-04-26T12:32:55.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7373999999999995e-05 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.514968+0000", 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00015468900000000001 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.518418+0000", 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034503070000000001 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.524 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:78906 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 417792~4096 in=4096b,write 430080~4096 in=4096b,write 471040~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:55.518267+0000", 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0014457879999999999, 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001566507, 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 78906 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.518267+0000", 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:55.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.518267+0000", 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.518266+0000", 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.518281+0000", 2024-04-26T12:32:55.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5105e-05 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.518292+0000", 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0682999999999999e-05 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.518299+0000", 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9929999999999998e-06 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.518341+0000", 2024-04-26T12:32:55.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2002999999999997e-05 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.518426+0000", 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5506000000000004e-05 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:78908 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 3932160~4096 in=4096b,write 3969024~4096 in=4096b,write 4026368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:55.519249+0000", 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.000463263, 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00062688100000000003, 2024-04-26T12:32:55.528 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 78908 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.519249+0000", 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:55.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.519249+0000", 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.519249+0000", 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.519261+0000", 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1984000000000001e-05 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.519270+0000", 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2990000000000002e-06 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.519277+0000", 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4930000000000003e-06 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.519314+0000", 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7054999999999997e-05 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:55.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:55.519366+0000", 2024-04-26T12:32:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1963999999999999e-05 2024-04-26T12:32:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:55.532 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 3 2024-04-26T12:32:55.532 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:55.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:55.540 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:55.540+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:55.641 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:55.641+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:55.642 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:32:55.743 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:55.742+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:55.757 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:55.757 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:55.757 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:55.757 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:55.757 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:55.772 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:55.839 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:55.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~19s 2024-04-26T12:32:55.844 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:55.843+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:55.862 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:55.863 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:55.863 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:55.863 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:55.866 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:55.866 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:55.944 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:55.943+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:55.962 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:55.962 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:55.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:56.046 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:56.045+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:56.146 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:56.145+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:56.148 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:56.148 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:56.160 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:56.248 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:56.247+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:56.324 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:56.324 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:56.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:56.382 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:56.381+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:56.450 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:56.449+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:56.505 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:56.505 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:56.520 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:56.653 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:56.652+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:56.697 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:56.697 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:56.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:56.722 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:56.560+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:56.754 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:56.753+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:56.855 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:56.854+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:56.939 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:56.939 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:56.954 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:56.956 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:56.955+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:57.057 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:57.056+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:57.126 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:32:57.138 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:57.138 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:57.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:57.194 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:57.193+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:57.258 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:57.257+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:57.335 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:57.336 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:57.349 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:57.392 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:57.391+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:57.460 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:57.459+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:57.561 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:57.561 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:57.561 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:57.559+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:57.575 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:57.661 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:57.660+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:57.742 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:57.742 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:57.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:57.799 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:57.798+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:57.863 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:57.862+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:57.867 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:32:57.935 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:32:57.935 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:32:57.948 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:57.964 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:57.963+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:58.062 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:32:58.064 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:58.064+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:58.087 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:32:58.087 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:32:58.087 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:32:58.087 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:32:58.090 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:32:58.090 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:32:58.131 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:32:58.166 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:58.165+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:58.177 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:58.177 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:58.177 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:58.192 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:58.267 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:58.266+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:58.368 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:58.367+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:58.377 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:58.377 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:58.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:58.377 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.256334832, 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:32:58.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:32:58.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.256206619, 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:32:58.382 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.386 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.256094735000001, 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.387 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:58.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:32:58.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:58.391 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.256077381000001, 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:32:58.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:32:58.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.256030421999998, 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:32:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.400 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.256010436, 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:32:58.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:32:58.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.255956096999999, 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:32:58.405 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:32:58.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:32:58.409 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.253085638999998, 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:32:58.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:32:58.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:32:58.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:32:58.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.252074630999999, 2024-04-26T12:32:58.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:32:58.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:32:58.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.420 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.251974326999999, 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.421 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:32:58.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:58.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:32:58.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.251839579999999, 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:32:58.426 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:32:58.431 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.251518581999999, 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.432 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:32:58.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:32:58.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:32:58.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.251026317000001, 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.437 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:32:58.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.250933424999999, 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:32:58.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:32:58.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.250824984000001, 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.448 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:32:58.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:32:58.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:32:58.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:32:58.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.453 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.250641855000001, 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:58.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:32:58.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:32:58.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:32:58.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:32:58.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.250623047000001, 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.459 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:58.464 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.248964190999999, 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:32:58.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:32:58.469 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.240651686, 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:32:58.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:32:58.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:32:58.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:32:58.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 22.237661932999998, 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:32:58.475 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:58.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.481 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:58.481 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:58.481 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:58.482 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:58.481+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:58.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:32:58.570 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:32:58.584 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:58.582+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:58.648 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:58.648 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:85743 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 3964928~4096 in=4096b,write 4112384~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:58.642585+0000", 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0050136929999999996, 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050355399999999998, 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 85743 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.649 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642585+0000", 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642585+0000", 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:58.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642584+0000", 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642593+0000", 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3649999999999993e-06 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642604+0000", 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0784999999999999e-05 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642609+0000", 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5480000000000001e-06 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643245+0000", 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00063597000000000002 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643312+0000", 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6866999999999995e-05 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643470+0000", 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015743300000000001 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:85744 4.11 4:8b544b63:::100000001f8.0000002c:head [write 2113536~4096 in=4096b,write 2879488~4096 in=4096b,write 2891776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:58.642945+0000", 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0046527829999999997, 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047307920000000002, 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 85744 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642945+0000", 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642945+0000", 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642945+0000", 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642957+0000", 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2377e-05 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642965+0000", 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2980000000000003e-06 2024-04-26T12:32:58.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.642969+0000", 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1749999999999998e-06 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644229+0000", 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0012599589999999999 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644308+0000", 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9326000000000006e-05 2024-04-26T12:32:58.656 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:85745 4.25 4:a76ff001:::100000001f8.0000002b:head [write 2015232~4096 in=4096b,write 3026944~4096 in=4096b,write 3117056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:58.643365+0000", 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0042333780000000003, 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0043542779999999996, 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 85745 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:58.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643365+0000", 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643365+0000", 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643364+0000", 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643387+0000", 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2532e-05 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643393+0000", 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3260000000000001e-06 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643397+0000", 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0790000000000002e-06 2024-04-26T12:32:58.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643440+0000", 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3061e-05 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643522+0000", 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1979999999999998e-05 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.643695+0000", 2024-04-26T12:32:58.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000172855 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:85746 4.2a e72/13 4:57147dc3:::100000001f8.00000011:head v 72'1346, mlcod=72'1344)", 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:58.644124+0000", 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0034739889999999998, 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003634984, 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644124+0000", 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644124+0000", 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644124+0000", 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644154+0000", 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0673999999999998e-05 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644163+0000", 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8119999999999997e-06 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644168+0000", 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4519999999999999e-06 2024-04-26T12:32:58.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644200+0000", 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2478000000000003e-05 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644217+0000", 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6997999999999999e-05 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:85748 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3944448~4096 in=4096b,write 3977216~4096 in=4096b,write 4141056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:58.644976+0000", 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0026223129999999998, 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028193570000000002, 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 85748 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.665 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644976+0000", 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644976+0000", 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:58.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644975+0000", 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.644991+0000", 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5699e-05 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.645004+0000", 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3322999999999999e-05 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.645013+0000", 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.67e-06 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.645058+0000", 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5627000000000002e-05 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.645164+0000", 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000105342 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:58.668 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:85752 4.29 4:94178d8a:::100000001f8.00000006:head [write 2367488~4096 in=4096b,write 2498560~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:58.646466+0000", 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0011326019999999999, 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001369328, 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.669 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 85752 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646466+0000", 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646466+0000", 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646465+0000", 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646490+0000", 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4848e-05 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646502+0000", 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2568000000000001e-05 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646508+0000", 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5140000000000001e-06 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647240+0000", 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00073252199999999999 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647337+0000", 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6529999999999999e-05 2024-04-26T12:32:58.672 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:85753 4.e 4:73e84e43:::100000001f8.00000004:head [write 2547712~4096 in=4096b,write 2752512~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:58.646842+0000", 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00075630900000000004, 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001030081, 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 85753 2024-04-26T12:32:58.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646842+0000", 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646842+0000", 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646842+0000", 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646874+0000", 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2583999999999998e-05 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646881+0000", 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4570000000000002e-06 2024-04-26T12:32:58.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646884+0000", 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9450000000000003e-06 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.646932+0000", 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.727e-05 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647020+0000", 2024-04-26T12:32:58.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7995e-05 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647158+0000", 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000137897 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:85754 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2936832~4096 in=4096b,write 2985984~4096 in=4096b,write 3043328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:58.647305+0000", 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00029311799999999998, 2024-04-26T12:32:58.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00061079199999999998, 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 85754 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647305+0000", 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647305+0000", 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647304+0000", 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647346+0000", 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1576999999999999e-05 2024-04-26T12:32:58.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647364+0000", 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647373+0000", 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0310000000000004e-06 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647418+0000", 2024-04-26T12:32:58.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5615999999999998e-05 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:58.647503+0000", 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5028e-05 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 8 2024-04-26T12:32:58.681 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:58.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:32:58.683 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-26T12:32:58.724 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:58.723+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:58.784 INFO:teuthology.orchestra.console.smithi098:Power on completed 2024-04-26T12:32:58.786 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:58.785+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:58.885 DEBUG:teuthology.orchestra.console.smithi098:Waiting for login prompt 2024-04-26T12:32:58.885 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi098 2024-04-26T12:32:58.895 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:58.894+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:58.896 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:58.896 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:32:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:32:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:32:58.897 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:58.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:32:58.996 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:58.996+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:59.098 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:59.097+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.047216098, 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:32:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:32:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.040141948999999, 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:32:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:32:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.032980469000002, 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:32:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.032591866000001, 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:32:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:32:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:32:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.032262160999998, 2024-04-26T12:32:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:32:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:32:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:32:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.030419595000001, 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:32:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:32:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:32:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.026066889999999, 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:32:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:32:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:32:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:32:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:32:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:32:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.002381259, 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:32:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:32:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:32:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.002233533999998, 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:32:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:32:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.00217645, 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:32:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:32:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.002149172999999, 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:32:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.002107476999999, 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.002061242, 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.002027957999999, 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:32:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.001997884000001, 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:32:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:32:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.001961619999999, 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:32:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.001907149000001, 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:32:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:32:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.001881740999998, 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:32:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:32:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:32:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 23.001857911999998, 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:32:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:32:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:32:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:32:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 22.997709592, 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:32:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:32:59.241 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:32:59.243 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:59.241+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:59.243 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:32:59.344 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:59.343+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:59.423 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:59.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:87305 4.6 4:616d4c41:::100000001f8.00000034:head [write 3055616~4096 in=4096b,write 3121152~4096 in=4096b,write 3170304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:59.395047+0000", 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027293260999999999, 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027316746999999999, 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 87305 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.395047+0000", 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.395047+0000", 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.395046+0000", 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.395066+0000", 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9392999999999999e-05 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.395072+0000", 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8889999999999999e-06 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.395076+0000", 2024-04-26T12:32:59.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1470000000000003e-06 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.405911+0000", 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010835566 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.406004+0000", 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2538000000000001e-05 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:87311 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 4136960~4096 in=4096b,write 4190208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:59.397829+0000", 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.024511471, 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.024703345000000002, 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 87311 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.397829+0000", 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.397829+0000", 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.397828+0000", 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.397839+0000", 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1375999999999999e-05 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.397851+0000", 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.185e-05 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.397858+0000", 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9530000000000002e-06 2024-04-26T12:32:59.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.405897+0000", 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080384069999999992 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.405979+0000", 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2577000000000006e-05 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.431 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:87328 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1794048~4096 in=4096b,write 1871872~4096 in=4096b,write 1966080~4096 in=4096b,write 2093056~4096 in=4096b,write 2125824~4096 in=4096b,write 2289664~4096 in=4096b,write 2355200~4096 in=4096b,write 2396160~8192 in=8192b,write 2424832~4096 in=4096b,write 2473984~4096 in=4096b,write 2482176~4096 in=4096b,write 2625536~4096 in=4096b,write 2670592~4096 in=4096b,write 2756608~4096 in=4096b,write 2772992~4096 in=4096b,write 2805760~4096 in=4096b,write 2969600~4096 in=4096b,write 2981888~4096 in=4096b,write 2990080~4096 in=4096b,write 3047424~4096 in=4096b,write 3092480~4096 in=4096b,write 3125248~4096 in=4096b,write 3145728~4096 in=4096b,write 3223552~4096 in=4096b,write 3403776~4096 in=4096b,write 3469312~4096 in=4096b,write 3649536~4096 in=4096b,write 3731456~4096 in=4096b,write 4018176~4096 in=4096b,write 4079616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:59.403600+0000", 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.018739922999999999, 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019001937, 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 87328 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.403600+0000", 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.403600+0000", 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.403600+0000", 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.403730+0000", 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013061299999999999 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.403740+0000", 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0149000000000001e-05 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.403749+0000", 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3780000000000001e-06 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.434 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.409667+0000", 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059185870000000003 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.409792+0000", 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012522100000000001 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:87290 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2662400~4096 in=4096b,write 2686976~4096 in=4096b,write 2711552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:59.435 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:59.388886+0000", 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.033454643999999999, 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033759323000000001, 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 87290 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.388886+0000", 2024-04-26T12:32:59.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.388886+0000", 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.388885+0000", 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.388897+0000", 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2473999999999999e-05 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.388905+0000", 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5240000000000003e-06 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.388910+0000", 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9919999999999998e-06 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.393289+0000", 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043795470000000001 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.393377+0000", 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7538000000000001e-05 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.439 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:87329 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 983040~4096 in=4096b,write 1118208~4096 in=4096b,write 1396736~4096 in=4096b,write 1679360~4096 in=4096b,write 1794048~4096 in=4096b,write 2007040~4096 in=4096b,write 2174976~4096 in=4096b,write 2297856~4096 in=4096b,write 2310144~4096 in=4096b,write 2359296~4096 in=4096b,write 2437120~4096 in=4096b,write 2519040~4096 in=4096b,write 2670592~4096 in=4096b,write 2686976~4096 in=4096b,write 2781184~4096 in=4096b,write 2822144~4096 in=4096b,write 3100672~4096 in=4096b,write 3448832~4096 in=4096b,write 3461120~4096 in=4096b,write 3751936~4096 in=4096b,write 3776512~4096 in=4096b,write 3907584~4096 in=4096b,write 3964928~4096 in=4096b,write 4030464~4096 in=4096b,write 4071424~4096 in=4096b,write 4124672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:59.403815+0000", 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.018525467, 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018883937999999999, 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 87329 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.403815+0000", 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.403815+0000", 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.403814+0000", 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404096+0000", 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000281496 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404106+0000", 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0251000000000001e-05 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404113+0000", 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9949999999999999e-06 2024-04-26T12:32:59.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.415663+0000", 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011550182000000001 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.415794+0000", 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000131125 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:87331 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 102400~4096 in=4096b,write 217088~4096 in=4096b,write 692224~4096 in=4096b,write 794624~4096 in=4096b,write 1298432~4096 in=4096b,write 1331200~4096 in=4096b,write 1441792~4096 in=4096b,write 1531904~4096 in=4096b,write 1671168~4096 in=4096b,write 1802240~4096 in=4096b,write 1843200~4096 in=4096b,write 2023424~4096 in=4096b,write 2093056~4096 in=4096b,write 2232320~4096 in=4096b,write 2318336~4096 in=4096b,write 2486272~8192 in=8192b,write 2895872~4096 in=4096b,write 2920448~4096 in=4096b,write 2961408~4096 in=4096b,write 3043328~4096 in=4096b,write 3121152~4096 in=4096b,write 3248128~4096 in=4096b,write 3457024~4096 in=4096b,write 3477504~4096 in=4096b,write 3538944~4096 in=4096b,write 3760128~4096 in=4096b,write 3801088~4096 in=4096b,write 3829760~4096 in=4096b,write 3887104~4096 in=4096b,write 3944448~4096 in=4096b,write 3964928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:59.404120+0000", 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.018220620999999999, 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018635127000000001, 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 87331 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404120+0000", 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404120+0000", 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404119+0000", 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404212+0000", 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2892000000000004e-05 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404221+0000", 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8540000000000003e-06 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404227+0000", 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.417431+0000", 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013203652999999999 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.417515+0000", 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4438999999999996e-05 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:87332 4.36 4:6ee5e2c4:::100000001f9.00000000:head [write 0~1048576 in=1048576b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:59.404238+0000", 2024-04-26T12:32:59.447 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.018102736000000001, 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018557761999999998, 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 87332 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404238+0000", 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404238+0000", 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.404237+0000", 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.405375+0000", 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0011385900000000001 2024-04-26T12:32:59.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.405386+0000", 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0533000000000001e-05 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.405393+0000", 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4839999999999998e-06 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.417510+0000", 2024-04-26T12:32:59.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012116622000000001 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.417563+0000", 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3012e-05 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:87295 4.6 4:616d4c41:::100000001f8.00000034:head [write 3997696~4096 in=4096b,write 4034560~4096 in=4096b,write 4055040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:59.391027+0000", 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031312936999999999, 2024-04-26T12:32:59.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031815156999999997, 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 87295 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391027+0000", 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391027+0000", 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391026+0000", 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391040+0000", 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3579e-05 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391051+0000", 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0641e-05 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391060+0000", 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0319999999999992e-06 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.393267+0000", 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022077669999999998 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.393315+0000", 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7423999999999999e-05 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:87296 4.6 4:63e80496:::100000001f8.0000001e:head [write 491520~4096 in=4096b,write 503808~4096 in=4096b,write 614400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:59.391372+0000", 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.030968426, 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031540355999999999, 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:32:59.455 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 87296 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391372+0000", 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391372+0000", 2024-04-26T12:32:59.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391371+0000", 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391388+0000", 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6704000000000001e-05 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391398+0000", 2024-04-26T12:32:59.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.391406+0000", 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7770000000000002e-06 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.397117+0000", 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057111990000000001 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:59.397208+0000", 2024-04-26T12:32:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1754000000000003e-05 2024-04-26T12:32:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:32:59.459 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 9 2024-04-26T12:32:59.459 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:59.460 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:59.459+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:59.461 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:32:59.563 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:59.562+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:59.662 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:32:59.662+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:32:59.694 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:59.694 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:32:59.694 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:32:59.694 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:32:59.694 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:32:59.709 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:32:59.799 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:59.798+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:59.864 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:32:59.863+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:32:59.938 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:32:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:32:59.938 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.817490598999999, 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.939 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.940 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.941 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:32:59.942 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.817362385999999, 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:32:59.943 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:32:59.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.817250502, 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:59.948 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:32:59.949 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.950 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.951 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.817233148, 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.952 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.953 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.954 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.955 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:32:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.817186189000001, 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:32:59.959 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:32:59.960 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.961 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.817166202999999, 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.962 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:32:59.963 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.964 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:32:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:32:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:32:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:32:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.965 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.817111864000001, 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.966 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.967 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:32:59.968 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.969 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:32:59.970 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.814241406000001, 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.971 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.972 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:32:59.973 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.974 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.975 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.976 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.813230398000002, 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.977 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.978 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:32:59.979 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.980 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.981 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.982 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.813130094000002, 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.983 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:32:59.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:32:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.812995347000001, 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.988 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.989 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:32:59.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:32:59.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:32:59.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.993 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.812674349000002, 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:32:59.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.812182084, 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:32:59.999 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:33:00.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:33:00.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:33:00.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.812089191999998, 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:00.005 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:00.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:33:00.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:33:00.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:33:00.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:00.010 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.811980751, 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:33:00.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:33:00.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:00.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:00.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.811797622, 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:00.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:33:00.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:33:00.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:00.021 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.811778814, 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:00.022 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:00.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:00.027 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.810119958000001, 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.801807452999999, 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:00.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.034 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.035 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:33:00.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 23.798817700000001, 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:33:00.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:00.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:00.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:33:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:33:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:00.043 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:00.043 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:00.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:00.045 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:00.043+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:00.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:33:00.145 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:00.144+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:00.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:33:00.217 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:00.217 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:00.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.217 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:88943 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 1929216~4096 in=4096b,write 2113536~4096 in=4096b,write 2146304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:33:00.217 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:00.206324+0000", 2024-04-26T12:33:00.217 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.010096562999999999, 2024-04-26T12:33:00.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010118442, 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 88943 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206324+0000", 2024-04-26T12:33:00.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206324+0000", 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206323+0000", 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206336+0000", 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3447e-05 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206347+0000", 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1177e-05 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206356+0000", 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0430000000000008e-06 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206391+0000", 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5420000000000003e-05 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206440+0000", 2024-04-26T12:33:00.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9135000000000003e-05 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206546+0000", 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00010621899999999999 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.210204+0000", 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0036575090000000002 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.222 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:88944 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 3403776~4096 in=4096b,write 3420160~4096 in=4096b,write 3452928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:00.206656+0000", 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0097642100000000006, 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0098416649999999994, 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:00.223 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 88944 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206656+0000", 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206656+0000", 2024-04-26T12:33:00.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206655+0000", 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206718+0000", 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3106000000000002e-05 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206732+0000", 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.206742+0000", 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6379999999999999e-06 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.208280+0000", 2024-04-26T12:33:00.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001538085 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.208349+0000", 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9799e-05 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.208488+0000", 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013824700000000001 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211975+0000", 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0034871849999999999 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:88946 4.25 4:a76ff001:::100000001f8.0000002b:head [write 3698688~4096 in=4096b,write 3809280~4096 in=4096b,write 3817472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:00.207319+0000", 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0091012269999999999, 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0092272499999999993, 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:00.228 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 88946 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207319+0000", 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207319+0000", 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207318+0000", 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:00.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207363+0000", 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4128999999999997e-05 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207375+0000", 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2379e-05 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207383+0000", 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.61e-06 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.208270+0000", 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00088762400000000005 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.208345+0000", 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4585000000000005e-05 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.208488+0000", 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014299000000000001 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212215+0000", 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0037273530000000001 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:88947 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 49152~4096 in=4096b,write 540672~4096 in=4096b,write 647168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:33:00.233 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:00.207668+0000", 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0087526089999999997, 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0089261319999999998, 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 88947 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207668+0000", 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207668+0000", 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207667+0000", 2024-04-26T12:33:00.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207724+0000", 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6724000000000001e-05 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207734+0000", 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0329999999999999e-05 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207743+0000", 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6910000000000003e-06 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207786+0000", 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3640999999999998e-05 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.207877+0000", 2024-04-26T12:33:00.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1136000000000003e-05 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.208040+0000", 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016271999999999999 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212780+0000", 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0047402670000000003 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.238 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:88957 4.27 4:e68799fb:::100000001f8.00000018:head [write 2203648~4096 in=4096b,write 2301952~4096 in=4096b,write 2359296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:00.211114+0000", 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0053060870000000001, 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0055260020000000003, 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:00.239 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 88957 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211114+0000", 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211114+0000", 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211114+0000", 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211172+0000", 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8300000000000001e-05 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:00.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211187+0000", 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5430999999999998e-05 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211196+0000", 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.4940000000000003e-06 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211236+0000", 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0426999999999998e-05 2024-04-26T12:33:00.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211287+0000", 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1149000000000001e-05 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.211383+0000", 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5018000000000004e-05 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.214467+0000", 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0030846010000000002 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:88961 4.27 4:e68799fb:::100000001f8.00000018:head [write 1458176~4096 in=4096b,write 1490944~4096 in=4096b,write 1515520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:00.212598+0000", 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0038226800000000002, 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0040878399999999997, 2024-04-26T12:33:00.244 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 88961 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212598+0000", 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212598+0000", 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212597+0000", 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212644+0000", 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.6953999999999998e-05 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212654+0000", 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0244999999999999e-05 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212662+0000", 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.678e-06 2024-04-26T12:33:00.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212876+0000", 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00021424599999999999 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.212945+0000", 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9239000000000006e-05 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.213093+0000", 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014744899999999999 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.214965+0000", 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0018720379999999999 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:88967 4.13 4:cbf33e86:::100000001f8.00000026:head [write 917504~4096 in=4096b,write 1146880~4096 in=4096b,write 1171456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:00.215055+0000", 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.001365193, 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0016773510000000001, 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 88967 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:00.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.215055+0000", 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.215055+0000", 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.215054+0000", 2024-04-26T12:33:00.251 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.215068+0000", 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3614e-05 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.215077+0000", 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3500000000000003e-06 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.215083+0000", 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9680000000000003e-06 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.215120+0000", 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6548000000000003e-05 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:00.253 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.215202+0000", 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1885999999999995e-05 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:00.215321+0000", 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000119024 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:33:00.254 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 7 2024-04-26T12:33:00.255 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:00.256 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:00.257 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:00.254+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:00.297 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:00.320 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:00.320 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:00.320 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:00.320 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:00.325 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:00.325 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:00.356 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:00.355+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:00.457 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:00.457+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:00.459 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:00.460 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:00.470 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:00.558 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:00.557+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:00.659 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:00.658+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:00.688 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:00.689 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:00.704 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:00.760 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:00.759+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:00.861 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:00.860+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:00.890 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:00.890 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:00.907 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:00.962 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:00.962+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:01.063 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:01.062+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:01.130 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:01.131 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:01.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:01.164 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:01.163+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:01.186 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:33:01.265 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:01.264+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:01.367 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:01.366+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:01.374 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:01.374 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:01.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:01.467 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:01.466+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:01.550 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:01.550 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:01.564 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:01.608 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:01.608+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:01.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~25s 2024-04-26T12:33:01.668 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:01.667+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:01.733 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:01.733 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:01.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:01.769 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:01.768+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:01.870 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:01.869+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:01.954 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:01.954 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:01.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:01.971 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:01.970+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:02.072 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:02.071+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:02.156 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:02.156 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:02.172 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:02.173 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:02.172+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:02.274 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:02.273+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:02.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:33:02.375 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:02.374+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:02.395 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:02.395 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:02.411 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:02.476 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:02.475+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:02.521 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:02.546 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:02.547 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:02.547 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:02.547 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:02.550 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:02.550 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:02.577 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:02.576+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:02.640 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:02.640 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:33:02.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:33:02.640 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:02.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.640 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.640 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.519054193999999, 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:02.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:02.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:33:02.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:33:02.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:33:02.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:33:02.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.518925980999999, 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.648 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.518814097, 2024-04-26T12:33:02.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.656 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.518796742999999, 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:33:02.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:02.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:33:02.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:33:02.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:33:02.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:33:02.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:02.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.662 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.663 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.663 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:02.663 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.518749784000001, 2024-04-26T12:33:02.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:33:02.663 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.663 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:33:02.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:33:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:33:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:33:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:02.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.518729797999999, 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:02.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:33:02.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:33:02.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:33:02.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:33:02.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:33:02.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:33:02.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:33:02.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.518675459000001, 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:02.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:02.679 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.515805001, 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:33:02.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:02.685 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.514793993000001, 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:33:02.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:33:02.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:33:02.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.514693689000001, 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.691 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.692 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:33:02.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.696 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.514558942000001, 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:02.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:33:02.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:33:02.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:33:02.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.514237944000001, 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.702 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:02.707 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.513745678999999, 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:33:02.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:33:02.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.513652787000002, 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:02.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:33:02.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.718 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.513544346, 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:33:02.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:33:02.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.513361217, 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.724 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:02.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.513342409, 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.511683553000001, 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.735 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:33:02.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:33:02.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.503371047999998, 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:02.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 26.500381295, 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:02.746 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:02.751 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:02.753 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:02.752+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:02.753 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:02.854 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:02.853+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:02.915 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:94705 4.a 4:50194ce5:::100000001f8.00000027:head [write 1044480~4096 in=4096b,write 1150976~4096 in=4096b,write 1175552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:02.914064+0000", 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0014422459999999999, 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014644, 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:02.916 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 94705 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914064+0000", 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914064+0000", 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:02.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914064+0000", 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914074+0000", 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0149000000000001e-05 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914083+0000", 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.2709999999999998e-06 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914089+0000", 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5180000000000004e-06 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914134+0000", 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5569999999999999e-05 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914230+0000", 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5623000000000002e-05 2024-04-26T12:33:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:94707 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 696320~4096 in=4096b,write 921600~4096 in=4096b,write 929792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:02.914783+0000", 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.000723275, 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00079380100000000001, 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 94707 2024-04-26T12:33:02.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914783+0000", 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914783+0000", 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:02.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914783+0000", 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914793+0000", 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0566e-05 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914799+0000", 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0589999999999999e-06 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914803+0000", 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6270000000000002e-06 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914835+0000", 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2286999999999998e-05 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.914893+0000", 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7590999999999998e-05 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:02.923 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:94708 4.3 4:c222b65c:::100000001f8.00000021:head [write 32768~4096 in=4096b,write 57344~4096 in=4096b,write 86016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:02.915265+0000", 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.000241413, 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000356535, 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 94708 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:02.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.915265+0000", 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.915265+0000", 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.915264+0000", 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:02.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.915275+0000", 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0473e-05 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.915289+0000", 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3956e-05 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.915296+0000", 2024-04-26T12:33:02.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2099999999999996e-06 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.915339+0000", 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2706000000000001e-05 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.915428+0000", 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9148999999999996e-05 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:02.915612+0000", 2024-04-26T12:33:02.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000184525 2024-04-26T12:33:02.928 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:02.928 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:02.928 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:02.928 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:02.928 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:33:02.928 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 3 2024-04-26T12:33:02.928 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:02.929 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:02.973 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:02.972+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:03.055 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:03.054+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:03.098 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:03.098 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:03.098 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:33:03.098 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:33:03.098 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:03.112 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:03.156 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:03.155+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:03.201 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:33:03.257 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:03.256+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.242264213999999, 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:33:03.319 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:03.320 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:33:03.321 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.322 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.323 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.235190065000001, 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.325 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.326 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.327 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:33:03.328 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:33:03.330 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.331 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.228028585000001, 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:33:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.333 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.335 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.336 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:33:03.337 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:03.338 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.227639981999999, 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:33:03.340 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.341 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.342 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:33:03.343 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.227310277000001, 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:33:03.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.346 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:33:03.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:33:03.348 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.349 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.350 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.225467711, 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.351 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.352 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.353 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:33:03.354 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:33:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:33:03.356 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.221115006000002, 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:33:03.357 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.358 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.359 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.360 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.361 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:33:03.362 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.197429374999999, 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:33:03.363 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.365 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.366 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.367 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.368 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.197281650000001, 2024-04-26T12:33:03.369 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:33:03.371 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:33:03.372 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.373 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.374 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.197224565999999, 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:33:03.375 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.377 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:33:03.379 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:33:03.380 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:03.381 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.197197289000002, 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:33:03.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:33:03.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:33:03.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:03.387 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.197155593000002, 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:03.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:33:03.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.197109357999999, 2024-04-26T12:33:03.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:03.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:33:03.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:33:03.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:33:03.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.197076074000002, 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:33:03.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:33:03.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.404 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.197046, 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:03.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:33:03.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.410 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.197009735999998, 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:33:03.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:33:03.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.196955265, 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:33:03.416 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:33:03.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:33:03.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.196929857000001, 2024-04-26T12:33:03.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.196906028000001, 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:03.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:33:03.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.434 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 27.192757707999998, 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:33:03.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:03.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:33:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:33:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:03.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.440 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:03.441 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:03.441 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:03.442 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:03.443 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:03.441+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:03.543 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:03.542+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:03.629 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:03.629 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:03.629 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.629 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96213 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2736128~4096 in=4096b,write 2748416~4096 in=4096b,write 2764800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.629 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.614419+0000", 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011488763000000001, 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011525687, 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96213 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614419+0000", 2024-04-26T12:33:03.630 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614419+0000", 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614418+0000", 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.631 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614430+0000", 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2412000000000001e-05 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614440+0000", 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6080000000000002e-06 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614448+0000", 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6520000000000006e-06 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.632 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614650+0000", 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000202301 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614749+0000", 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8605999999999997e-05 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96214 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 995328~4096 in=4096b,write 1040384~4096 in=4096b,write 1105920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.614726+0000", 2024-04-26T12:33:03.633 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011181386, 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011302627000000001, 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96214 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614726+0000", 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.634 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614726+0000", 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614726+0000", 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614742+0000", 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6767000000000001e-05 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.635 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614751+0000", 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6459999999999999e-06 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614758+0000", 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4000000000000003e-06 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614795+0000", 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6628999999999998e-05 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.636 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614844+0000", 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8890000000000001e-05 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96215 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3944448~4096 in=4096b,write 4087808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.616583+0000", 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0093242570000000007, 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095229259999999993, 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.637 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96215 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616583+0000", 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.638 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616583+0000", 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616583+0000", 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616594+0000", 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1516e-05 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.639 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616604+0000", 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8989999999999996e-06 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616611+0000", 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4229999999999999e-06 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616699+0000", 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7365000000000001e-05 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616771+0000", 2024-04-26T12:33:03.640 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1859000000000004e-05 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96218 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 4096~4096 in=4096b,write 45056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.616622+0000", 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0092856380000000006, 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095582549999999999, 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.641 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96218 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616622+0000", 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616622+0000", 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.642 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616622+0000", 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616632+0000", 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0541e-05 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616639+0000", 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6969999999999996e-06 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.643 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616646+0000", 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.973e-06 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616864+0000", 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000218035 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616940+0000", 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5795000000000002e-05 2024-04-26T12:33:03.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626159+0000", 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092196699999999993 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96219 4.6 4:63e80496:::100000001f8.0000001e:head [write 2461696~4096 in=4096b,write 3072000~4096 in=4096b,write 3264512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.616655+0000", 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0092530449999999997, 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0096219979999999997, 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.645 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96219 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616655+0000", 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.646 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616655+0000", 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616654+0000", 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616665+0000", 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0419e-05 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.647 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616671+0000", 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2899999999999999e-06 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616676+0000", 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.22e-06 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623194+0000", 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0065175099999999998 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.648 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623252+0000", 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8065000000000001e-05 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:96220 4.13 e73/13 4:cbf33e86:::100000001f8.00000026:head v 73'3012, mlcod=73'3010)", 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.616833+0000", 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0090750520000000001, 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095195490000000004, 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.649 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616833+0000", 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616833+0000", 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616832+0000", 2024-04-26T12:33:03.650 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616847+0000", 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5308999999999999e-05 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616857+0000", 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0056e-05 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616864+0000", 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9949999999999999e-06 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.651 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616962+0000", 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7287999999999994e-05 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.616981+0000", 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9062000000000001e-05 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:96221 4.32 e73/13 4:4f726a0c:::100000001f8.00000012:head v 73'1534, mlcod=73'1531)", 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.617214+0000", 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0086936229999999993, 2024-04-26T12:33:03.652 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092028660000000005, 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617214+0000", 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617214+0000", 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617213+0000", 2024-04-26T12:33:03.653 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617228+0000", 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.472e-05 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617239+0000", 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0487e-05 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617251+0000", 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2509e-05 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617286+0000", 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4387000000000001e-05 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617316+0000", 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0833000000000001e-05 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.655 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96222 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3211264~4096 in=4096b,write 3366912~4096 in=4096b,write 3387392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.617318+0000", 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0085902080000000002, 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0091723510000000005, 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96222 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617318+0000", 2024-04-26T12:33:03.656 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617318+0000", 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617317+0000", 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617353+0000", 2024-04-26T12:33:03.657 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6439999999999997e-05 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617364+0000", 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0718e-05 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617372+0000", 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8259999999999993e-06 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.658 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617415+0000", 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3492999999999998e-05 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617498+0000", 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3048999999999997e-05 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96223 4.2f 4:f59f865b:::100000001f8.00000007:head [write 425984~4096 in=4096b,write 475136~4096 in=4096b,write 540672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.617608+0000", 2024-04-26T12:33:03.659 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0082998380000000004, 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.008962299, 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96223 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617608+0000", 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.660 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617608+0000", 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617607+0000", 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617620+0000", 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3142000000000001e-05 2024-04-26T12:33:03.661 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617630+0000", 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3179999999999996e-06 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617636+0000", 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4699999999999999e-06 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623554+0000", 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0059182510000000002 2024-04-26T12:33:03.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623646+0000", 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1118000000000004e-05 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96224 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.617930+0000", 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0079776150000000004, 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0087136350000000008, 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.663 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96224 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617930+0000", 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.664 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617930+0000", 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617929+0000", 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617947+0000", 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7051e-05 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.665 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617954+0000", 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1459999999999999e-06 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.617960+0000", 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7240000000000003e-06 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96225 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.618339+0000", 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0075691810000000003, 2024-04-26T12:33:03.666 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083457150000000001, 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96225 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618339+0000", 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.667 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618339+0000", 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618338+0000", 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618352+0000", 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4157e-05 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618363+0000", 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0774000000000001e-05 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618370+0000", 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6939999999999995e-06 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96227 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3719168~4096 in=4096b,write 3780608~4096 in=4096b,write 4026368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.669 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.618952+0000", 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0069556189999999997, 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0077774519999999998, 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96227 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618952+0000", 2024-04-26T12:33:03.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618952+0000", 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618951+0000", 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618971+0000", 2024-04-26T12:33:03.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9712999999999999e-05 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618982+0000", 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.063e-05 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.618989+0000", 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6499999999999996e-06 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619093+0000", 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000104095 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619155+0000", 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1365000000000006e-05 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96228 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.619236+0000", 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0066718760000000002, 2024-04-26T12:33:03.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0075437229999999996, 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96228 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619236+0000", 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619236+0000", 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619235+0000", 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619254+0000", 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9108000000000001e-05 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619265+0000", 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0662999999999999e-05 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619272+0000", 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9800000000000001e-06 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.676 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96229 4.37 4:eff9002a:::100000001f8.00000003:head [write 413696~4096 in=4096b,write 454656~4096 in=4096b,write 614400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.619874+0000", 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0060341989999999996, 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069609540000000001, 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96229 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.677 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619874+0000", 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619874+0000", 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619873+0000", 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619882+0000", 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9940000000000006e-06 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619890+0000", 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6159999999999996e-06 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.619894+0000", 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7310000000000001e-06 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623499+0000", 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0036048370000000001 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623575+0000", 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5475999999999994e-05 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96230 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 286720~4096 in=4096b,write 458752~4096 in=4096b,write 471040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.620199+0000", 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.005708543, 2024-04-26T12:33:03.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0067049880000000003, 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96230 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620199+0000", 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.681 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620199+0000", 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620199+0000", 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620217+0000", 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7819999999999999e-05 2024-04-26T12:33:03.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620222+0000", 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1050000000000003e-06 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620225+0000", 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.208e-06 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620259+0000", 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4513e-05 2024-04-26T12:33:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620312+0000", 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2794999999999999e-05 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96231 4.1c 4:39b842ef:::100000001f8.00000029:head [write 57344~4096 in=4096b,write 139264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.620494+0000", 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0054141730000000004, 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064547399999999996, 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.684 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96231 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620494+0000", 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620494+0000", 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620493+0000", 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620507+0000", 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4528999999999999e-05 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620517+0000", 2024-04-26T12:33:03.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0076e-05 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620524+0000", 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3439999999999997e-06 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620566+0000", 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2623000000000002e-05 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.620637+0000", 2024-04-26T12:33:03.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0907000000000004e-05 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96234 4.12 4:48ab9bde:::100000001f8.00000015:head [write 16384~4096 in=4096b,write 65536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.621319+0000", 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0045884599999999999, 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0056685579999999998, 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.688 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96234 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621319+0000", 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621319+0000", 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621319+0000", 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621327+0000", 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6589999999999996e-06 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621336+0000", 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6109999999999994e-06 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621342+0000", 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3389999999999998e-06 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621388+0000", 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5631999999999999e-05 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621491+0000", 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000103057 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.691 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96198 4.37 4:eff9002a:::100000001f8.00000003:head [write 106496~4096 in=4096b,write 155648~4096 in=4096b,write 192512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.608937+0000", 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.016971211999999999, 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018092957, 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96198 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.608937+0000", 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.608937+0000", 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.608936+0000", 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.608957+0000", 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0978000000000001e-05 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.608967+0000", 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0898e-05 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.608976+0000", 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6610000000000006e-06 2024-04-26T12:33:03.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.609019+0000", 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.248e-05 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.609104+0000", 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5826000000000001e-05 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.695 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96235 4.37 4:ef395e89:::100000001f8.00000020:head [write 2662400~4096 in=4096b,write 2732032~4096 in=4096b,write 2748416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.621517+0000", 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0043911169999999999, 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055537590000000001, 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96235 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621517+0000", 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621517+0000", 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621516+0000", 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621545+0000", 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9436000000000001e-05 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621552+0000", 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6819999999999997e-06 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621556+0000", 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3669999999999999e-06 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626496+0000", 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049399309999999998 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626583+0000", 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6953999999999995e-05 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96236 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.621849+0000", 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0040585179999999997, 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052599489999999999, 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96236 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621849+0000", 2024-04-26T12:33:03.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621849+0000", 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621849+0000", 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621885+0000", 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6649000000000001e-05 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621892+0000", 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.251e-06 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.621895+0000", 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6990000000000001e-06 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.702 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96237 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.622159+0000", 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0037492110000000001, 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0049830250000000003, 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96237 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622159+0000", 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622159+0000", 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622158+0000", 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622194+0000", 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6319999999999998e-05 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622201+0000", 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3080000000000004e-06 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622204+0000", 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.585e-06 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.705 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96238 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.622560+0000", 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0033473750000000001, 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0046131460000000003, 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96238 2024-04-26T12:33:03.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622560+0000", 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622560+0000", 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622560+0000", 2024-04-26T12:33:03.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622568+0000", 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5629999999999992e-06 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622575+0000", 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.601e-06 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622579+0000", 2024-04-26T12:33:03.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5760000000000002e-06 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96239 4.28 4:15eeb89b:::100000001f8.00000032:head [write 589824~4096 in=4096b,write 638976~4096 in=4096b,write 651264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.622881+0000", 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0030265489999999999, 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043271680000000002, 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96239 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622881+0000", 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622881+0000", 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622880+0000", 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622929+0000", 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9013e-05 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622939+0000", 2024-04-26T12:33:03.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6299999999999993e-06 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.622946+0000", 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4489999999999996e-06 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623496+0000", 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00055031899999999996 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623575+0000", 2024-04-26T12:33:03.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8962999999999996e-05 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96203 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3289088~4096 in=4096b,write 3350528~4096 in=4096b,write 3436544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.610989+0000", 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014918402000000001, 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016275135999999999, 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.713 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96203 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.610989+0000", 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.610989+0000", 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.610989+0000", 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.611001+0000", 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2278e-05 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.611011+0000", 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0059e-05 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.611018+0000", 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4739999999999999e-06 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.611060+0000", 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1350000000000002e-05 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.611140+0000", 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0276000000000002e-05 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96241 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.623516+0000", 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0023915719999999998, 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0037943370000000001, 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96241 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623516+0000", 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623516+0000", 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623515+0000", 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623533+0000", 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7453e-05 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623543+0000", 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0127e-05 2024-04-26T12:33:03.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623551+0000", 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96242 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 659456~4096 in=4096b,write 806912~4096 in=4096b,write 917504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.623864+0000", 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0020435430000000001, 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034806149999999998, 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.720 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96242 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623864+0000", 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623864+0000", 2024-04-26T12:33:03.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623863+0000", 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623909+0000", 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5714000000000003e-05 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623919+0000", 2024-04-26T12:33:03.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6970000000000005e-06 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623926+0000", 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.306e-06 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.623970+0000", 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3887000000000002e-05 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.624046+0000", 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6185000000000003e-05 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96245 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.624791+0000", 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00111713, 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025985729999999999, 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96245 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.624791+0000", 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.624791+0000", 2024-04-26T12:33:03.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.624790+0000", 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.624851+0000", 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1500000000000004e-05 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.624862+0000", 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0678e-05 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.624869+0000", 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4410000000000004e-06 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96207 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2482176~4096 in=4096b,write 2560000~4096 in=4096b,write 2617344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.612477+0000", 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.013430406000000001, 2024-04-26T12:33:03.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014971418, 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96207 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612477+0000", 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612477+0000", 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612477+0000", 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612491+0000", 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3961000000000001e-05 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612500+0000", 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0999999999999993e-06 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612510+0000", 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0166999999999999e-05 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612557+0000", 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6743999999999998e-05 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612643+0000", 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6139999999999999e-05 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96246 4.28 4:153ae410:::100000001f8.0000003b:head [write 1540096~4096 in=4096b,write 1671168~4096 in=4096b,write 2072576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.625092+0000", 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00081617799999999998, 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024270540000000001, 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.731 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96246 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625092+0000", 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625092+0000", 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625091+0000", 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625145+0000", 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3817000000000003e-05 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625153+0000", 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2099999999999993e-06 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.733 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625159+0000", 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8669999999999999e-06 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625568+0000", 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00040896800000000001 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625622+0000", 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4539000000000001e-05 2024-04-26T12:33:03.734 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96208 4.36 4:6fa85f86:::100000001f8.00000013:head [write 315392~4096 in=4096b,write 425984~4096 in=4096b,write 1064960~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.612827+0000", 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.013080540999999999, 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014775124000000001, 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.735 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96208 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612827+0000", 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612827+0000", 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.736 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612826+0000", 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612836+0000", 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9809999999999998e-06 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612848+0000", 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1931e-05 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.737 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.612854+0000", 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8680000000000004e-06 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614340+0000", 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0014854860000000001 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.614390+0000", 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0232000000000003e-05 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.738 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96248 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.625868+0000", 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 3.968e-05, 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0018160679999999999, 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96248 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625868+0000", 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625868+0000", 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625867+0000", 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625923+0000", 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5386000000000001e-05 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625934+0000", 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1107999999999999e-05 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.625941+0000", 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.452e-06 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.741 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:96249 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2125824~4096 in=4096b,write 2330624~4096 in=4096b,write 2363392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.626206+0000", 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.999702, 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001546951, 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 96249 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.742 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626206+0000", 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626206+0000", 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626205+0000", 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:03.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626248+0000", 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2438000000000003e-05 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626257+0000", 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626264+0000", 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5719999999999999e-06 2024-04-26T12:33:03.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626332+0000", 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8091999999999998e-05 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.626394+0000", 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2799000000000006e-05 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:96252 4.18 e73/59)", 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:03.627774+0000", 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9981337, 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4608000000000003e-05, 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.627774+0000", 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:03.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.627774+0000", 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.627773+0000", 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.627791+0000", 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8241e-05 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.627801+0000", 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7909999999999999e-06 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:03.627808+0000", 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0280000000000003e-06 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 33 2024-04-26T12:33:03.748 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:03.750 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:03.750 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:03.748+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:03.850 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:03.849+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:03.952 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:03.951+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:03.972 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:33:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:33:03.972 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:33:03.972 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:03.988 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:04.053 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:04.052+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:04.154 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:04.153+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:04.219 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:04.219 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.098893670999999, 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.220 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.221 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.222 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:33:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.224 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.098765457999999, 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.225 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:33:04.228 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.098653574, 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.229 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.230 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.232 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.233 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.098636219999999, 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:33:04.234 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:04.235 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:33:04.236 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.237 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.098589261000001, 2024-04-26T12:33:04.238 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.239 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.240 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.241 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.242 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.098569274999999, 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:04.243 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.244 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:33:04.245 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:33:04.246 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.247 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.098514936000001, 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.248 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.249 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.250 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.251 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.095644478000001, 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.252 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:04.253 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.254 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.255 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.256 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.257 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.094633470000002, 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.258 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:33:04.259 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.262 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.263 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.094533166000002, 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:04.264 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.265 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.266 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.267 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:33:04.268 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.094398419000001, 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.269 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.270 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.271 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.272 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:33:04.273 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:33:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.094077421000001, 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.275 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.276 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:33:04.277 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.278 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.279 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.280 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.093585156, 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.281 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.282 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:33:04.283 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:33:04.284 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.287 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:33:04.288 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.093492264000002, 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:33:04.289 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.290 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.291 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.292 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.293 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:33:04.294 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.093383823, 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:33:04.295 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:33:04.296 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:33:04.297 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.298 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.299 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:04.300 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.093200694, 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.301 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:33:04.302 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.303 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.304 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.093181886, 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:33:04.306 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:33:04.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.091523030000001, 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.312 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:04.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:33:04.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.083210524999998, 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.318 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:33:04.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:33:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:33:04.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.323 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 28.080220772000001, 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:04.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:33:04.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:33:04.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:33:04.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:33:04.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:33:04.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.329 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:04.329 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:04.329 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:04.330 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:04.329+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:04.331 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:33:04.331 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:04.431 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:04.430+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:04.494 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:04.494 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:04.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.494 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:98139 4.13 4:cbf33e86:::100000001f8.00000026:head [write 237568~4096 in=4096b,write 319488~4096 in=4096b,write 327680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-26T12:33:04.494 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:04.488164+0000", 2024-04-26T12:33:04.494 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0051524359999999998, 2024-04-26T12:33:04.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0051744529999999999, 2024-04-26T12:33:04.494 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 98139 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.488164+0000", 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.488164+0000", 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.488164+0000", 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.488175+0000", 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141000000000001e-05 2024-04-26T12:33:04.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.488184+0000", 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5310000000000007e-06 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.488192+0000", 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3860000000000001e-06 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.488962+0000", 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00077064699999999996 2024-04-26T12:33:04.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.489015+0000", 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.321e-05 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.489104+0000", 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8270999999999996e-05 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:98144 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 2105344~4096 in=4096b,write 2158592~4096 in=4096b,write 2523136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:04.490571+0000", 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0027459310000000001, 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0028447640000000001, 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 98144 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490571+0000", 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490571+0000", 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490570+0000", 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490583+0000", 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.307e-05 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490596+0000", 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2959000000000001e-05 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490604+0000", 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5339999999999999e-06 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490649+0000", 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5006999999999998e-05 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490705+0000", 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5432000000000001e-05 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.502 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:98145 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 3465216~4096 in=4096b,write 3571712~4096 in=4096b,write 3870720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:04.490961+0000", 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0023552479999999999, 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0025526469999999999, 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 98145 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490961+0000", 2024-04-26T12:33:04.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490961+0000", 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490961+0000", 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:04.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490973+0000", 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.205e-05 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490985+0000", 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1941e-05 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.490992+0000", 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2910000000000002e-06 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.493180+0000", 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00218834 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.493257+0000", 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6902000000000003e-05 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:98148 4.29 4:94178d8a:::100000001f8.00000006:head [write 2957312~4096 in=4096b,write 2977792~4096 in=4096b,write 3121152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:04.492027+0000", 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0012897519999999999, 2024-04-26T12:33:04.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001535355, 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 98148 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492027+0000", 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492027+0000", 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492026+0000", 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492042+0000", 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6104999999999999e-05 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492055+0000", 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2218999999999999e-05 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492062+0000", 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8380000000000002e-06 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492102+0000", 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9301999999999997e-05 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492167+0000", 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5587999999999996e-05 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:98147 4.24 e74/13 4:27adda6e:::100000001f8.0000000f:head v 74'1530, mlcod=74'1528)", 2024-04-26T12:33:04.510 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:04.492585+0000", 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00073121500000000001, 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0010443830000000001, 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492585+0000", 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492585+0000", 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:04.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492585+0000", 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492596+0000", 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1387e-05 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492605+0000", 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9199999999999993e-06 2024-04-26T12:33:04.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492610+0000", 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9139999999999999e-06 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492649+0000", 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8739999999999998e-05 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:04.492671+0000", 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1911000000000001e-05 2024-04-26T12:33:04.513 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.514 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:04.514 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.514 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:04.514 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:33:04.514 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 5 2024-04-26T12:33:04.514 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:04.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:04.531 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:04.530+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:04.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:33:04.632 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:04.631+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:04.676 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:04.677 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:04.677 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:33:04.677 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:33:04.677 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:04.691 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:04.733 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:04.732+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:04.741 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:04.765 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:04.766 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:04.766 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:04.766 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:04.769 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:04.769 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:04.834 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:04.833+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:04.908 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:04.908 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:04.923 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:04.964 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:04.963+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:05.035 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:05.034+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:05.118 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:05.119 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:05.134 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:05.136 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:05.135+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:05.236 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:05.236+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:05.340 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:05.337+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:05.362 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:05.362 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:05.377 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:05.437 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:05.437+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:05.540 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:05.538+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:05.597 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:05.597 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:05.609 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:05.653 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:05.652+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:05.741 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:05.739+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:05.780 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:05.780 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:05.795 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:05.843 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:05.840+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:05.943 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:05.941+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:06.002 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:06.003 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:06.018 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:06.044 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:06.043+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:06.145 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:06.144+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:06.190 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:06.190 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:06.205 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:06.246 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:06.245+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:06.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:33:06.347 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:06.346+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:06.386 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:06.386 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:06.402 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:06.447 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:06.447+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:06.551 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:06.550+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:06.601 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:06.601 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:06.611 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:06.652 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:06.651+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:06.753 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:06.752+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:06.770 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:33:06.802 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:06.802 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:06.820 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:06.841 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:33:06.863 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:06.861+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:06.955 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:06.953+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:06.976 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:06.997 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:06.998 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:06.999 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:06.999 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:07.000 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:07.000 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:07.003 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:07.003 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:07.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:07.057 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:07.056+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:07.156 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:07.155+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:07.185 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:07.185 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:07.185 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:33:07.185 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:33:07.185 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:07.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:07.256 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:07.255+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:07.358 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:07.356+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:07.412 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:07.412 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:33:07.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:33:07.412 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:07.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.412 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:07.412 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:07.412 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.335271014, 2024-04-26T12:33:07.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:33:07.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.328196864999999, 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:33:07.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:07.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.424 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.321035384999998, 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.425 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:07.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:07.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:33:07.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:33:07.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.431 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.320646782000001, 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:33:07.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:33:07.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.320317076999999, 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:33:07.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:33:07.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.318474511000002, 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:33:07.444 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:33:07.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:33:07.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:33:07.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:07.450 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.314121805999999, 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:07.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.290436175, 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.459 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:07.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:33:07.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:33:07.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:33:07.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:33:07.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:33:07.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:33:07.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:33:07.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:33:07.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:33:07.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:33:07.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:33:07.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:33:07.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:33:07.466 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.466 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.467 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.467 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.467 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:07.468 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.290288449999998, 2024-04-26T12:33:07.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:33:07.468 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.468 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.468 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.468 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.469 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.469 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:33:07.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.469 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:07.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:07.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:07.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:33:07.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:33:07.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:33:07.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:33:07.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:33:07.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:33:07.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:33:07.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:33:07.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:33:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:33:07.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.290231366, 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.477 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:33:07.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:33:07.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:33:07.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:33:07.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:33:07.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:33:07.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.290204088999999, 2024-04-26T12:33:07.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:33:07.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:33:07.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.290162392999999, 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.490 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:33:07.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:33:07.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.290116158, 2024-04-26T12:33:07.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:07.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:33:07.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:33:07.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:33:07.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:33:07.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:33:07.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:33:07.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:33:07.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:33:07.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:33:07.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:33:07.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:33:07.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:33:07.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:33:07.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:33:07.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:33:07.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:33:07.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:33:07.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:33:07.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:33:07.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:33:07.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:33:07.506 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.506 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.507 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.507 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.507 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:07.507 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.290082873999999, 2024-04-26T12:33:07.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:33:07.508 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.508 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.508 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.508 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.508 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.508 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:33:07.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:33:07.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:33:07.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:33:07.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:33:07.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:33:07.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:33:07.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.290052800000002, 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:33:07.515 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:33:07.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:33:07.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:33:07.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:33:07.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:33:07.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:33:07.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:33:07.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:33:07.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:33:07.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:33:07.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:33:07.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:33:07.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:33:07.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:33:07.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.521 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:33:07.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:33:07.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:33:07.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:33:07.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:33:07.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:33:07.523 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.523 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.523 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.524 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.524 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:07.524 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.290016536, 2024-04-26T12:33:07.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:33:07.524 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.524 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.524 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.525 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.525 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.525 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:33:07.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.525 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:07.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:07.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:07.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:33:07.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:33:07.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:33:07.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:33:07.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:33:07.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:33:07.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:33:07.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:33:07.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:33:07.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:33:07.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.530 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.530 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:33:07.530 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:33:07.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:33:07.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:33:07.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.531 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.531 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:33:07.531 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:33:07.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:33:07.532 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:33:07.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.532 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.532 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.289962065000001, 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.533 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.534 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.535 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:33:07.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:33:07.538 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.289936656999998, 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.539 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.540 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.541 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.542 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.543 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.544 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.289912827999999, 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.545 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.546 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:33:07.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:33:07.549 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.550 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:33:07.551 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:33:07.551 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.551 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.551 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.551 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:07.551 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:07.551 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 31.285764508, 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.552 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:33:07.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.554 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.555 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:07.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:07.557 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:07.557 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:33:07.557 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:33:07.557 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.557 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.557 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.557 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:07.557 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:07.557 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:07.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~30s 2024-04-26T12:33:07.559 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:07.557+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:07.559 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:07.659 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:07.658+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105147 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3670016~8192 in=8192b,write 3772416~4096 in=4096b,write 3985408~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.737874+0000", 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.013424831999999999, 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013455015000000001, 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.755 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105147 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.737874+0000", 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.737874+0000", 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.737874+0000", 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.737885+0000", 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1314999999999999e-05 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.737896+0000", 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0879999999999999e-05 2024-04-26T12:33:07.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.737904+0000", 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9130000000000003e-06 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744594+0000", 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006690161 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744816+0000", 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00022208500000000001 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105151 4.19 4:997b7129:::100000001f8.00000000:head [write 704512~4096 in=4096b,write 720896~4096 in=4096b,write 729088~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.739300+0000", 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.01199911, 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012111078000000001, 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.759 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105151 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.739300+0000", 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.739300+0000", 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.739299+0000", 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.739312+0000", 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2388999999999999e-05 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.739326+0000", 2024-04-26T12:33:07.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4591e-05 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.739334+0000", 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0500000000000003e-06 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.741363+0000", 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020299879999999999 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.741488+0000", 2024-04-26T12:33:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00012470100000000001 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105156 4.37 4:eff9002a:::100000001f8.00000003:head [write 2920448~4096 in=4096b,write 3047424~4096 in=4096b,write 3137536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.740786+0000", 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.010512982000000001, 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010701616000000001, 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.763 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105156 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.740786+0000", 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.740786+0000", 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.740786+0000", 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.740800+0000", 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.489e-05 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.740811+0000", 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0349999999999999e-05 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.740819+0000", 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.875e-06 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743214+0000", 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002394864 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743309+0000", 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5261999999999997e-05 2024-04-26T12:33:07.766 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:105159 4.13 e75/13 4:cbf33e86:::100000001f8.00000026:head v 75'3305, mlcod=75'3302)", 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.742153+0000", 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0091465520000000005, 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0093998510000000007, 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.742153+0000", 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.742153+0000", 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.742152+0000", 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.742179+0000", 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7433999999999999e-05 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.742189+0000", 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7620000000000007e-06 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.742196+0000", 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4540000000000004e-06 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.742232+0000", 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6686000000000001e-05 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.742258+0000", 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5499000000000001e-05 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.770 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:105162 4.27 e75/52 4:e68799fb:::100000001f8.00000018:head v 75'1673, mlcod=75'1670)", 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.743437+0000", 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0078619799999999993, 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0081753060000000002, 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743437+0000", 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743437+0000", 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743437+0000", 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743451+0000", 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4260999999999999e-05 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743460+0000", 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7690000000000002e-06 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743466+0000", 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0959999999999997e-06 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743511+0000", 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5058999999999997e-05 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743529+0000", 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7748999999999999e-05 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105163 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 700416~4096 in=4096b,write 765952~4096 in=4096b,write 774144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.743584+0000", 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0077151310000000001, 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080908060000000007, 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.774 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105163 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743584+0000", 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743584+0000", 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743583+0000", 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743595+0000", 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1865000000000001e-05 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.776 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743605+0000", 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7419999999999992e-06 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743613+0000", 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4910000000000005e-06 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743666+0000", 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2428e-05 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.777 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.743744+0000", 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8601000000000002e-05 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105123 4.6 4:616d4c41:::100000001f8.00000034:head [write 20480~4096 in=4096b,write 315392~4096 in=4096b,write 704512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.728934+0000", 2024-04-26T12:33:07.778 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.022365341, 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022810005000000001, 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105123 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.728934+0000", 2024-04-26T12:33:07.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.728934+0000", 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.728933+0000", 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.728945+0000", 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.219e-05 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.728954+0000", 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9660000000000002e-06 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.728960+0000", 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9240000000000004e-06 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.729008+0000", 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7579e-05 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.729093+0000", 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4980000000000003e-05 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.785 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:105166 4.8 e75/52 4:11ee3b64:::100000001f8.0000003e:head v 75'1666, mlcod=75'1663)", 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.744925+0000", 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0063745609999999999, 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0068871310000000003, 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744925+0000", 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744925+0000", 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744924+0000", 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744939+0000", 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4885000000000001e-05 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744948+0000", 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6049999999999998e-06 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744955+0000", 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745006+0000", 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1088000000000003e-05 2024-04-26T12:33:07.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745024+0000", 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7584999999999999e-05 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105169 4.15 4:aada5e43:::100000001f8.00000028:head [write 2822144~4096 in=4096b,write 2875392~4096 in=4096b,write 2912256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.745735+0000", 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0055646480000000002, 2024-04-26T12:33:07.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006141858, 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105169 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.790 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745735+0000", 2024-04-26T12:33:07.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745735+0000", 2024-04-26T12:33:07.791 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745733+0000", 2024-04-26T12:33:07.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999986 2024-04-26T12:33:07.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745746+0000", 2024-04-26T12:33:07.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.307e-05 2024-04-26T12:33:07.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745756+0000", 2024-04-26T12:33:07.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8300000000000008e-06 2024-04-26T12:33:07.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745764+0000", 2024-04-26T12:33:07.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4880000000000001e-06 2024-04-26T12:33:07.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745847+0000", 2024-04-26T12:33:07.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3336000000000003e-05 2024-04-26T12:33:07.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745933+0000", 2024-04-26T12:33:07.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5877000000000005e-05 2024-04-26T12:33:07.795 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.795 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.795 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.796 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:105164 4.3d e75/13 4:bd3afb9d:::100000001f8.00000009:head v 75'3263, mlcod=75'3260)", 2024-04-26T12:33:07.796 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.745919+0000", 2024-04-26T12:33:07.796 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00538047, 2024-04-26T12:33:07.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060235009999999997, 2024-04-26T12:33:07.796 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.796 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.796 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745919+0000", 2024-04-26T12:33:07.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.797 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.797 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745919+0000", 2024-04-26T12:33:07.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745918+0000", 2024-04-26T12:33:07.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745931+0000", 2024-04-26T12:33:07.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2434e-05 2024-04-26T12:33:07.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745939+0000", 2024-04-26T12:33:07.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6160000000000002e-06 2024-04-26T12:33:07.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745946+0000", 2024-04-26T12:33:07.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3370000000000002e-06 2024-04-26T12:33:07.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.748032+0000", 2024-04-26T12:33:07.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020856109999999998 2024-04-26T12:33:07.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.748062+0000", 2024-04-26T12:33:07.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9737999999999999e-05 2024-04-26T12:33:07.801 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.801 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.801 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.802 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:105168 4.3 e75/52 4:c222b65c:::100000001f8.00000021:head v 75'1633, mlcod=75'1631)", 2024-04-26T12:33:07.802 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.745952+0000", 2024-04-26T12:33:07.802 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0053469850000000003, 2024-04-26T12:33:07.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006051435, 2024-04-26T12:33:07.802 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.802 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.802 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745952+0000", 2024-04-26T12:33:07.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745952+0000", 2024-04-26T12:33:07.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745952+0000", 2024-04-26T12:33:07.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745963+0000", 2024-04-26T12:33:07.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0849000000000001e-05 2024-04-26T12:33:07.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.805 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745968+0000", 2024-04-26T12:33:07.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4489999999999998e-06 2024-04-26T12:33:07.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.745973+0000", 2024-04-26T12:33:07.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2320000000000003e-06 2024-04-26T12:33:07.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.746256+0000", 2024-04-26T12:33:07.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00028308899999999999 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.746274+0000", 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7906000000000001e-05 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105129 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2256896~4096 in=4096b,write 2506752~4096 in=4096b,write 2564096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.731070+0000", 2024-04-26T12:33:07.807 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020229319999999999, 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021003748999999999, 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105129 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.731070+0000", 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.731070+0000", 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.731069+0000", 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.731129+0000", 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9509000000000002e-05 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.731137+0000", 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2490000000000001e-06 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.731143+0000", 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5099999999999998e-06 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.738072+0000", 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0069295829999999996 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.738157+0000", 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4567999999999994e-05 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.811 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:105170 4.8 e75/52 4:11ee3b64:::100000001f8.0000003e:head v 75'1667, mlcod=75'1663)", 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.746416+0000", 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0048831530000000003, 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057317619999999996, 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.746416+0000", 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.812 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.746416+0000", 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.746416+0000", 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.746430+0000", 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4823e-05 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.813 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.746438+0000", 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5859999999999999e-06 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.746444+0000", 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5600000000000001e-06 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.748476+0000", 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020328490000000002 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.814 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.748497+0000", 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0299999999999999e-05 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105174 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2273280~4096 in=4096b,write 2310144~4096 in=4096b,write 2506752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.747315+0000", 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0039837700000000002, 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.004905698, 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.815 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105174 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747315+0000", 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747315+0000", 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.816 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747314+0000", 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747327+0000", 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2852e-05 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.817 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747340+0000", 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2490999999999999e-05 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747348+0000", 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8509999999999999e-06 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.748174+0000", 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00082655100000000002 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.818 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.748268+0000", 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4130999999999997e-05 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:105167 4.3d e75/13 4:bd3afb9d:::100000001f8.00000009:head v 75'3264, mlcod=75'3260)", 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.747834+0000", 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.003465414, 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044644000000000003, 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.819 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747834+0000", 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747834+0000", 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747833+0000", 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.820 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747844+0000", 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0671e-05 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747851+0000", 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3409999999999997e-06 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.747857+0000", 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.716e-06 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.821 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.752129+0000", 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042718770000000003 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.752141+0000", 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2306e-05 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.822 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105177 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2641920~4096 in=4096b,write 2678784~4096 in=4096b,write 2707456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.749747+0000", 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0015518960000000001, 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026264880000000002, 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105177 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.823 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.749747+0000", 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.749747+0000", 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.749746+0000", 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.824 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.749760+0000", 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3788000000000001e-05 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.749773+0000", 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3159000000000001e-05 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.749782+0000", 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7700000000000007e-06 2024-04-26T12:33:07.825 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.749816+0000", 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4251999999999997e-05 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.749875+0000", 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9224000000000001e-05 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.826 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105178 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 3248128~8192 in=8192b,write 3268608~4096 in=4096b,write 3342336~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.750119+0000", 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0011806900000000001, 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023269660000000002, 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105178 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.750119+0000", 2024-04-26T12:33:07.827 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.750119+0000", 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.750118+0000", 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.828 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.750132+0000", 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3689000000000001e-05 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.750141+0000", 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1759999999999999e-06 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.750146+0000", 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1900000000000003e-06 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.829 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.750176+0000", 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9828999999999999e-05 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.750226+0000", 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0268000000000001e-05 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105180 4.24 4:27adda6e:::100000001f8.0000000f:head [write 1232896~4096 in=4096b,write 1273856~4096 in=4096b,write 1478656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.830 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.751073+0000", 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.000225944, 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001446613, 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105180 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751073+0000", 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.831 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751073+0000", 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751072+0000", 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751084+0000", 2024-04-26T12:33:07.832 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1873e-05 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751095+0000", 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0363999999999999e-05 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751102+0000", 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0430000000000002e-06 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.833 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751159+0000", 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7080999999999998e-05 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751232+0000", 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3520000000000001e-05 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751382+0000", 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014962800000000001 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.834 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:105179 4.18 e75/59 4:1a1c818c:::100000001f8.0000000d:head v 75'1654, mlcod=75'1652)", 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.751109+0000", 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00019000000000000001, 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001488839, 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751109+0000", 2024-04-26T12:33:07.835 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751109+0000", 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751108+0000", 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.836 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751123+0000", 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4208e-05 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751132+0000", 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.499e-06 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751140+0000", 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7079999999999997e-06 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.837 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751187+0000", 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6802999999999999e-05 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751206+0000", 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9281000000000001e-05 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105137 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 1519616~4096 in=4096b,write 1785856~4096 in=4096b,write 1859584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.838 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.733973+0000", 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017325864, 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018695021999999999, 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105137 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.733973+0000", 2024-04-26T12:33:07.839 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.733973+0000", 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.733973+0000", 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.734054+0000", 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1533999999999996e-05 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.734065+0000", 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0722e-05 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.734072+0000", 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5270000000000001e-06 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.740358+0000", 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062857030000000001 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.740450+0000", 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1575000000000003e-05 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105181 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1536000~4096 in=4096b,write 1556480~4096 in=4096b,write 1585152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.842 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.751624+0000", 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9996748, 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0011260440000000001, 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105181 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751624+0000", 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.843 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751624+0000", 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751624+0000", 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.844 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751640+0000", 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5985e-05 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751650+0000", 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0033e-05 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751656+0000", 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7850000000000003e-06 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.845 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751698+0000", 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1233999999999999e-05 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.751799+0000", 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000101294 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:105140 4.6 4:616d4c41:::100000001f8.00000034:head [write 3457024~4096 in=4096b,write 3596288~4096 in=4096b,write 3657728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:07.846 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.735215+0000", 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.016084546000000002, 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017635774, 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 105140 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735215+0000", 2024-04-26T12:33:07.847 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735215+0000", 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735214+0000", 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735224+0000", 2024-04-26T12:33:07.848 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735232+0000", 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9400000000000008e-06 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735238+0000", 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6180000000000003e-06 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.849 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744678+0000", 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0094403709999999995 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.744772+0000", 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3387999999999994e-05 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:105139 4.e e75/13 4:73e84e43:::100000001f8.00000004:head v 75'1684, mlcod=75'1682)", 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:07.735257+0000", 2024-04-26T12:33:07.850 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.016042279, 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017664776, 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735257+0000", 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735257+0000", 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:07.851 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735256+0000", 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735339+0000", 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2799999999999993e-05 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735347+0000", 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1480000000000006e-06 2024-04-26T12:33:07.852 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.735353+0000", 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.736255+0000", 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000902205 2024-04-26T12:33:07.853 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:07.736274+0000", 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9598000000000001e-05 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 23 2024-04-26T12:33:07.854 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:07.856 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:07.856 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:07.854+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:07.956 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:07.955+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:08.058 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:08.057+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:08.077 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:33:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:33:08.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:33:08.077 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:08.093 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:08.159 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:08.158+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:08.259 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:08.258+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:08.327 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.206175342999998, 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.329 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:33:08.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.329 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:08.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:33:08.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:33:08.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.206047130000002, 2024-04-26T12:33:08.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:33:08.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.205935246000003, 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.339 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:33:08.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:33:08.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:33:08.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:33:08.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.205917892000002, 2024-04-26T12:33:08.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:08.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:08.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:08.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:33:08.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:33:08.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.205870933, 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:08.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:08.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:33:08.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:33:08.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.354 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.205850947000002, 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:33:08.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.359 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.205796608, 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:33:08.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.202926150000003, 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.364 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:33:08.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:33:08.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:33:08.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.201915141999997, 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:33:08.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.372 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.201814837999997, 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:33:08.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.201680091, 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.381 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.386 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.201359093000001, 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:33:08.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:33:08.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.392 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.200866828000002, 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:33:08.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:33:08.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:33:08.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:33:08.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:33:08.398 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.399 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.399 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.399 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.200773935999997, 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.200665495000003, 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.405 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:08.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:33:08.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:33:08.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:33:08.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.200482366000003, 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.411 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:08.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.200463558000003, 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.417 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:08.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.419 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.420 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.422 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.198804701999997, 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:33:08.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:33:08.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.427 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.190492196999998, 2024-04-26T12:33:08.428 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.429 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:33:08.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:33:08.433 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 32.187502444000003, 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.434 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.435 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:08.439 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:08.441 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:08.441 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:08.439+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:08.541 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:08.541+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:08.614 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:08.614 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:08.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.614 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:107057 4.30 4:0c89e311:::100000001f8.00000017:head [write 2818048~4096 in=4096b,write 2826240~4096 in=4096b,write 2863104~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:08.614 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:08.612535+0000", 2024-04-26T12:33:08.614 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00084911700000000004, 2024-04-26T12:33:08.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00087933900000000003, 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 107057 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.612535+0000", 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.612535+0000", 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.612535+0000", 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.612560+0000", 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5565e-05 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.612569+0000", 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.612575+0000", 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3129999999999998e-06 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.612618+0000", 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3689000000000001e-05 2024-04-26T12:33:08.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.612719+0000", 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000100635 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:107059 4.2c 4:36128e15:::100000001f8.00000008:head [write 3985408~4096 in=4096b,write 4075520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:08.613298+0000", 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 8.6316999999999994e-05, 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017334499999999999, 2024-04-26T12:33:08.618 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 107059 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.613298+0000", 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:08.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.613298+0000", 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.613297+0000", 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.613309+0000", 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1882000000000001e-05 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:08.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.613323+0000", 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4054e-05 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.613333+0000", 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.6779999999999995e-06 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.613380+0000", 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7055999999999998e-05 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.613462+0000", 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2352e-05 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:107049 4.11 4:893be98d:::100000001f8.00000001:head [write 229376~4096 in=4096b,write 274432~4096 in=4096b,write 380928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:08.608613+0000", 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0047715680000000003, 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.004915155, 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:08.622 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 107049 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.608613+0000", 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.608613+0000", 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.608612+0000", 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.608632+0000", 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9432999999999998e-05 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.608641+0000", 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0589999999999992e-06 2024-04-26T12:33:08.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.608648+0000", 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1029999999999996e-06 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.608688+0000", 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0147e-05 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.608765+0000", 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6750999999999998e-05 2024-04-26T12:33:08.625 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:107050 4.22 4:47e99c31:::100000001f8.00000025:head [write 3350528~4096 in=4096b,write 3371008~4096 in=4096b,write 3457024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:08.609014+0000", 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0043704549999999997, 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0045850810000000004, 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:08.626 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 107050 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.609014+0000", 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.609014+0000", 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.609013+0000", 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.609041+0000", 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7361000000000001e-05 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.609051+0000", 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.006e-05 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.609058+0000", 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4420000000000001e-06 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.609106+0000", 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8007000000000003e-05 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.609177+0000", 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0871999999999995e-05 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.609310+0000", 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000133356 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611493+0000", 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0021827909999999999 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.630 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:107052 4.31 4:8fb8ba0c:::100000001f8.00000024:head [write 2240512~4096 in=4096b,write 2322432~4096 in=4096b,write 2330624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:08.610134+0000", 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0032505839999999999, 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0035495990000000001, 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 107052 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:08.631 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610134+0000", 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610134+0000", 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610133+0000", 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:08.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610158+0000", 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.4219999999999999e-05 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610170+0000", 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.226e-05 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610175+0000", 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3249999999999998e-06 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610203+0000", 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8234000000000001e-05 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610252+0000", 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8130000000000002e-05 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610340+0000", 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8568999999999999e-05 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.612110+0000", 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001770048 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:107054 4.d 4:b1164065:::100000001f8.00000035:head [write 1265664~4096 in=4096b,write 1277952~4096 in=4096b,write 1413120~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:08.610997+0000", 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0023878599999999999, 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0027485320000000001, 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 107054 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610997+0000", 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610997+0000", 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.610996+0000", 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611031+0000", 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5488000000000003e-05 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611043+0000", 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1423999999999999e-05 2024-04-26T12:33:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611050+0000", 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.221e-06 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611092+0000", 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2191000000000003e-05 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611143+0000", 2024-04-26T12:33:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0317e-05 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611252+0000", 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000109051 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.613434+0000", 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002182411 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:107055 4.38 4:1dcf718c:::100000001f8.00000022:head [write 2555904~8192 in=8192b,write 2691072~4096 in=4096b,write 2953216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:08.611372+0000", 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0020129280000000002, 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002429517, 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 107055 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611372+0000", 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611372+0000", 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611371+0000", 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611414+0000", 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2590999999999999e-05 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611425+0000", 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1079e-05 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611437+0000", 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2534999999999999e-05 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611479+0000", 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2230000000000001e-05 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:08.611561+0000", 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2066999999999999e-05 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 7 2024-04-26T12:33:08.643 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:08.645 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:08.645 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:08.644+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:08.745 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:08.745+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:08.847 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:08.846+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:08.855 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:33:08.855 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:33:08.855 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:08.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:33:08.869 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:08.947 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:08.946+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:09.004 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:33:09.048 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:09.047+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:09.094 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 33.018176379000003, 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.095 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:33:09.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:33:09.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 33.011102229999999, 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:33:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:33:09.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:33:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:33:09.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 33.003940749999998, 2024-04-26T12:33:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:33:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.108 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:33:09.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 33.003552147000001, 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.117 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:33:09.118 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:33:09.119 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 33.003222442000002, 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.122 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:33:09.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:33:09.124 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.125 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 33.001379876000001, 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:33:09.127 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:09.128 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.129 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:33:09.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:33:09.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:33:09.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.997027170999999, 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:33:09.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:33:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:33:09.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.97334154, 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.140 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.973193815000002, 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:33:09.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:33:09.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.152 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.973136730999997, 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:09.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:33:09.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:33:09.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.973109454000003, 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.158 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:33:09.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:33:09.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.973067757999999, 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.164 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:33:09.169 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.973021523, 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.170 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.972988239000003, 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.176 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:33:09.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:33:09.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.972958165000001, 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.182 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:09.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:33:09.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.972921900999999, 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:33:09.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:33:09.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.972867430000001, 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:09.199 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.972842022000002, 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:33:09.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:33:09.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:33:09.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.972818193000002, 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.205 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:33:09.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:33:09.210 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 32.968669873000003, 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:33:09.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:09.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:09.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.215 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.216 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:09.217 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:09.217 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:09.218 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:09.218 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:09.217+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:09.219 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:09.233 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:09.233 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:09.233 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:09.233 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:09.236 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:09.237 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:09.319 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:09.318+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:09.420 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:09.420 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:09.421 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:09.419+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:09.432 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:09.520 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:09.519+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:09.622 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:09.621+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:09.658 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:09.658 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:09.669 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:09.723 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:09.722+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:09.827 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:09.826+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:09.898 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:09.898 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:09.913 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:09.956 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:09.956+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:10.029 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:10.028+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:10.076 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:33:10.091 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:10.091 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:10.105 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:10.146 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:10.145+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:10.234 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:10.231+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:10.305 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:10.306 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:10.318 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:10.332 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:10.331+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:10.433 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:10.432+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:10.533 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:10.533+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:10.540 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:10.540 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:10.555 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:10.635 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:10.634+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:10.735 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:10.735+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:10.743 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:10.743 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:10.751 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:10.836 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:10.835+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:10.937 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:10.937 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:10.937 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:10.936+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:10.953 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:11.040 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:11.039+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:11.139 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:11.138+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:11.182 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:11.182 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:11.199 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:11.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:33:11.244 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:11.243+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:11.340 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:11.339+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:11.374 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:11.374 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:11.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:11.431 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:11.456 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:11.457 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:11.457 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:11.457 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:11.460 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:11.460 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:11.473 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:11.472+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:11.543 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:11.542+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:11.599 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:11.599 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:11.599 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:33:11.599 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:33:11.600 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:11.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:11.655 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:11.654+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:11.743 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:11.743+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:11.822 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:11.822 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:33:11.822 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:33:11.822 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.745348270999997, 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.823 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.824 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:33:11.825 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:11.826 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.827 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.828 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.738274122, 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:33:11.830 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:33:11.832 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:33:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:33:11.834 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.731112641999999, 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.835 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.836 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.837 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:33:11.838 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:33:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:33:11.840 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.730724039000002, 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.841 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.842 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:33:11.843 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.844 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.845 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.846 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:11.847 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.730394334000003, 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.848 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.849 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:33:11.850 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:33:11.851 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:33:11.852 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.728551768000003, 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:33:11.853 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.854 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.855 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.856 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.857 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.858 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.724199063, 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.859 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.861 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:33:11.862 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.863 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.864 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700513432000001, 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:33:11.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700365707000003, 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700308622999998, 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.876 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:33:11.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700281345999997, 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.70023965, 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.887 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:11.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.892 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700193415000001, 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:33:11.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:33:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:33:11.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700160130999997, 2024-04-26T12:33:11.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:33:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:33:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700130057000003, 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.904 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700093793000001, 2024-04-26T12:33:11.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.914 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700039322000002, 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:33:11.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:33:11.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:33:11.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:33:11.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.700013914000003, 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.925 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.699990085000003, 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.926 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:33:11.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:33:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 35.695841764999997, 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:11.932 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:33:11.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:33:11.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:11.938 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:11.939 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:11.940 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:11.938+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:12.040 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:12.039+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:12.095 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:33:12.130 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.130 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:114536 4.18 e76/59 4:1a1c818c:::100000001f8.0000000d:head v 76'1825, mlcod=76'1823)", 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.116521+0000", 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012707576, 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012739116, 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.116521+0000", 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.116521+0000", 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.116520+0000", 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.116535+0000", 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4887e-05 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.116543+0000", 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3699999999999995e-06 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.116549+0000", 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5199999999999997e-06 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.116577+0000", 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7970000000000002e-05 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.116591+0000", 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3749e-05 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:114558 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1167360~4096 in=4096b,write 1335296~4096 in=4096b,write 1470464~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.120776+0000", 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0084523489999999996, 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0085657449999999996, 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.134 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 114558 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.120776+0000", 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.120776+0000", 2024-04-26T12:33:12.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.120775+0000", 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.120788+0000", 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2669e-05 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.120798+0000", 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8430000000000005e-06 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.120804+0000", 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6780000000000003e-06 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123133+0000", 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0023291459999999998 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123221+0000", 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7928000000000002e-05 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:114561 4.28 4:153ae410:::100000001f8.0000003b:head [write 155648~8192 in=8192b,write 520192~4096 in=4096b,write 557056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.122130+0000", 2024-04-26T12:33:12.138 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0070980549999999998, 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072931690000000004, 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 114561 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122130+0000", 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122130+0000", 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122130+0000", 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122150+0000", 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0877e-05 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122159+0000", 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5110000000000003e-06 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122166+0000", 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2400000000000001e-06 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122208+0000", 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2338e-05 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122296+0000", 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7440000000000003e-05 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.142 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:114562 4.3 e76/52 4:c222b65c:::100000001f8.00000021:head v 76'1792, mlcod=76'1789)", 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.122933+0000", 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0062957040000000001, 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0065573519999999998, 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122933+0000", 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122933+0000", 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122932+0000", 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122946+0000", 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4258e-05 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.144 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122957+0000", 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0725e-05 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122964+0000", 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1969999999999999e-06 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123029+0000", 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4508e-05 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.145 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123048+0000", 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9805000000000001e-05 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:114563 4.28 4:153ae410:::100000001f8.0000003b:head [write 2039808~4096 in=4096b,write 2187264~4096 in=4096b,write 2297856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.122994+0000", 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0062342609999999996, 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.006563859, 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.146 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 114563 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122994+0000", 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122994+0000", 2024-04-26T12:33:12.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.122993+0000", 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123006+0000", 2024-04-26T12:33:12.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2850999999999999e-05 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123016+0000", 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.027e-05 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123025+0000", 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3580000000000003e-06 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.127303+0000", 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0042783650000000001 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.127352+0000", 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9255000000000002e-05 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:114565 4.1c 4:39b842ef:::100000001f8.00000029:head [write 368640~4096 in=4096b,write 389120~4096 in=4096b,write 827392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.123904+0000", 2024-04-26T12:33:12.150 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0053243120000000003, 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0057257150000000001, 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 114565 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123904+0000", 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123904+0000", 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123903+0000", 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123928+0000", 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4837e-05 2024-04-26T12:33:12.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123942+0000", 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4353e-05 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123950+0000", 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9589999999999995e-06 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.123996+0000", 2024-04-26T12:33:12.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6082999999999999e-05 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.124159+0000", 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016296799999999999 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:114566 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 1081344~4096 in=4096b,write 1089536~4096 in=4096b,write 1122304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.124491+0000", 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0047376780000000004, 2024-04-26T12:33:12.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0052142810000000003, 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 114566 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.124491+0000", 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.124491+0000", 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.124490+0000", 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.124518+0000", 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7787999999999999e-05 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.156 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.124525+0000", 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.357e-06 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.124531+0000", 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3450000000000002e-06 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.124572+0000", 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1060000000000003e-05 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.157 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.124658+0000", 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5328999999999996e-05 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:114564 4.18 e76/59 4:1a1c818c:::100000001f8.0000000d:head v 76'1826, mlcod=76'1823)", 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.125391+0000", 2024-04-26T12:33:12.158 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.003837001, 2024-04-26T12:33:12.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043919759999999997, 2024-04-26T12:33:12.159 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.159 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.159 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125391+0000", 2024-04-26T12:33:12.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125391+0000", 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125391+0000", 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125404+0000", 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3492999999999999e-05 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125414+0000", 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9969999999999993e-06 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125421+0000", 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6819999999999997e-06 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.127295+0000", 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001873825 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.127315+0000", 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0035999999999999e-05 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:114568 4.37 4:ef395e89:::100000001f8.00000020:head [write 1495040~4096 in=4096b,write 1548288~4096 in=4096b,write 1564672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.125437+0000", 2024-04-26T12:33:12.162 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0037909739999999999, 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044190870000000004, 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 114568 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125437+0000", 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125437+0000", 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125436+0000", 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125465+0000", 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8595e-05 2024-04-26T12:33:12.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125474+0000", 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9749999999999996e-06 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125482+0000", 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7190000000000001e-06 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125546+0000", 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4157000000000003e-05 2024-04-26T12:33:12.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.125631+0000", 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4901999999999995e-05 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:114572 4.13 e76/13 4:cbf33e86:::100000001f8.00000026:head v 76'3617, mlcod=76'3615)", 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.128502+0000", 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00072617000000000005, 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001401551, 2024-04-26T12:33:12.166 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.128502+0000", 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.128502+0000", 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.128501+0000", 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.128515+0000", 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3206e-05 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.128522+0000", 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2679999999999997e-06 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.128527+0000", 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0409999999999997e-06 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.128564+0000", 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7329999999999997e-05 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.128585+0000", 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1043000000000002e-05 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.169 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:114575 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3100672~4096 in=4096b,write 3121152~4096 in=4096b,write 3203072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:12.129604+0000", 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9996238, 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00034367499999999999, 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 114575 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.170 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.129604+0000", 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.129604+0000", 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.129604+0000", 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:12.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.129616+0000", 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2938999999999999e-05 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.129627+0000", 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0594000000000001e-05 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.129638+0000", 2024-04-26T12:33:12.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0798999999999999e-05 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.129676+0000", 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7951000000000003e-05 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:12.129775+0000", 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8726000000000003e-05 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.173 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:33:12.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 11 2024-04-26T12:33:12.174 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:12.175 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:12.176 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:12.174+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:12.276 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:12.275+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:12.377 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:12.376+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:12.418 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:33:12.418 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:33:12.418 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:33:12.418 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:12.427 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:12.511 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:12.510+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:12.579 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:12.578+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:12.667 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:33:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:33:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:12.667 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.545937793, 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.668 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.669 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.670 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.671 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.672 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.545809579999997, 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:12.673 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:33:12.674 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:33:12.675 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.676 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.545697695999998, 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.677 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.678 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.679 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:33:12.680 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.682 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.545680341999997, 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.683 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.684 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:33:12.685 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.686 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:12.687 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.545633383000002, 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.688 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:33:12.689 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:33:12.690 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.691 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.545613396999997, 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.692 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.693 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.694 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.695 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:33:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:33:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:33:12.696 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:33:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:33:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:33:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.697 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:33:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:33:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.698 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.545559058000002, 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.699 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:33:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.700 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.701 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:33:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:33:12.702 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:33:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:33:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:33:12.703 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:33:12.704 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.704 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.704 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.704 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:33:12.704 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:33:12.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.705 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:33:12.705 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:33:12.705 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.705 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.705 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:33:12.706 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:33:12.706 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.706 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.706 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.706 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:33:12.707 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:33:12.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.707 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.707 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.707 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.707 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.707 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.708 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:12.708 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.542688599999998, 2024-04-26T12:33:12.708 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:33:12.708 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.709 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.709 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.710 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.711 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.712 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.713 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:33:12.714 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:33:12.715 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.716 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.541677591999999, 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.717 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:12.718 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.718 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.718 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.718 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.718 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:12.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.719 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.719 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:33:12.719 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.719 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.719 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.720 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:33:12.721 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.722 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:33:12.722 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:33:12.722 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.722 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.722 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.723 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:33:12.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:33:12.724 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.724 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.724 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.724 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:33:12.724 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:33:12.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.724 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.724 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.541577287999999, 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.725 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.726 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.727 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:33:12.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:33:12.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.728 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:33:12.728 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:33:12.728 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.728 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.728 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:33:12.729 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:33:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:33:12.731 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.732 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.541442541000002, 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.733 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.734 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:33:12.735 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.735 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.735 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.735 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.735 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:33:12.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:33:12.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.738 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.738 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.738 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:33:12.738 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:33:12.738 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:33:12.739 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:33:12.740 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:33:12.741 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:33:12.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:33:12.742 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.742 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.742 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.742 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:33:12.742 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.541121543000003, 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:33:12.743 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:12.744 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:33:12.745 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:33:12.746 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:33:12.746 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.746 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.746 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.746 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:33:12.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:33:12.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.747 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.747 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.747 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:33:12.747 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:33:12.747 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:33:12.748 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:33:12.749 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:33:12.750 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:33:12.750 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.750 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.750 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.750 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.751 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.540629277999997, 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.752 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.753 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:12.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.754 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:12.754 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.754 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.754 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.755 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:33:12.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:33:12.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.756 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.756 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.756 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:33:12.756 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:33:12.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:33:12.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:33:12.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:33:12.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:33:12.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.759 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.759 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.759 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:33:12.759 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.540536385999999, 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.760 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:12.761 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.762 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:33:12.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:33:12.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.763 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.763 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.763 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:33:12.763 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:33:12.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:33:12.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:33:12.764 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.764 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.764 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.764 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:33:12.764 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:33:12.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.765 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:33:12.765 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:33:12.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.765 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.765 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:33:12.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:33:12.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.766 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.766 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.766 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:33:12.766 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:33:12.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:33:12.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:33:12.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.767 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.767 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.767 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:33:12.767 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:33:12.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.768 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.768 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.768 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:33:12.768 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:33:12.768 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.768 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.768 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.540427944999998, 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.769 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:33:12.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:33:12.772 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:33:12.773 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:33:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:33:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:33:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.774 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:33:12.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:33:12.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.775 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.775 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.775 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:33:12.775 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:33:12.775 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.775 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.775 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.776 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.776 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.776 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:12.776 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.540244815999998, 2024-04-26T12:33:12.776 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:33:12.776 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.776 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.776 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.777 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:12.778 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:33:12.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:33:12.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:33:12.781 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.782 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.540226007999998, 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.783 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.785 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.786 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:33:12.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:33:12.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.787 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.787 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.787 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:33:12.787 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:33:12.787 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.788 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.789 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.790 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.790 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.790 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:12.790 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.538567151999999, 2024-04-26T12:33:12.790 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:33:12.790 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.790 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.790 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.791 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.791 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.791 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:33:12.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.791 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.791 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.791 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.791 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:33:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.794 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.795 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:33:12.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:33:12.796 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.796 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.796 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.796 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:33:12.796 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:33:12.796 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.796 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.530254647, 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.797 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:33:12.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.798 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.798 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.798 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.798 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:12.798 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.798 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.799 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:33:12.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:33:12.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.800 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.800 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:33:12.800 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:33:12.800 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.800 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.801 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.802 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:33:12.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:33:12.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.803 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.803 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.803 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:33:12.803 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:33:12.803 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 36.527264893999998, 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.805 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.806 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.807 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:33:12.808 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.809 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:12.810 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:12.812 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:12.813 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:12.810+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:12.913 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:12.912+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:12.990 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:116513 4.2c 4:36128e15:::100000001f8.00000008:head [write 2727936~4096 in=4096b,write 2789376~4096 in=4096b,write 2854912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:12.984970+0000", 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0048744649999999997, 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0048974839999999997, 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 116513 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.984970+0000", 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.984970+0000", 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.984969+0000", 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.984990+0000", 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0985e-05 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985000+0000", 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0029e-05 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985005+0000", 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1610000000000002e-06 2024-04-26T12:33:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985035+0000", 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9944e-05 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985086+0000", 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0828999999999997e-05 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:116514 4.22 4:47e99c31:::100000001f8.00000025:head [write 495616~4096 in=4096b,write 577536~4096 in=4096b,write 643072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:12.985368+0000", 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.004476402, 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0045475740000000004, 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 116514 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985368+0000", 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985368+0000", 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985367+0000", 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985377+0000", 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0549e-05 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985388+0000", 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1068e-05 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985394+0000", 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0469999999999999e-06 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985432+0000", 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7558999999999997e-05 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985479+0000", 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7033999999999997e-05 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985572+0000", 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.2870999999999999e-05 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.988403+0000", 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002831035 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:116515 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 2945024~4096 in=4096b,write 3162112~4096 in=4096b,write 3223552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:12.985708+0000", 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0041358319999999999, 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0042633130000000003, 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 116515 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985708+0000", 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985708+0000", 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985707+0000", 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985717+0000", 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0074e-05 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985726+0000", 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.6200000000000005e-06 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985733+0000", 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9999999999999999e-06 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985772+0000", 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8532999999999999e-05 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.985861+0000", 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9244000000000001e-05 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:116516 4.38 4:1dcf718c:::100000001f8.00000022:head [write 2232320~4096 in=4096b,write 2764800~4096 in=4096b,write 3088384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:12.986087+0000", 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0037574520000000001, 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003924299, 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 116516 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986087+0000", 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986087+0000", 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986086+0000", 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986100+0000", 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4392e-05 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986110+0000", 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4569999999999994e-06 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986115+0000", 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8420000000000004e-06 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986154+0000", 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9409999999999997e-05 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986234+0000", 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0079000000000004e-05 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:116517 4.11 4:893be98d:::100000001f8.00000001:head [write 3694592~4096 in=4096b,write 3735552~4096 in=4096b,write 3768320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:12.986436+0000", 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0034082000000000001, 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0036150039999999998, 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 116517 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986436+0000", 2024-04-26T12:33:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986436+0000", 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986435+0000", 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986462+0000", 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6808000000000002e-05 2024-04-26T12:33:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986468+0000", 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5929999999999996e-06 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986472+0000", 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0879999999999997e-06 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986509+0000", 2024-04-26T12:33:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.7410000000000003e-05 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986568+0000", 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8616000000000003e-05 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:116518 4.13 4:cbf33e86:::100000001f8.00000026:head [write 3911680~4096 in=4096b,write 4145152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:12.986809+0000", 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0030351179999999998, 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0032794579999999999, 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 116518 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986809+0000", 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986809+0000", 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986808+0000", 2024-04-26T12:33:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986818+0000", 2024-04-26T12:33:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9629999999999993e-06 2024-04-26T12:33:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986834+0000", 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6248000000000001e-05 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986841+0000", 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8870000000000003e-06 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986877+0000", 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6208999999999998e-05 2024-04-26T12:33:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.986967+0000", 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9413000000000006e-05 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.987090+0000", 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012276799999999999 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989657+0000", 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0025668959999999999 2024-04-26T12:33:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:116520 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 1781760~4096 in=4096b,write 1847296~4096 in=4096b,write 2088960~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:12.987947+0000", 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.001896846, 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0021856039999999998, 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 116520 2024-04-26T12:33:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.987947+0000", 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.987947+0000", 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.987946+0000", 2024-04-26T12:33:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.987979+0000", 2024-04-26T12:33:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.2943e-05 2024-04-26T12:33:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.987989+0000", 2024-04-26T12:33:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0086e-05 2024-04-26T12:33:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.987996+0000", 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.669e-06 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.988037+0000", 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1183999999999997e-05 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.988119+0000", 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1883000000000002e-05 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.988275+0000", 2024-04-26T12:33:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00015572700000000001 2024-04-26T12:33:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:116522 4.d 4:b1164065:::100000001f8.00000035:head [write 2064384~4096 in=4096b,write 2535424~4096 in=4096b,write 2686976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T12:33:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:12.989172+0000", 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.00067228600000000002, 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0010042129999999999, 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 116522 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989172+0000", 2024-04-26T12:33:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989172+0000", 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989171+0000", 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989216+0000", 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4771999999999998e-05 2024-04-26T12:33:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989226+0000", 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0454e-05 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989232+0000", 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3330000000000002e-06 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989276+0000", 2024-04-26T12:33:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3897999999999999e-05 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989364+0000", 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7142e-05 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:12.989522+0000", 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000158457 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:33:13.028 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 8 2024-04-26T12:33:13.028 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:13.029 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:13.028+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:13.030 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:13.110 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:33:13.129 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:13.128+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:13.198 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:13.198 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:13.198 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:33:13.198 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:33:13.198 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:13.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:13.231 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:13.230+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:13.331 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:13.331+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:13.385 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:13.385 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:33:13.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:33:13.385 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:13.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.385 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.308510603000002, 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:33:13.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:33:13.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:33:13.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:33:13.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:33:13.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:33:13.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.391 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.393 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.301436453999997, 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:33:13.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:33:13.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:33:13.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:33:13.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:33:13.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.397 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.294274973999997, 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:13.400 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.402 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:13.406 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.293886370999999, 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.407 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.408 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:33:13.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:33:13.412 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.293556666000001, 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.413 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:33:13.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:33:13.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:33:13.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.418 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.2917141, 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.419 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.421 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.424 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.287361394999998, 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:33:13.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:33:13.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:33:13.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:13.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:33:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:33:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:13.431 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263675763999998, 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:13.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:33:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:33:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:33:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:13.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:33:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:33:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:33:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.436 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:33:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:33:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:33:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:33:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:33:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:33:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:33:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:33:13.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:33:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:33:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.440 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263528039000001, 2024-04-26T12:33:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:33:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.444 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.447 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263470955000003, 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:33:13.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:33:13.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:33:13.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.453 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263443678000002, 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:33:13.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.458 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263401981999998, 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.459 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.461 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:33:13.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:33:13.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263355746999999, 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:33:13.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:33:13.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:33:13.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:33:13.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:33:13.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263322463000002, 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:13.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:33:13.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:33:13.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:33:13.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.475 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263292389, 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:13.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:33:13.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:33:13.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263256124999998, 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.481 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:13.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.486 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263201654, 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.487 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:33:13.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:33:13.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:33:13.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263176246, 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.493 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:33:13.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:33:13.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:33:13.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:33:13.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:33:13.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:33:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:33:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:33:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:33:13.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:33:13.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.500 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.500 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:33:13.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:33:13.500 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.500 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.501 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.501 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.501 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:13.501 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.263152417000001, 2024-04-26T12:33:13.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:33:13.501 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.502 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.502 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.502 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.502 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.502 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:33:13.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.502 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:13.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:33:13.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 37.259004097000002, 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:13.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:33:13.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:33:13.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:13.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:33:13.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:33:13.518 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.518 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.518 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.518 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:13.518 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:13.518 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:13.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:33:13.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~36s 2024-04-26T12:33:13.520 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:13.518+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:13.521 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:13.621 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:13.619+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:13.717 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:13.718 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:13.718 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:13.721 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:13.720+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:13.733 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:13.741 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:13.741 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:13.741 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:13.741 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:13.744 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:13.745 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:13.822 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:13.821+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:13.923 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:13.921+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:13.966 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:13.967 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:13.983 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:14.024 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:14.023+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:14.125 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:14.124+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:14.210 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:14.210 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:14.226 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:14.227 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:14.225+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:14.327 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:14.326+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:14.398 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:14.399 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:14.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:14.458 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:14.457+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:14.529 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:14.528+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:14.587 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:14.587 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:14.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:14.630 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:14.628+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:14.730 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:14.729+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:14.796 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:14.796 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:14.809 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:14.853 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:14.852+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:14.935 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:14.934+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:15.003 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:15.004 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:15.020 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:15.061 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:15.060+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:15.128 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:33:15.133 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:15.133+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:15.234 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:15.234+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:15.261 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:15.261 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:15.270 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:15.335 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:15.334+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:15.436 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:15.435+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:15.463 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:15.464 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:15.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:15.537 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:15.536+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:15.638 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:15.637+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:15.668 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:15.668 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:15.682 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:15.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:33:15.767 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:15.766+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:15.839 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:15.838+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:15.889 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:15.890 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:15.904 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:15.940 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:15.938+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:15.945 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:15.973 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:15.973 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:15.973 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:15.973 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:15.976 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:15.976 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:16.041 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:16.040+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:16.114 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:33:16.130 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:16.130 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:33:16.130 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:33:16.130 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:16.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.130 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.052671597, 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.131 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:33:16.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:16.134 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.135 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.136 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.045597448000002, 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:33:16.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.138 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.139 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.140 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:33:16.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:33:16.142 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:16.143 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.038435968000002, 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.144 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:16.145 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:33:16.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:33:16.148 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:33:16.149 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.038047364999997, 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.150 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:16.151 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:33:16.152 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:33:16.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.037717659999998, 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.156 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.157 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:33:16.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:33:16.160 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:33:16.161 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:16.162 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.035875093999998, 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:33:16.164 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.165 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:16.168 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.031522389000003, 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:33:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:33:16.171 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.172 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.173 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:16.174 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007836758000003, 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:33:16.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.177 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:33:16.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:33:16.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:33:16.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.179 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.179 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:33:16.179 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007689032999998, 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.181 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:33:16.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:33:16.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007631949, 2024-04-26T12:33:16.186 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:33:16.188 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.189 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.190 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.191 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007604671999999, 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.192 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:33:16.194 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:33:16.195 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.196 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.197 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007562976000003, 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:33:16.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.199 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:33:16.202 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007516741000003, 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:33:16.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.205 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.206 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.209 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007483456999999, 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:16.210 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.211 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:33:16.212 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.214 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007453382999998, 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.215 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:16.216 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.217 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.218 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.220 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007417119000003, 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.221 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:16.222 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:33:16.223 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:33:16.224 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.225 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:16.226 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007362647999997, 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:33:16.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:33:16.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:33:16.230 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:33:16.231 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007337239999998, 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.232 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:33:16.234 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:33:16.235 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.236 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.237 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.007313410999998, 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.238 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.240 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.241 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.242 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:16.243 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 40.003165091, 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:16.244 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:33:16.245 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.246 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.247 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:16.248 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:33:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:33:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:16.249 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:16.249 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:16.251 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:16.249+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:16.251 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:16.351 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:16.351+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:16.449 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:16.449 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123909 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3805184~4096 in=4096b,write 3825664~4096 in=4096b,write 4116480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.425086+0000", 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020408862, 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020439230999999999, 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123909 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425086+0000", 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425086+0000", 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.451 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425086+0000", 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425092+0000", 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9859999999999999e-06 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425096+0000", 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1819999999999999e-06 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425099+0000", 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0639999999999998e-06 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429261+0000", 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041620310000000001 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429332+0000", 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0436000000000001e-05 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123947 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.441445+0000", 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0040505589999999996, 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041539990000000002, 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.454 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123947 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.441445+0000", 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.441445+0000", 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.441444+0000", 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.441453+0000", 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0389999999999993e-06 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.441461+0000", 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1599999999999998e-06 2024-04-26T12:33:16.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.441466+0000", 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7539999999999997e-06 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123910 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1155072~4096 in=4096b,write 1167360~4096 in=4096b,write 1449984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.425325+0000", 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020169875, 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020338048000000001, 2024-04-26T12:33:16.457 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123910 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425325+0000", 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425325+0000", 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425325+0000", 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425339+0000", 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3920000000000001e-05 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425345+0000", 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7120000000000003e-06 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425349+0000", 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5880000000000002e-06 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.431422+0000", 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060724739999999996 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.431499+0000", 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7842000000000005e-05 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123949 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.442270+0000", 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0032255320000000001, 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034574950000000001, 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.461 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123949 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442270+0000", 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442270+0000", 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442269+0000", 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442277+0000", 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.498e-06 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442282+0000", 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.707e-06 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442285+0000", 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.464 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123950 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.442613+0000", 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.002881813, 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0031669269999999999, 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.465 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123950 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442613+0000", 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442613+0000", 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442613+0000", 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442632+0000", 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8890999999999999e-05 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442641+0000", 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4490000000000005e-06 2024-04-26T12:33:16.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442646+0000", 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6789999999999996e-06 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123951 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 4096~4096 in=4096b,write 311296~4096 in=4096b,write 352256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.443212+0000", 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.002283457, 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0026256489999999999, 2024-04-26T12:33:16.468 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123951 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443212+0000", 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443212+0000", 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443211+0000", 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443223+0000", 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2312e-05 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443232+0000", 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5830000000000007e-06 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443245+0000", 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3101e-05 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443290+0000", 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5482000000000003e-05 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443364+0000", 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3021000000000004e-05 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123914 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1540096~4096 in=4096b,write 1601536~4096 in=4096b,write 1773568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.426894+0000", 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.018601135000000001, 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019011320000000002, 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.472 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123914 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426894+0000", 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426894+0000", 2024-04-26T12:33:16.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426893+0000", 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426905+0000", 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2035000000000001e-05 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426915+0000", 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2990000000000002e-06 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426922+0000", 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4189999999999996e-06 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438238+0000", 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011315529 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438322+0000", 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3901999999999997e-05 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123952 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.443938+0000", 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0015573189999999999, 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0020300029999999998, 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.476 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123952 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443938+0000", 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443938+0000", 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443937+0000", 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443957+0000", 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0129e-05 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443966+0000", 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9989999999999997e-06 2024-04-26T12:33:16.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.443972+0000", 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1769999999999997e-06 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123873 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 450560~12288 in=12288b,write 581632~4096 in=4096b,write 843776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.410284+0000", 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.035211265999999998, 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.035742786999999998, 2024-04-26T12:33:16.479 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123873 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.410284+0000", 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.410284+0000", 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.410283+0000", 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.410303+0000", 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9919e-05 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.481 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.410318+0000", 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5097e-05 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.410324+0000", 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9819999999999996e-06 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420529+0000", 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010204493 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420580+0000", 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1360000000000003e-05 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123916 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 2256896~4096 in=4096b,write 2412544~4096 in=4096b,write 2547712~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.427956+0000", 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017539573999999999, 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018137751000000001, 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.483 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123916 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.427956+0000", 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.427956+0000", 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.427955+0000", 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.427983+0000", 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8705999999999999e-05 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.427998+0000", 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4401e-05 2024-04-26T12:33:16.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428007+0000", 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.789e-06 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.431538+0000", 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003531691 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.431624+0000", 2024-04-26T12:33:16.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5476000000000006e-05 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123953 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.444338+0000", 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.001157349, 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001817115, 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.487 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123953 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444338+0000", 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444338+0000", 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444337+0000", 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444348+0000", 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1299e-05 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444357+0000", 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6209999999999993e-06 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444364+0000", 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9260000000000003e-06 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:123954 4.e e78/13)", 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.445482+0000", 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 1.3251000000000001e-05, 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00072612000000000002, 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445482+0000", 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445482+0000", 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445481+0000", 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445496+0000", 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4919999999999999e-05 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445511+0000", 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4679e-05 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445516+0000", 2024-04-26T12:33:16.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4310000000000002e-06 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123917 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 4096~4096 in=4096b,write 61440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.428481+0000", 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017014090999999999, 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017782190999999999, 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.493 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123917 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428481+0000", 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428481+0000", 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428480+0000", 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428491+0000", 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428500+0000", 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5200000000000003e-06 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428507+0000", 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.764e-06 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.441055+0000", 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012547371999999999 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.441129+0000", 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4381000000000005e-05 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.496 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123955 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.445631+0000", 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9998646, 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00069575799999999999, 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123955 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445631+0000", 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445631+0000", 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445630+0000", 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445647+0000", 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7078000000000001e-05 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445655+0000", 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7910000000000005e-06 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.445660+0000", 2024-04-26T12:33:16.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0300000000000001e-06 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:123918 4.e e78/13 4:73e84e43:::100000001f8.00000004:head v 78'1967, mlcod=78'1964)", 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.429147+0000", 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.016348142, 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017232311, 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429147+0000", 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429147+0000", 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429147+0000", 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429159+0000", 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2859e-05 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429168+0000", 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6200000000000005e-06 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429173+0000", 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3940000000000004e-06 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.431375+0000", 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0022019930000000002 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.431395+0000", 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9344999999999999e-05 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123878 4.6 4:616d4c41:::100000001f8.00000034:head [write 4096~4096 in=4096b,write 143360~4096 in=4096b,write 466944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.413910+0000", 2024-04-26T12:33:16.503 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031585598999999999, 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032537426000000001, 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123878 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413910+0000", 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413910+0000", 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413909+0000", 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413921+0000", 2024-04-26T12:33:16.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1167e-05 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413928+0000", 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8099999999999998e-06 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413933+0000", 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0860000000000001e-06 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420347+0000", 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0064135140000000004 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420425+0000", 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8349999999999994e-05 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123921 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 2797568~4096 in=4096b,write 2842624~4096 in=4096b,write 2891776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.429869+0000", 2024-04-26T12:33:16.507 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.015626363000000001, 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016652706, 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123921 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429869+0000", 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429869+0000", 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429868+0000", 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429881+0000", 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2818e-05 2024-04-26T12:33:16.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429889+0000", 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0350000000000001e-06 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.429895+0000", 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4960000000000004e-06 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.436247+0000", 2024-04-26T12:33:16.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0063521960000000001 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.436310+0000", 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3109999999999997e-05 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123879 4.6 4:616d4c41:::100000001f8.00000034:head [write 1708032~4096 in=4096b,write 2015232~4096 in=4096b,write 2297856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.413938+0000", 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031556808999999998, 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032655722999999998, 2024-04-26T12:33:16.511 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123879 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413938+0000", 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413938+0000", 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413938+0000", 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.413949+0000", 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0601999999999999e-05 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.414222+0000", 2024-04-26T12:33:16.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00027330099999999999 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.414229+0000", 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7560000000000002e-06 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428134+0000", 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013905348999999999 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.514 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428208+0000", 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4231000000000001e-05 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123923 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1626112~4096 in=4096b,write 1789952~4096 in=4096b,write 1953792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.430728+0000", 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014767753999999999, 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015937949, 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.515 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123923 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.430728+0000", 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.430728+0000", 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.430727+0000", 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.430739+0000", 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2354999999999999e-05 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.430755+0000", 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5630000000000001e-05 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.430763+0000", 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0350000000000001e-06 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442735+0000", 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011972049 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442790+0000", 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5021000000000001e-05 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.518 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123928 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1191936~4096 in=4096b,write 1294336~4096 in=4096b,write 1339392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.432513+0000", 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.01298236, 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014229504, 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123928 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.519 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.432513+0000", 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.432513+0000", 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.432512+0000", 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.432524+0000", 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1838000000000001e-05 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.432534+0000", 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7759999999999992e-06 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.432541+0000", 2024-04-26T12:33:16.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9720000000000003e-06 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.435432+0000", 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0028914280000000001 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.435520+0000", 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7576000000000003e-05 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123890 4.37 4:ef395e89:::100000001f8.00000020:head [write 3076096~4096 in=4096b,write 3125248~4096 in=4096b,write 3133440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.417860+0000", 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027635533, 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028960882, 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123890 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.417860+0000", 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.417860+0000", 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.417859+0000", 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.417873+0000", 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3699999999999999e-05 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.417884+0000", 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1099e-05 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.417890+0000", 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7379999999999997e-06 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425849+0000", 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079587709999999999 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425904+0000", 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4939999999999999e-05 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123931 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.433709+0000", 2024-04-26T12:33:16.526 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011786308000000001, 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013179778, 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123931 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.433709+0000", 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.433709+0000", 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.433708+0000", 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.433722+0000", 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3767e-05 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.433733+0000", 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0686000000000001e-05 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.433740+0000", 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1489999999999997e-06 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123891 4.6 4:616d4c41:::100000001f8.00000034:head [write 2658304~8192 in=8192b,write 2723840~4096 in=4096b,write 3047424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.529 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.418218+0000", 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027276834, 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.028731031000000001, 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123891 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.418218+0000", 2024-04-26T12:33:16.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.418218+0000", 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.418218+0000", 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.418236+0000", 2024-04-26T12:33:16.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8813000000000001e-05 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.418250+0000", 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3560999999999999e-05 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.418257+0000", 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.255e-06 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.431365+0000", 2024-04-26T12:33:16.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013107354 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.431445+0000", 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0838000000000001e-05 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123933 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.434432+0000", 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011063401, 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012584989, 2024-04-26T12:33:16.533 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123933 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.434432+0000", 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.434432+0000", 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.434431+0000", 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.434444+0000", 2024-04-26T12:33:16.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3405e-05 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.434454+0000", 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6430000000000007e-06 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.434462+0000", 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4030000000000001e-06 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123935 4.37 4:ef395e89:::100000001f8.00000020:head [write 1310720~4096 in=4096b,write 1384448~4096 in=4096b,write 1531904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.435583+0000", 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0099122559999999995, 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011498605, 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123935 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.435583+0000", 2024-04-26T12:33:16.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.435583+0000", 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.435582+0000", 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.435596+0000", 2024-04-26T12:33:16.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3701e-05 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.435607+0000", 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0668e-05 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.435614+0000", 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2599999999999999e-06 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444827+0000", 2024-04-26T12:33:16.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0092130619999999993 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444906+0000", 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9110000000000007e-05 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123896 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 172032~4096 in=4096b,write 196608~4096 in=4096b,write 212992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.419878+0000", 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0256177, 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027282638000000001, 2024-04-26T12:33:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123896 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.419878+0000", 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.419878+0000", 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.419877+0000", 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.419894+0000", 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6801000000000001e-05 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.419904+0000", 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0848e-05 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.419912+0000", 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.08e-06 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.434520+0000", 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014608207 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.543 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.434601+0000", 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0980000000000001e-05 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123897 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 77824~4096 in=4096b,write 94208~4096 in=4096b,write 430080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.420192+0000", 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.025303189, 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027045824999999999, 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.544 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123897 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420192+0000", 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420192+0000", 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420191+0000", 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420206+0000", 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4744e-05 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420218+0000", 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2194999999999999e-05 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420226+0000", 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6599999999999995e-06 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.436663+0000", 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016437229000000001 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.436751+0000", 2024-04-26T12:33:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8236e-05 2024-04-26T12:33:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.548 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:123936 4.3d e78/13 4:bd3afb9d:::100000001f8.00000009:head v 78'3866, mlcod=78'3864)", 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.437139+0000", 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0083560830000000003, 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010176312, 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437139+0000", 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437139+0000", 2024-04-26T12:33:16.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437139+0000", 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437153+0000", 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4312e-05 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437159+0000", 2024-04-26T12:33:16.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437164+0000", 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6349999999999997e-06 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438439+0000", 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001275326 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438466+0000", 2024-04-26T12:33:16.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6556000000000001e-05 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:123898 4.e e78/13 4:73e84e43:::100000001f8.00000004:head v 78'1966, mlcod=78'1963)", 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.420898+0000", 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.024597312999999999, 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026478544, 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420898+0000", 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420898+0000", 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420897+0000", 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420910+0000", 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2777e-05 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420919+0000", 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0070000000000003e-06 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.420925+0000", 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0449999999999997e-06 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426929+0000", 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0060036179999999996 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426946+0000", 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7484000000000001e-05 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:123937 4.3 e78/52 4:c222b65c:::100000001f8.00000021:head v 78'1929, mlcod=78'1927)", 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.437168+0000", 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0083274260000000006, 2024-04-26T12:33:16.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010273002999999999, 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437168+0000", 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437168+0000", 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437168+0000", 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437179+0000", 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0993e-05 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437184+0000", 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5559999999999998e-06 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437189+0000", 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4549999999999997e-06 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437256+0000", 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7810000000000003e-05 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.437272+0000", 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5971e-05 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.558 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123938 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 299008~8192 in=8192b,write 348160~4096 in=4096b,write 991232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.438439+0000", 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0070560900000000001, 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0091104619999999997, 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123938 2024-04-26T12:33:16.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438439+0000", 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438439+0000", 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438438+0000", 2024-04-26T12:33:16.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438457+0000", 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8246000000000001e-05 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438467+0000", 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0138e-05 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438474+0000", 2024-04-26T12:33:16.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1640000000000004e-06 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444634+0000", 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0061597220000000003 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.444741+0000", 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000107093 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123901 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2015232~4096 in=4096b,write 2211840~4096 in=4096b,write 2236416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.421641+0000", 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.023854107999999999, 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025951516000000001, 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123901 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.421641+0000", 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.421641+0000", 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.421640+0000", 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.421655+0000", 2024-04-26T12:33:16.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4174e-05 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.421665+0000", 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0579e-05 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.421673+0000", 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4760000000000001e-06 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.436647+0000", 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014974191 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.436724+0000", 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.674e-05 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123941 4.14 4:2b28d75f:::100000001f8.00000016:head [write 684032~4096 in=4096b,write 790528~4096 in=4096b,write 1126400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.438983+0000", 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0065127010000000001, 2024-04-26T12:33:16.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0086538259999999999, 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123941 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438983+0000", 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438983+0000", 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438982+0000", 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.438993+0000", 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1185999999999999e-05 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439002+0000", 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2119999999999992e-06 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439009+0000", 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5649999999999998e-06 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439051+0000", 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2101999999999998e-05 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439126+0000", 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4618999999999998e-05 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123942 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.439320+0000", 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0061752539999999998, 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083550510000000005, 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.570 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123942 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439320+0000", 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439320+0000", 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439319+0000", 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439333+0000", 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3220999999999999e-05 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439341+0000", 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2320000000000001e-06 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439347+0000", 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6779999999999997e-06 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123943 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 2068480~4096 in=4096b,write 2088960~4096 in=4096b,write 2404352~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.439696+0000", 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0057990890000000003, 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080165930000000007, 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123943 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439696+0000", 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439696+0000", 2024-04-26T12:33:16.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439695+0000", 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439711+0000", 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6022e-05 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439721+0000", 2024-04-26T12:33:16.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6860000000000001e-06 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.439728+0000", 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.221e-06 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442707+0000", 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0029787239999999999 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.442791+0000", 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3536999999999997e-05 2024-04-26T12:33:16.576 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123905 4.2f 4:f59f865b:::100000001f8.00000007:head [write 2899968~4096 in=4096b,write 3162112~4096 in=4096b,write 3174400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.425039+0000", 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020456471, 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022721544, 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123905 2024-04-26T12:33:16.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425039+0000", 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425039+0000", 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425038+0000", 2024-04-26T12:33:16.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425047+0000", 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.4830000000000005e-06 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425057+0000", 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3330000000000003e-06 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425062+0000", 2024-04-26T12:33:16.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.4040000000000003e-06 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426648+0000", 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0015856170000000001 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.426729+0000", 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0823999999999997e-05 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123944 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.440171+0000", 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0053246689999999998, 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0076423510000000004, 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123944 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440171+0000", 2024-04-26T12:33:16.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440171+0000", 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440170+0000", 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.582 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440182+0000", 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1807999999999999e-05 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440192+0000", 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0623e-05 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440199+0000", 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6479999999999997e-06 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123908 4.37 4:eff9002a:::100000001f8.00000003:head [write 1380352~4096 in=4096b,write 1417216~4096 in=4096b,write 1458176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.425068+0000", 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020427700999999999, 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022784225000000002, 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123908 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.584 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425068+0000", 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425068+0000", 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425067+0000", 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.585 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425075+0000", 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7300000000000005e-06 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425080+0000", 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7559999999999999e-06 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.425083+0000", 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4510000000000001e-06 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.586 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428657+0000", 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0035739399999999998 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.428716+0000", 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8928000000000002e-05 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:123946 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 1335296~4096 in=4096b,write 1363968~4096 in=4096b,write 2125824~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:16.440878+0000", 2024-04-26T12:33:16.587 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0046174670000000001, 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0070334580000000002, 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 123946 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440878+0000", 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.588 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440878+0000", 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440877+0000", 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440887+0000", 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6360000000000006e-06 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.589 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440894+0000", 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.593e-06 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440899+0000", 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:16.590 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.440934+0000", 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4762999999999999e-05 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:16.441020+0000", 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5490999999999999e-05 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 39 2024-04-26T12:33:16.591 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:16.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:16.594 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:16.591+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:16.694 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:16.693+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:16.795 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:16.794+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:16.818 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:16.818 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:33:16.818 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:33:16.818 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:33:16.818 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:16.828 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:16.895 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:16.895+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:16.996 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:16.995+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.935165277000003, 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:33:17.059 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:33:17.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:33:17.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.935037063999999, 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.064 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:33:17.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.067 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:33:17.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:33:17.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:33:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:33:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.93492518, 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:33:17.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:17.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.075 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.934907826, 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:17.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:17.080 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.934860866999998, 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:17.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:33:17.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.934840881, 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.085 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.086 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:17.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.934786541999998, 2024-04-26T12:33:17.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:33:17.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:33:17.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:33:17.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:33:17.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:33:17.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:33:17.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:33:17.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:33:17.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:33:17.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:33:17.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:33:17.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:33:17.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:33:17.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.097 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.097 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.098 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:17.098 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.931916084000001, 2024-04-26T12:33:17.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:33:17.098 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.098 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.098 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.099 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:33:17.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.099 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:17.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:17.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:33:17.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:33:17.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:33:17.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:33:17.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:33:17.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:33:17.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:33:17.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:33:17.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:33:17.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:33:17.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:33:17.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:33:17.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:33:17.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:33:17.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:33:17.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:33:17.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:33:17.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:33:17.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:33:17.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:33:17.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:33:17.109 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.109 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.109 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.109 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.110 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:17.110 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.930905076000002, 2024-04-26T12:33:17.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:33:17.110 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.110 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.110 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.111 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.111 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:33:17.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.111 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:17.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:17.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.113 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.113 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.113 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:33:17.113 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.114 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.114 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:33:17.114 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:33:17.114 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.115 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:33:17.115 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:33:17.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.115 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.116 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:33:17.116 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:33:17.116 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.116 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.116 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:33:17.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:33:17.117 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.117 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.117 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.117 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:33:17.117 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:33:17.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.118 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.118 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.118 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:33:17.118 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:33:17.118 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.119 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.119 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:33:17.119 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:33:17.119 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.119 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:33:17.120 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:33:17.120 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.120 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.120 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.120 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:33:17.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:33:17.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.121 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.121 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.121 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:33:17.121 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:33:17.122 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.122 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.122 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.122 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.123 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:17.123 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.930804772000002, 2024-04-26T12:33:17.123 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:33:17.123 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.123 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.123 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.124 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.124 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:33:17.124 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.124 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.124 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:17.125 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.125 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.125 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.125 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.125 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:17.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.126 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.126 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.126 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.126 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:17.126 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.127 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:33:17.127 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:33:17.127 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.127 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.127 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:33:17.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:33:17.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.128 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.128 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:33:17.128 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:33:17.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.128 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:17.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:33:17.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.130 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.130 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:33:17.130 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:33:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:33:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:33:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.131 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.132 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.930670024999998, 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.133 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.134 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:33:17.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.135 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.135 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.135 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:33:17.135 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:33:17.135 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.136 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.136 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:33:17.136 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:33:17.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.136 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.137 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:33:17.137 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:33:17.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.137 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:33:17.138 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:33:17.138 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.138 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.138 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.138 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:33:17.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:33:17.139 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.139 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.139 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.139 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:33:17.139 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:33:17.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.140 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.140 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.140 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:33:17.140 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:33:17.140 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.141 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.141 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:33:17.141 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:33:17.141 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.141 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.142 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:33:17.142 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:33:17.142 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.142 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.142 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.143 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:33:17.143 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:33:17.143 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.143 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.143 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.144 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.144 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:17.144 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.930349026999998, 2024-04-26T12:33:17.144 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:33:17.144 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.145 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.145 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.145 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.145 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.145 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:33:17.145 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.145 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.146 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.146 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:17.146 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.146 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.146 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.147 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:33:17.148 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.148 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.148 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.148 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.148 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:33:17.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:33:17.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.149 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.149 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.149 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:33:17.149 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:33:17.149 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.150 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.150 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:33:17.150 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:33:17.150 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.150 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:33:17.151 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:33:17.151 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.151 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.151 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.151 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:33:17.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:33:17.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.152 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.152 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:33:17.152 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:33:17.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.152 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:17.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:33:17.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.153 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.153 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:33:17.153 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:33:17.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.154 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.154 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:33:17.154 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:33:17.154 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.154 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.155 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.155 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:33:17.155 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:33:17.155 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.155 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.155 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.155 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.156 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.156 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.156 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:17.156 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.929856762, 2024-04-26T12:33:17.156 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:33:17.156 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.156 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.157 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.157 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:33:17.157 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.157 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.158 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.158 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:17.158 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.158 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.158 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:17.159 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.159 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.159 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.159 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:17.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.160 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.160 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.160 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:33:17.160 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:33:17.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:33:17.161 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:33:17.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.161 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.161 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:33:17.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:33:17.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.162 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.162 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:33:17.162 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:33:17.162 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.162 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:33:17.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:33:17.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.163 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.163 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.163 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:33:17.163 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:33:17.163 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.165 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.929763870000002, 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.166 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.167 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.168 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.169 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.170 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.929655429, 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.171 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.172 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.173 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.174 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.175 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.176 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.9294723, 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:33:17.178 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:33:17.179 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:33:17.180 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:33:17.181 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.929453492, 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.182 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.183 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.184 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.185 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.186 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:17.187 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.927794636000002, 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.188 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.189 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:33:17.190 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:33:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:33:17.192 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.919482131000002, 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.193 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.194 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.195 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.196 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.197 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 40.916492378000001, 2024-04-26T12:33:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.199 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.201 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.201 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:17.201 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:17.202 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:33:17.203 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:33:17.204 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:17.205 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:17.206 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:17.207 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:17.207 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:17.206+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:17.307 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:17.306+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:17.381 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125868 4.38 4:1d13bf87:::100000001f8.00000030:head [write 1191936~4096 in=4096b,write 1224704~4096 in=4096b,write 1359872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.366394+0000", 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.012262333, 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.012291432, 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.382 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125868 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.366394+0000", 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.366394+0000", 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.383 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.366394+0000", 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.366404+0000", 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0127e-05 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.366415+0000", 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0966e-05 2024-04-26T12:33:17.384 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.366421+0000", 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5649999999999998e-06 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370296+0000", 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0038747360000000002 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370375+0000", 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8690999999999996e-05 2024-04-26T12:33:17.385 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125870 4.2c 4:36128e15:::100000001f8.00000008:head [write 2867200~4096 in=4096b,write 2875392~4096 in=4096b,write 3190784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.367123+0000", 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.011533197, 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011612445000000001, 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.386 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125870 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367123+0000", 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367123+0000", 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.387 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367123+0000", 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367131+0000", 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1610000000000003e-06 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.388 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367138+0000", 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5869999999999998e-06 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367142+0000", 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0969999999999999e-06 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.389 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.374329+0000", 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0071868949999999996 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.374414+0000", 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5469000000000004e-05 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.390 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125871 4.13 4.6028f753 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.391 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.367500+0000", 2024-04-26T12:33:17.391 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.011156177999999999, 2024-04-26T12:33:17.391 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.011275133999999999, 2024-04-26T12:33:17.391 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.391 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:17.391 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.391 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.391 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.392 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125871 2024-04-26T12:33:17.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.392 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.392 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.392 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367500+0000", 2024-04-26T12:33:17.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.393 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.393 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.393 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367500+0000", 2024-04-26T12:33:17.393 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.394 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.394 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367500+0000", 2024-04-26T12:33:17.394 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367510+0000", 2024-04-26T12:33:17.395 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0018e-05 2024-04-26T12:33:17.395 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.395 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.395 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367521+0000", 2024-04-26T12:33:17.396 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1036000000000001e-05 2024-04-26T12:33:17.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.396 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.396 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367526+0000", 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.643e-06 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125872 4.27 4:e68799fb:::100000001f8.00000018:head [write 348160~4096 in=4096b,write 503808~4096 in=4096b,write 573440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.367850+0000", 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.010807036000000001, 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.01096012, 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.397 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125872 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367850+0000", 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.398 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367850+0000", 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367849+0000", 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367859+0000", 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8409999999999995e-06 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.399 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367870+0000", 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0961000000000001e-05 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367875+0000", 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5709999999999997e-06 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367909+0000", 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3800000000000002e-05 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.400 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.367965+0000", 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6001000000000001e-05 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368068+0000", 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000103451 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.377818+0000", 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0097500150000000008 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.401 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125874 4.30 4:0c89e311:::100000001f8.00000017:head [write 647168~4096 in=4096b,write 1331200~4096 in=4096b,write 1347584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.368436+0000", 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.010220397000000001, 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010422337, 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125874 2024-04-26T12:33:17.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368436+0000", 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368436+0000", 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368435+0000", 2024-04-26T12:33:17.403 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368464+0000", 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.8252e-05 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368473+0000", 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1069999999999994e-06 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.404 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368480+0000", 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3819999999999998e-06 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370290+0000", 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001810077 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370365+0000", 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4548999999999994e-05 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125875 4.c 4:33b8095f:::100000001f8.0000003a:head [write 1871872~4096 in=4096b,write 1921024~4096 in=4096b,write 2174976~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.369082+0000", 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0095750569999999997, 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0098200240000000001, 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125875 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.406 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.369082+0000", 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.369082+0000", 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.369081+0000", 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.408 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.369115+0000", 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4150000000000003e-05 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.369132+0000", 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7119e-05 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.410 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.369140+0000", 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1820000000000006e-06 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378162+0000", 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0090215509999999992 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378237+0000", 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5492000000000002e-05 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.411 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:125877 4.24 e78/13 4:27adda6e:::100000001f8.0000000f:head v 78'1992, mlcod=78'1988)", 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.370101+0000", 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.008555577, 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0088437499999999992, 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370101+0000", 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370101+0000", 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370101+0000", 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370127+0000", 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6038999999999999e-05 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370138+0000", 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1717e-05 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370146+0000", 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2389999999999996e-06 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.414 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.376777+0000", 2024-04-26T12:33:17.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0066312230000000003 2024-04-26T12:33:17.415 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.415 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.415 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.415 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.376800+0000", 2024-04-26T12:33:17.415 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.3377999999999999e-05 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125840 4.3 4:c222b65c:::100000001f8.00000021:head [write 4104192~8192 in=8192b,write 4116480~4096 in=4096b,write 4157440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.355321+0000", 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.023335413999999999, 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023672617999999999, 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.416 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125840 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.355321+0000", 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.417 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.355321+0000", 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.355320+0000", 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.355341+0000", 2024-04-26T12:33:17.418 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0849999999999999e-05 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.355349+0000", 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6059999999999997e-06 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.355354+0000", 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1440000000000002e-06 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.419 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.355392+0000", 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.807e-05 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.355480+0000", 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8134999999999996e-05 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.355641+0000", 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000160235 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.420 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.374618+0000", 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018977105000000001 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125879 4.35 4:af28909f:::100000001f8.0000001b:head [write 2134016~4096 in=4096b,write 2187264~4096 in=4096b,write 2363392~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.370515+0000", 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0081419119999999994, 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0085394570000000003, 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.421 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125879 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370515+0000", 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.422 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370515+0000", 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370514+0000", 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370528+0000", 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4562999999999999e-05 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.423 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370539+0000", 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0635999999999999e-05 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370549+0000", 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5820000000000008e-06 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.374998+0000", 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0044493859999999996 2024-04-26T12:33:17.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375321+0000", 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00032331100000000001 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.425 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125882 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 4050944~4096 in=4096b,write 4108288~4096 in=4096b,write 4149248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.371569+0000", 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0070880500000000003, 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0075278109999999997, 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125882 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.426 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371569+0000", 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371569+0000", 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.427 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371568+0000", 2024-04-26T12:33:17.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.428 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.428 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371581+0000", 2024-04-26T12:33:17.428 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3283e-05 2024-04-26T12:33:17.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371594+0000", 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3497e-05 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371603+0000", 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1610000000000003e-06 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.374960+0000", 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003357531 2024-04-26T12:33:17.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375104+0000", 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014429699999999999 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375231+0000", 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00012648100000000001 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.430 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125845 4.13 4:cbf33e86:::100000001f8.00000026:head [write 434176~4096 in=4096b,write 495616~4096 in=4096b,write 540672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.357217+0000", 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.021439829000000001, 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.021922410999999999, 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.431 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125845 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.357217+0000", 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.357217+0000", 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.432 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.357216+0000", 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.357241+0000", 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5295000000000001e-05 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.357252+0000", 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0115999999999999e-05 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.433 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.357257+0000", 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7139999999999998e-06 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.357293+0000", 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5444000000000001e-05 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.357351+0000", 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.7989000000000003e-05 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.434 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.357440+0000", 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.9383999999999997e-05 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.374612+0000", 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017171404000000001 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.435 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125883 4.e 4:73e84e43:::100000001f8.00000004:head [write 2027520~4096 in=4096b,write 2043904~4096 in=4096b,write 2060288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.371841+0000", 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0068155840000000004, 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0073777970000000002, 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125883 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.436 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371841+0000", 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371841+0000", 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371840+0000", 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.437 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371861+0000", 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.1095e-05 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371874+0000", 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.292e-05 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.438 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371882+0000", 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5109999999999997e-06 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.371931+0000", 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9209999999999998e-05 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372024+0000", 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3338000000000007e-05 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.439 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372187+0000", 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016294700000000001 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.376080+0000", 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003892356 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125884 4.1b 4.d7c0abdb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.372243+0000", 2024-04-26T12:33:17.440 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0064137819999999998, 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0070216510000000003, 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125884 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372243+0000", 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.441 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372243+0000", 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372242+0000", 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.442 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372269+0000", 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.7279000000000001e-05 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372280+0000", 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0713000000000001e-05 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372287+0000", 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1629999999999999e-06 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.443 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125847 4.13 4:cbf33e86:::100000001f8.00000026:head [write 2994176~4096 in=4096b,write 3166208~4096 in=4096b,write 3284992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.358065+0000", 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.020591425, 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.021234197, 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125847 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.444 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358065+0000", 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358065+0000", 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.445 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358064+0000", 2024-04-26T12:33:17.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.446 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.446 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358082+0000", 2024-04-26T12:33:17.446 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7907e-05 2024-04-26T12:33:17.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.446 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358098+0000", 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5146e-05 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358106+0000", 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1750000000000005e-06 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368431+0000", 2024-04-26T12:33:17.447 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010325446 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368506+0000", 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4392000000000002e-05 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.368601+0000", 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.5554e-05 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.448 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125885 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1228800~4096 in=4096b,write 1286144~4096 in=4096b,write 1396736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.372587+0000", 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0060692280000000003, 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.006759719, 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125885 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.449 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372587+0000", 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372587+0000", 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372586+0000", 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372621+0000", 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4696000000000001e-05 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372633+0000", 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2038000000000001e-05 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.451 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372641+0000", 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7829999999999999e-06 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372680+0000", 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9440000000000002e-05 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372758+0000", 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7916000000000004e-05 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.452 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125848 4.13 4:caef1406:::100000001f8.00000031:head [write 98304~4096 in=4096b,write 491520~4096 in=4096b,write 565248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.358403+0000", 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.020253611000000001, 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020992674999999999, 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.453 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125848 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358403+0000", 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358403+0000", 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.454 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358402+0000", 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358412+0000", 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9199999999999999e-06 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358419+0000", 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.0049999999999998e-06 2024-04-26T12:33:17.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358424+0000", 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.374e-06 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.374634+0000", 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016210448999999998 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.374709+0000", 2024-04-26T12:33:17.456 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4635000000000006e-05 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.374876+0000", 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00016688599999999999 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.457 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125886 4.3 4.3a6d4443 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.372910+0000", 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0057470120000000001, 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065682880000000003, 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125886 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.458 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372910+0000", 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372910+0000", 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372909+0000", 2024-04-26T12:33:17.459 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372940+0000", 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1241999999999997e-05 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372957+0000", 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.7405999999999999e-05 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.460 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372967+0000", 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1579999999999994e-06 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125849 4.11 4:893be98d:::100000001f8.00000001:head [write 3952640~4096 in=4096b,write 3973120~4096 in=4096b,write 4009984~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.358759+0000", 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.019897186000000001, 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020784051000000001, 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.461 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125849 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358759+0000", 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358759+0000", 2024-04-26T12:33:17.462 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358759+0000", 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358767+0000", 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3580000000000003e-06 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358774+0000", 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2809999999999997e-06 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358778+0000", 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.0110000000000002e-06 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358808+0000", 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0831999999999999e-05 2024-04-26T12:33:17.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.358862+0000", 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3409999999999999e-05 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125887 4.34 4.ca934b4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.373227+0000", 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0054294720000000003, 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0063848450000000001, 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.465 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125887 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373227+0000", 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.466 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373227+0000", 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373226+0000", 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.467 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373269+0000", 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.2592000000000001e-05 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373279+0000", 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9049999999999992e-06 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373284+0000", 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.502e-06 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.468 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125888 4.d 4:b1164065:::100000001f8.00000035:head [write 3207168~4096 in=4096b,write 3239936~4096 in=4096b,write 3338240~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.373433+0000", 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0052231229999999997, 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0062414690000000004, 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125888 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.469 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373433+0000", 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373433+0000", 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373433+0000", 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373476+0000", 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3101e-05 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373482+0000", 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8470000000000001e-06 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.373486+0000", 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1999999999999996e-06 2024-04-26T12:33:17.471 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379218+0000", 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0057315689999999997 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379292+0000", 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4515000000000001e-05 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379437+0000", 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000145377 2024-04-26T12:33:17.472 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125893 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 1609728~4096 in=4096b,write 1626112~4096 in=4096b,write 1654784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.375297+0000", 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0033598740000000001, 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0044660940000000003, 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.473 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125893 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375297+0000", 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375297+0000", 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.474 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375296+0000", 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375335+0000", 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9425999999999998e-05 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375344+0000", 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1249999999999999e-06 2024-04-26T12:33:17.475 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375352+0000", 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2880000000000004e-06 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375397+0000", 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5061000000000001e-05 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.375489+0000", 2024-04-26T12:33:17.476 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.2443999999999998e-05 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125896 4.13 4.617ccfd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.376454+0000", 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.0022021530000000001, 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0033618210000000001, 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.477 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125896 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.376454+0000", 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.478 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.376454+0000", 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.376454+0000", 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.479 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.376465+0000", 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.146e-05 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.376475+0000", 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3889999999999994e-06 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.376482+0000", 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2690000000000002e-06 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125852 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 1118208~4096 in=4096b,write 1175552~4096 in=4096b,write 1351680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.360036+0000", 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.018620947999999998, 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019815769, 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125852 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.360036+0000", 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.360036+0000", 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.360035+0000", 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.482 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.360047+0000", 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1973999999999999e-05 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.360059+0000", 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1765e-05 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.360066+0000", 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.9650000000000002e-06 2024-04-26T12:33:17.483 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.360099+0000", 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.3293999999999997e-05 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.360148+0000", 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9326000000000002e-05 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125899 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1822720~4096 in=4096b,write 2367488~4096 in=4096b,write 3014656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.378660+0000", 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4294967295.9999962, 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0012326489999999999, 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125899 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.485 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378660+0000", 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378660+0000", 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378659+0000", 2024-04-26T12:33:17.486 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999986 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378674+0000", 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5034999999999999e-05 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378686+0000", 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1671000000000001e-05 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.487 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378694+0000", 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0229999999999992e-06 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378739+0000", 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5074000000000002e-05 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.488 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.378825+0000", 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5809999999999993e-05 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop_reply(client.4532.0:125847 4.13 e78/13)", 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.379155+0000", 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4294967295.9995022, 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00077463599999999999, 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.489 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379155+0000", 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379155+0000", 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.490 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379154+0000", 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379159+0000", 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0529999999999997e-06 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379175+0000", 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5617999999999999e-05 2024-04-26T12:33:17.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379182+0000", 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1430000000000001e-06 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125856 4.13 4:cbf33e86:::100000001f8.00000026:head [write 2461696~4096 in=4096b,write 2498560~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.361458+0000", 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.017198471, 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018508437999999999, 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.492 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125856 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361458+0000", 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.493 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361458+0000", 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361457+0000", 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361473+0000", 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5163e-05 2024-04-26T12:33:17.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361483+0000", 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8619999999999998e-06 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361489+0000", 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4590000000000003e-06 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.377741+0000", 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016251680000000001 2024-04-26T12:33:17.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.377834+0000", 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3676000000000002e-05 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.377979+0000", 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00014499399999999999 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.496 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop_reply(client.4532.0:125866 4.d e78/13)", 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.379701+0000", 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4294967295.9989557, 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000306306, 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379701+0000", 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379701+0000", 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379700+0000", 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.498 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379705+0000", 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7119999999999999e-06 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379715+0000", 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0263e-05 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.499 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379722+0000", 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6579999999999996e-06 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125902 4.25 4.800ff6e5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.379754+0000", 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 4294967295.9989023, 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00027922899999999998, 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.500 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125902 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379754+0000", 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379754+0000", 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379754+0000", 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379766+0000", 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2414e-05 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379777+0000", 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:33:17.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.379785+0000", 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3299999999999999e-06 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:125855 4.24 e78/13 4:27adda6e:::100000001f8.0000000f:head v 78'1990, mlcod=78'1988)", 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.361864+0000", 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.016792378, 2024-04-26T12:33:17.503 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018207083999999998, 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361864+0000", 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361864+0000", 2024-04-26T12:33:17.504 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361864+0000", 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967296 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361874+0000", 2024-04-26T12:33:17.505 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8740000000000007e-06 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361878+0000", 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6710000000000001e-06 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361880+0000", 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.57e-06 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.506 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361915+0000", 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.4721000000000002e-05 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.361936+0000", 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0826999999999999e-05 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125858 4.22 4:47e99c31:::100000001f8.00000025:head [write 1511424~4096 in=4096b,write 1572864~4096 in=4096b,write 1609728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.362121+0000", 2024-04-26T12:33:17.507 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.016535272, 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017986449000000002, 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125858 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362121+0000", 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362121+0000", 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362121+0000", 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.509 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362142+0000", 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.126e-05 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362151+0000", 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.5939999999999994e-06 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362155+0000", 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8729999999999998e-06 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372555+0000", 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.010399791 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372619+0000", 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3804000000000001e-05 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.372737+0000", 2024-04-26T12:33:17.511 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117766 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.377967+0000", 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.005230251 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125859 4.38 4:1dcf718c:::100000001f8.00000022:head [write 2027520~4096 in=4096b,write 2203648~4096 in=4096b,write 2215936~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.362658+0000", 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.015998831000000002, 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017495986000000002, 2024-04-26T12:33:17.512 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125859 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362658+0000", 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.513 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362658+0000", 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362657+0000", 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362667+0000", 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4870000000000008e-06 2024-04-26T12:33:17.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362673+0000", 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2049999999999999e-06 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362677+0000", 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.6389999999999998e-06 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362722+0000", 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4960000000000003e-05 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.362775+0000", 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.3690000000000003e-05 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.516 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_repop(client.4532.0:125860 4.24 e78/13 4:27adda6e:::100000001f8.0000000f:head v 78'1991, mlcod=78'1988)", 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.363422+0000", 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.015234741, 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016768818000000001, 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.517 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.363422+0000", 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.363422+0000", 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.518 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.363421+0000", 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.363442+0000", 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.0628e-05 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.363448+0000", 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3040000000000001e-06 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.363452+0000", 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5650000000000002e-06 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370362+0000", 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.006910027 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.520 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370384+0000", 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.2019999999999999e-05 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125864 4.35 4:af28909f:::100000001f8.0000001b:head [write 954368~4096 in=4096b,write 1175552~4096 in=4096b,write 1204224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.364812+0000", 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.013844853000000001, 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015415628000000001, 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "started", 2024-04-26T12:33:17.521 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125864 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.364812+0000", 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.364812+0000", 2024-04-26T12:33:17.522 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.364811+0000", 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.364822+0000", 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0468e-05 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.364828+0000", 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.336e-06 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.364832+0000", 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8979999999999998e-06 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370418+0000", 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0055865150000000002 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370494+0000", 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5947999999999999e-05 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:125866 4.d 4:b1164065:::100000001f8.00000035:head [write 2490368~4096 in=4096b,write 2826240~4096 in=4096b,write 2846720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:33:17.365578+0000", 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 0.013078441, 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014688734, 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:17.525 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 125866 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.365578+0000", 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.365578+0000", 2024-04-26T12:33:17.526 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.365578+0000", 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.365586+0000", 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8210000000000002e-06 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.365592+0000", 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3040000000000001e-06 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.365596+0000", 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5800000000000002e-06 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370408+0000", 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.004811704 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370484+0000", 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5637999999999996e-05 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 1", 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:33:17.370622+0000", 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000138021 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.529 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.530 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.530 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-04-26T12:33:17.530 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 34 2024-04-26T12:33:17.530 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:17.532 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:17.533 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:17.530+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:17.632 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:17.631+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:17.733 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:17.732+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:17.747 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:17.747 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:17.747 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:33:17.747 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:33:17.747 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:17.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:17.846 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:17.845+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:17.935 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:17.934+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:17.973 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.897314741999999, 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.974 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:33:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:33:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:33:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:33:17.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:33:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:33:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:33:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:33:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:33:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:33:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:33:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:33:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:33:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:33:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:33:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:33:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:33:17.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:33:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:33:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:33:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:33:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:33:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:33:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.983 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.890240593000001, 2024-04-26T12:33:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:33:17.984 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:33:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.985 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.986 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:33:17.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:33:17.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:33:17.989 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:33:17.990 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.883079113000001, 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.991 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:33:17.993 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.994 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.995 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:33:17.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.882690510000003, 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:33:17.997 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:17.998 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:17.999 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:33:18.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:33:18.001 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.002 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.882360804999998, 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.004 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.006 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:18.007 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.008 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.009 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.880518238999997, 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.010 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.011 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.012 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.013 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:33:18.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:33:18.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.014 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:18.014 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:33:18.014 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:33:18.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.015 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:33:18.015 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:33:18.015 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.015 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.015 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:33:18.016 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:33:18.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.016 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.016 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.016 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:33:18.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:33:18.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.017 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.017 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:33:18.017 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:33:18.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.018 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.018 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:33:18.018 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:33:18.018 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.018 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.019 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.019 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.019 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:18.019 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:18.019 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.876165534000002, 2024-04-26T12:33:18.019 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:33:18.021 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.021 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:18.021 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.021 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.022 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.022 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:33:18.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.022 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.022 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.022 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:18.022 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.023 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.023 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:18.023 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:33:18.024 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.024 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.024 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.024 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.024 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:33:18.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:33:18.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.025 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.025 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:33:18.025 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:33:18.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.026 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.026 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:33:18.026 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:33:18.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:33:18.027 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:33:18.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.027 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.027 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:33:18.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:33:18.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.028 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.028 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:18.028 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:33:18.028 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:33:18.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.029 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.029 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:33:18.029 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:33:18.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.030 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:33:18.030 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:33:18.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.030 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:33:18.031 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:33:18.031 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.031 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.031 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.031 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:33:18.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:33:18.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.032 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.032 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:33:18.032 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:33:18.032 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.033 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.033 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.033 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.033 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:18.034 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852479903000003, 2024-04-26T12:33:18.034 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:33:18.034 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.034 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.034 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.034 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.034 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.035 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:33:18.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.035 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.035 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.035 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:18.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.036 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.036 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:18.036 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.037 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.037 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:33:18.037 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.037 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:33:18.038 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:33:18.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.038 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.038 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:18.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:33:18.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.039 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.039 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:33:18.039 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:33:18.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.040 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.040 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.040 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:33:18.040 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:33:18.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.041 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:33:18.041 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:33:18.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.041 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.042 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:33:18.043 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:33:18.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.043 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.043 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.043 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:33:18.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:33:18.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.044 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.044 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:33:18.044 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:33:18.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.045 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.045 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:33:18.045 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:33:18.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.046 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.046 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.046 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:33:18.046 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:33:18.046 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.046 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.047 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.047 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.047 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.047 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.047 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:18.047 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852332177999997, 2024-04-26T12:33:18.048 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:33:18.048 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.048 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.048 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.048 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.048 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.048 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:33:18.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.049 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.049 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.049 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:18.049 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.050 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.050 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:18.050 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.050 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:33:18.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:33:18.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:33:18.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852275093999999, 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:33:18.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:33:18.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852247816999999, 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.060 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.061 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.062 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.063 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.064 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.065 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852206121000002, 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.066 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:33:18.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:33:18.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852159886000003, 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.072 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.073 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.074 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.075 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852126601999998, 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.077 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:18.078 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:33:18.079 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.080 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.081 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:33:18.082 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852096527999997, 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.083 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.084 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.085 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.086 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.087 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.088 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852060264000002, 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:33:18.090 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.091 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.092 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.852005793000004, 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.094 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.095 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.096 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.097 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.098 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.099 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.851980384999997, 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.100 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:33:18.102 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:33:18.103 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:33:18.104 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.851956555999998, 2024-04-26T12:33:18.105 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.106 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:33:18.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:33:18.110 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 41.847808235999999, 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.111 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:18.112 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:33:18.113 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:18.114 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:18.115 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:18.116 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:18.116 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:33:18.118 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:18.117+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:18.119 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:18.218 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:18.217+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:18.253 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127863 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2449408~4096 in=4096b,write 2527232~4096 in=4096b,write 2760704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.285668+0000", 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027724419, 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027756955, 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.320 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127863 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285668+0000", 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285668+0000", 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285668+0000", 2024-04-26T12:33:18.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285675+0000", 2024-04-26T12:33:18.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0369999999999997e-06 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285681+0000", 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9259999999999997e-06 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285684+0000", 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6160000000000002e-06 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285725+0000", 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0710000000000002e-05 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285794+0000", 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9136999999999999e-05 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127900 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 3358720~4096 in=4096b,write 3444736~4096 in=4096b,write 3452928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.305310+0000", 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0080823979999999993, 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0081932210000000005, 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127900 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305310+0000", 2024-04-26T12:33:18.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305310+0000", 2024-04-26T12:33:18.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305309+0000", 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305325+0000", 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.626e-05 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305335+0000", 2024-04-26T12:33:18.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8740000000000007e-06 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305344+0000", 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4249999999999998e-06 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305381+0000", 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7115e-05 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.328 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305460+0000", 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9305e-05 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127864 4.23 4:c6f90462:::100000001f8.00000037:head [write 1523712~4096 in=4096b,write 1765376~4096 in=4096b,write 1826816~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.286126+0000", 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.027266579999999999, 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.027449852, 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.329 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127864 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286126+0000", 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286126+0000", 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286125+0000", 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286141+0000", 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5432000000000001e-05 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286159+0000", 2024-04-26T12:33:18.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8695e-05 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286168+0000", 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0790000000000007e-06 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294246+0000", 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0080776579999999997 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294317+0000", 2024-04-26T12:33:18.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0714000000000001e-05 2024-04-26T12:33:18.333 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.333 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.333 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.333 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127901 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.333 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.305353+0000", 2024-04-26T12:33:18.333 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0080394170000000001, 2024-04-26T12:33:18.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082885279999999999, 2024-04-26T12:33:18.334 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.334 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.334 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.334 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.334 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.334 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127901 2024-04-26T12:33:18.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.334 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305353+0000", 2024-04-26T12:33:18.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305353+0000", 2024-04-26T12:33:18.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305353+0000", 2024-04-26T12:33:18.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305364+0000", 2024-04-26T12:33:18.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1654999999999999e-05 2024-04-26T12:33:18.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.337 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.337 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305371+0000", 2024-04-26T12:33:18.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0990000000000001e-06 2024-04-26T12:33:18.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305377+0000", 2024-04-26T12:33:18.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8109999999999999e-06 2024-04-26T12:33:18.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.338 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.338 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.338 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127865 4.22 e78/52 4:47e99c31:::100000001f8.00000025:head v 78'1957, mlcod=78'1952)", 2024-04-26T12:33:18.339 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.286827+0000", 2024-04-26T12:33:18.339 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.026565477000000001, 2024-04-26T12:33:18.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026874788, 2024-04-26T12:33:18.339 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.339 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.339 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286827+0000", 2024-04-26T12:33:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286827+0000", 2024-04-26T12:33:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286826+0000", 2024-04-26T12:33:18.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286841+0000", 2024-04-26T12:33:18.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4859e-05 2024-04-26T12:33:18.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286853+0000", 2024-04-26T12:33:18.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1488000000000001e-05 2024-04-26T12:33:18.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286859+0000", 2024-04-26T12:33:18.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2360000000000001e-06 2024-04-26T12:33:18.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.287466+0000", 2024-04-26T12:33:18.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00060731399999999997 2024-04-26T12:33:18.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.287488+0000", 2024-04-26T12:33:18.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1962000000000001e-05 2024-04-26T12:33:18.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.344 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.344 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.344 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127902 4.14 4:2b28d75f:::100000001f8.00000016:head [write 835584~4096 in=4096b,write 897024~4096 in=4096b,write 917504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.344 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.305383+0000", 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0080099190000000008, 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0083916479999999998, 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127902 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.345 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305383+0000", 2024-04-26T12:33:18.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305383+0000", 2024-04-26T12:33:18.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305382+0000", 2024-04-26T12:33:18.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305392+0000", 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.482e-06 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305401+0000", 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.6430000000000007e-06 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305407+0000", 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.366e-06 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.348 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305460+0000", 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3133000000000001e-05 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305539+0000", 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8914999999999999e-05 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.349 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127820 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3821568~4096 in=4096b,write 3883008~4096 in=4096b,write 4030464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.264993+0000", 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.048399523, 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.048863575999999999, 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127820 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.264993+0000", 2024-04-26T12:33:18.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.264993+0000", 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.264992+0000", 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.265003+0000", 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0379e-05 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.265013+0000", 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0069e-05 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.265018+0000", 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6999999999999996e-06 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.273680+0000", 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0086614450000000003 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.273768+0000", 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8250000000000004e-05 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127899 4.d e78/13 4:b1164065:::100000001f8.00000035:head v 78'2004, mlcod=78'2000)", 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.305748+0000", 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0076441740000000001, 2024-04-26T12:33:18.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0081813319999999995, 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305748+0000", 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305748+0000", 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305748+0000", 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305763+0000", 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5704000000000001e-05 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305774+0000", 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0858e-05 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305781+0000", 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2359999999999998e-06 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.308041+0000", 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002259428 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.308061+0000", 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0384e-05 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.356 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127821 4.2f 4:f59f865b:::100000001f8.00000007:head [write 475136~4096 in=4096b,write 614400~4096 in=4096b,write 634880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.265697+0000", 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.047695333999999999, 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.048304753999999998, 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127821 2024-04-26T12:33:18.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.265697+0000", 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.265697+0000", 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.265697+0000", 2024-04-26T12:33:18.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.265706+0000", 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1090000000000004e-06 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.265714+0000", 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9789999999999993e-06 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.265719+0000", 2024-04-26T12:33:18.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0520000000000001e-06 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283615+0000", 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017896248 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283704+0000", 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8962999999999995e-05 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127903 4.e e78/13 4:73e84e43:::100000001f8.00000004:head v 78'2038, mlcod=78'2036)", 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.305821+0000", 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0075717639999999999, 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0082600239999999995, 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305821+0000", 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305821+0000", 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305820+0000", 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305836+0000", 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5841e-05 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305845+0000", 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5290000000000008e-06 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.305852+0000", 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1550000000000001e-06 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310158+0000", 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0043064430000000001 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310175+0000", 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6994999999999999e-05 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127823 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1339392~4096 in=4096b,write 1691648~4096 in=4096b,write 2207744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.266438+0000", 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.046954526000000003, 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.047712208999999998, 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.364 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127823 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.266438+0000", 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.266438+0000", 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.266437+0000", 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.266447+0000", 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0064999999999999e-05 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.266454+0000", 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.905e-06 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.266458+0000", 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.788e-06 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.303962+0000", 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037503537000000003 2024-04-26T12:33:18.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.304039+0000", 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7644000000000004e-05 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127868 4.37 4:eff9002a:::100000001f8.00000003:head [write 3579904~4096 in=4096b,write 3604480~4096 in=4096b,write 3641344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.287900+0000", 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.025492569999999999, 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026338067999999999, 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.368 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127868 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.287900+0000", 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.287900+0000", 2024-04-26T12:33:18.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.287899+0000", 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.287912+0000", 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2948e-05 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.287922+0000", 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7170000000000003e-06 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.287929+0000", 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4599999999999997e-06 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313627+0000", 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025697902000000002 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313709+0000", 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.2167000000000001e-05 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127904 4.32 e78/13 4:4f726a0c:::100000001f8.00000012:head v 78'2017, mlcod=78'2014)", 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.306347+0000", 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.007045979, 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0079757379999999996, 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.372 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306347+0000", 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306347+0000", 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306346+0000", 2024-04-26T12:33:18.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306360+0000", 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4178e-05 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306382+0000", 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1897999999999999e-05 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306390+0000", 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.311261+0000", 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0048716719999999996 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.311338+0000", 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6357000000000001e-05 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.375 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127869 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.288226+0000", 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.025166523, 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026160032, 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127869 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.288226+0000", 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.288226+0000", 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.288225+0000", 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.288238+0000", 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2490999999999999e-05 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.288255+0000", 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7048999999999999e-05 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.288262+0000", 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1509999999999998e-06 2024-04-26T12:33:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127905 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.306612+0000", 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0067801129999999999, 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0078302819999999992, 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127905 2024-04-26T12:33:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306612+0000", 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306612+0000", 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306612+0000", 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306624+0000", 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2687999999999999e-05 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306637+0000", 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2883e-05 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306645+0000", 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7770000000000002e-06 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127826 4.37 4:ef395e89:::100000001f8.00000020:head [write 696320~4096 in=4096b,write 733184~4096 in=4096b,write 1056768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.268159+0000", 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.045233306000000001, 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.046348489999999999, 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127826 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.268159+0000", 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.268159+0000", 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.268159+0000", 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.268169+0000", 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9110000000000005e-06 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.268177+0000", 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1880000000000002e-06 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.268182+0000", 2024-04-26T12:33:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1089999999999997e-06 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283687+0000", 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015505006999999999 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283771+0000", 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3718e-05 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.387 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.387 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127906 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.387 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.306974+0000", 2024-04-26T12:33:18.387 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0064188800000000001, 2024-04-26T12:33:18.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0075992439999999998, 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127906 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306974+0000", 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306974+0000", 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306973+0000", 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.306987+0000", 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3808000000000001e-05 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.389 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307003+0000", 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6518999999999999e-05 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307012+0000", 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.388e-06 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.390 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127828 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1028096~4096 in=4096b,write 1036288~4096 in=4096b,write 1048576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.269212+0000", 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.044180416, 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.045418066999999999, 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127828 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.269212+0000", 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.269212+0000", 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.269211+0000", 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.269223+0000", 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1603999999999999e-05 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.269233+0000", 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0202e-05 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.269310+0000", 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6518000000000002e-05 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307247+0000", 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037937315999999999 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307339+0000", 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1798000000000004e-05 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127907 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.307447+0000", 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0059458990000000001, 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072380049999999996, 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127907 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.395 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307447+0000", 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307447+0000", 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307446+0000", 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307461+0000", 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5051999999999999e-05 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307470+0000", 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6989999999999992e-06 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307477+0000", 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2010000000000002e-06 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.398 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127829 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 2207744~4096 in=4096b,write 2547712~4096 in=4096b,write 2670592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.270956+0000", 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.042436322999999998, 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043762793000000001, 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127829 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.270956+0000", 2024-04-26T12:33:18.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.270956+0000", 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.270955+0000", 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.270969+0000", 2024-04-26T12:33:18.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3986e-05 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.270981+0000", 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1904e-05 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.270989+0000", 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9500000000000001e-06 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.401 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285386+0000", 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014396991 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.285473+0000", 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6984999999999995e-05 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127908 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.309263+0000", 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0041292669999999998, 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0054927300000000004, 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127908 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.403 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309263+0000", 2024-04-26T12:33:18.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309263+0000", 2024-04-26T12:33:18.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309263+0000", 2024-04-26T12:33:18.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309274+0000", 2024-04-26T12:33:18.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1858000000000001e-05 2024-04-26T12:33:18.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309284+0000", 2024-04-26T12:33:18.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5990000000000008e-06 2024-04-26T12:33:18.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309290+0000", 2024-04-26T12:33:18.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8200000000000002e-06 2024-04-26T12:33:18.408 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.408 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.408 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.409 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127830 4.2a 4:57147dc3:::100000001f8.00000011:head [write 1626112~4096 in=4096b,write 1744896~4096 in=4096b,write 1765376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.409 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.270997+0000", 2024-04-26T12:33:18.409 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.042395412, 2024-04-26T12:33:18.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043792877000000001, 2024-04-26T12:33:18.409 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.409 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:18.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.410 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.410 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127830 2024-04-26T12:33:18.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.410 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.270997+0000", 2024-04-26T12:33:18.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.270997+0000", 2024-04-26T12:33:18.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.412 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.412 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.412 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.412 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.270997+0000", 2024-04-26T12:33:18.412 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.271008+0000", 2024-04-26T12:33:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1225e-05 2024-04-26T12:33:18.413 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.271015+0000", 2024-04-26T12:33:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:33:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.414 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.271020+0000", 2024-04-26T12:33:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6500000000000001e-06 2024-04-26T12:33:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.415 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.288889+0000", 2024-04-26T12:33:18.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017869063000000001 2024-04-26T12:33:18.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.416 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.416 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.288961+0000", 2024-04-26T12:33:18.416 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1773000000000006e-05 2024-04-26T12:33:18.416 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.416 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:33:18.417 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.289107+0000", 2024-04-26T12:33:18.417 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014641099999999999 2024-04-26T12:33:18.417 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.417 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.417 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:33:18.418 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296317+0000", 2024-04-26T12:33:18.418 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0072093369999999997 2024-04-26T12:33:18.418 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.418 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.418 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.418 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.418 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.419 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127876 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.419 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.292168+0000", 2024-04-26T12:33:18.419 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.021224396, 2024-04-26T12:33:18.419 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.022665698000000001, 2024-04-26T12:33:18.419 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.419 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.420 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.420 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.420 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.420 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127876 2024-04-26T12:33:18.420 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.420 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.420 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.421 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.292168+0000", 2024-04-26T12:33:18.421 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.421 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.421 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.421 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.292168+0000", 2024-04-26T12:33:18.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.422 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.422 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.422 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.422 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.292167+0000", 2024-04-26T12:33:18.422 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.423 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.423 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.423 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.292180+0000", 2024-04-26T12:33:18.423 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3062e-05 2024-04-26T12:33:18.423 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.424 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.292192+0000", 2024-04-26T12:33:18.424 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1531e-05 2024-04-26T12:33:18.424 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.424 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.424 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.425 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.292200+0000", 2024-04-26T12:33:18.425 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3469999999999999e-06 2024-04-26T12:33:18.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.425 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.425 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.425 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.426 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.426 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127909 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.426 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.309295+0000", 2024-04-26T12:33:18.426 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0040972339999999999, 2024-04-26T12:33:18.426 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0055901270000000003, 2024-04-26T12:33:18.426 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.429 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127909 2024-04-26T12:33:18.429 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.429 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.429 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.430 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309295+0000", 2024-04-26T12:33:18.430 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.430 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.430 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.430 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309295+0000", 2024-04-26T12:33:18.431 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.431 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.431 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.431 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.431 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309295+0000", 2024-04-26T12:33:18.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.432 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.432 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.432 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309304+0000", 2024-04-26T12:33:18.432 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3149999999999998e-06 2024-04-26T12:33:18.432 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309309+0000", 2024-04-26T12:33:18.433 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:33:18.433 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.433 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.433 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.433 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309312+0000", 2024-04-26T12:33:18.434 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0290000000000001e-06 2024-04-26T12:33:18.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.434 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.434 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.434 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.434 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.434 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127831 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 61440~4096 in=4096b,write 106496~4096 in=4096b,write 155648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.434 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.271027+0000", 2024-04-26T12:33:18.434 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.042365482000000003, 2024-04-26T12:33:18.435 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.043924493000000002, 2024-04-26T12:33:18.435 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.435 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.435 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.435 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.435 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.435 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127831 2024-04-26T12:33:18.435 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.436 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.271027+0000", 2024-04-26T12:33:18.436 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.436 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.436 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.436 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.436 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.271027+0000", 2024-04-26T12:33:18.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.437 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.437 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.437 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.271027+0000", 2024-04-26T12:33:18.437 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.437 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.271036+0000", 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1870000000000003e-06 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.271043+0000", 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6649999999999997e-06 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.438 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.271047+0000", 2024-04-26T12:33:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.639e-06 2024-04-26T12:33:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286468+0000", 2024-04-26T12:33:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01542077 2024-04-26T12:33:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.439 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.286518+0000", 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.0455999999999999e-05 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127910 4.13 e78/13 4:cbf33e86:::100000001f8.00000026:head v 78'4034, mlcod=78'4031)", 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.309578+0000", 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0038141759999999999, 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00545409, 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.440 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309578+0000", 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309578+0000", 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309578+0000", 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.441 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309590+0000", 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2510000000000001e-05 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309600+0000", 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0096e-05 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309607+0000", 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.8299999999999998e-06 2024-04-26T12:33:18.442 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309644+0000", 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6671000000000002e-05 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309665+0000", 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.443 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127788 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1724416~4096 in=4096b,write 1851392~4096 in=4096b,write 2039808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.251358+0000", 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.062034507000000003, 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.063713250999999999, 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127788 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.444 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.251358+0000", 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.251358+0000", 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.251357+0000", 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.445 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.251371+0000", 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3577000000000001e-05 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.251380+0000", 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9579999999999996e-06 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.251386+0000", 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.545e-06 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.446 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.266932+0000", 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015545748 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.267008+0000", 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6477000000000007e-05 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127878 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.447 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.293288+0000", 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.020104918999999999, 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021822184000000001, 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127878 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.293288+0000", 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.448 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.293288+0000", 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.293287+0000", 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.293301+0000", 2024-04-26T12:33:18.449 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3729e-05 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.293314+0000", 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2927e-05 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.293323+0000", 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.064e-06 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.450 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127911 4.2a 4:57147dc3:::100000001f8.00000011:head [write 1814528~4096 in=4096b,write 1867776~4096 in=4096b,write 2273280~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.310713+0000", 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.002679556, 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0044307649999999997, 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127911 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.451 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310713+0000", 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310713+0000", 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310712+0000", 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.452 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310727+0000", 2024-04-26T12:33:18.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5299e-05 2024-04-26T12:33:18.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.453 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.453 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.453 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310739+0000", 2024-04-26T12:33:18.453 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1304999999999999e-05 2024-04-26T12:33:18.453 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310746+0000", 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6769999999999995e-06 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.311480+0000", 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00073345300000000001 2024-04-26T12:33:18.454 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.311553+0000", 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3141999999999999e-05 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for subops from 2", 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.311737+0000", 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00018415400000000001 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.455 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127914 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 3584000~4096 in=4096b,write 3817472~4096 in=4096b,write 3866624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.312032+0000", 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.0013602760000000001, 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.003154263, 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127914 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.456 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312032+0000", 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312032+0000", 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312032+0000", 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.457 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312043+0000", 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1146e-05 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312051+0000", 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6419999999999996e-06 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312057+0000", 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5230000000000003e-06 2024-04-26T12:33:18.458 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312093+0000", 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6118999999999998e-05 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312185+0000", 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.1778000000000001e-05 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.459 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127836 4.37 4:ef395e89:::100000001f8.00000020:head [write 1314816~4096 in=4096b,write 1335296~4096 in=4096b,write 1462272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.273681+0000", 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.039711630999999997, 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.041598061999999998, 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127836 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.460 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.273681+0000", 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.273681+0000", 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.461 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.273680+0000", 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.273694+0000", 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3801000000000001e-05 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.273704+0000", 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0807e-05 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.462 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.463 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.273712+0000", 2024-04-26T12:33:18.463 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7370000000000006e-06 2024-04-26T12:33:18.463 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.463 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.463 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298763+0000", 2024-04-26T12:33:18.464 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025051108999999998 2024-04-26T12:33:18.464 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.464 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.464 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.464 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298835+0000", 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1811999999999996e-05 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127879 4.32 e78/13 4:4f726a0c:::100000001f8.00000012:head v 78'2016, mlcod=78'2014)", 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.294310+0000", 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.019082277000000002, 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021008690999999999, 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.465 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294310+0000", 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294310+0000", 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294310+0000", 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.466 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294326+0000", 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5803000000000001e-05 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294335+0000", 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9110000000000005e-06 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294342+0000", 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7390000000000002e-06 2024-04-26T12:33:18.467 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296339+0000", 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0019970209999999999 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296357+0000", 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7742000000000001e-05 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.468 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127916 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3768320~4096 in=4096b,write 3825664~4096 in=4096b,write 3981312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.312760+0000", 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00063301399999999999, 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0025952670000000001, 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127916 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312760+0000", 2024-04-26T12:33:18.469 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312760+0000", 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312759+0000", 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312775+0000", 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6548000000000001e-05 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312786+0000", 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0301e-05 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.312794+0000", 2024-04-26T12:33:18.471 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313845+0000", 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001051335 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313925+0000", 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9312000000000002e-05 2024-04-26T12:33:18.472 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127880 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.294935+0000", 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.018457870000000001, 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020456456000000001, 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.473 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127880 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294935+0000", 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.474 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294935+0000", 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294934+0000", 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294945+0000", 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0873000000000001e-05 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.475 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294953+0000", 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1189999999999997e-06 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.294959+0000", 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.75e-06 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.476 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127912 4.3 e78/52 4:c222b65c:::100000001f8.00000021:head v 78'1983, mlcod=78'1981)", 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.313018+0000", 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00037431999999999998, 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024032839999999999, 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313018+0000", 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.477 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313018+0000", 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313018+0000", 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313032+0000", 2024-04-26T12:33:18.478 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4523e-05 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313042+0000", 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0068000000000001e-05 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313049+0000", 2024-04-26T12:33:18.479 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3640000000000004e-06 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.314105+0000", 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001056413 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.314117+0000", 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2091e-05 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.480 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127881 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.295256+0000", 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.018136571000000001, 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020198363, 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127881 2024-04-26T12:33:18.481 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295256+0000", 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295256+0000", 2024-04-26T12:33:18.482 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.483 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.483 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295256+0000", 2024-04-26T12:33:18.483 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.483 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.483 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295270+0000", 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4165000000000001e-05 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295276+0000", 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9859999999999999e-06 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.484 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295279+0000", 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7280000000000001e-06 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127915 4.34 e78/52 4:2d2c9530:::100000001f8.00000036:head v 78'2021, mlcod=78'2019)", 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.313055+0000", 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.000337743, 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.002429985, 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.485 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313055+0000", 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313055+0000", 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313055+0000", 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.486 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313067+0000", 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2245e-05 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313073+0000", 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.879e-06 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313077+0000", 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2880000000000003e-06 2024-04-26T12:33:18.487 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313129+0000", 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.1739e-05 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313153+0000", 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.404e-05 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.488 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127882 4.12 4:48ab9bde:::100000001f8.00000015:head [write 126976~4096 in=4096b,write 253952~4096 in=4096b,write 282624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.295602+0000", 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017791088, 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019919215000000001, 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127882 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.489 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295602+0000", 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295602+0000", 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295601+0000", 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.490 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295621+0000", 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0319999999999999e-05 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295627+0000", 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.295631+0000", 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9110000000000003e-06 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.491 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.303440+0000", 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0078087419999999996 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.303527+0000", 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7374999999999996e-05 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127917 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.313115+0000", 2024-04-26T12:33:18.492 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00027764199999999998, 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0024418, 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127917 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313115+0000", 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.493 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313115+0000", 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313114+0000", 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313128+0000", 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4068e-05 2024-04-26T12:33:18.494 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313144+0000", 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6339999999999999e-05 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313152+0000", 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8900000000000007e-06 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.495 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127843 4.2f 4:f59f865b:::100000001f8.00000007:head [write 786432~4096 in=4096b,write 823296~4096 in=4096b,write 970752~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.276984+0000", 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.036408121000000002, 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038605159999999999, 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127843 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.276984+0000", 2024-04-26T12:33:18.496 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.276984+0000", 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.276984+0000", 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.276995+0000", 2024-04-26T12:33:18.497 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1697e-05 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277005+0000", 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8649999999999996e-06 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277011+0000", 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6999999999999996e-06 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.498 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.297512+0000", 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.020500786 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.297578+0000", 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5932999999999994e-05 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127883 4.12 4:48ab9bde:::100000001f8.00000015:head [write 671744~4096 in=4096b,write 987136~4096 in=4096b,write 1110016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.296030+0000", 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.017362313000000001, 2024-04-26T12:33:18.499 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019606963000000002, 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127883 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296030+0000", 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.500 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296030+0000", 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296029+0000", 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296057+0000", 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8079999999999999e-05 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.501 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296070+0000", 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2541000000000001e-05 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296080+0000", 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.5149999999999995e-06 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.308526+0000", 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012446646 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.502 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.308608+0000", 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1747000000000002e-05 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127918 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.313501+0000", 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9998918, 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00219388, 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.503 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127918 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313501+0000", 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313501+0000", 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.504 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313500+0000", 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313516+0000", 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5449000000000001e-05 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313526+0000", 2024-04-26T12:33:18.505 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0624e-05 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313534+0000", 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1610000000000003e-06 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127844 4.37 4:eff9002a:::100000001f8.00000003:head [write 1703936~4096 in=4096b,write 1867776~4096 in=4096b,write 1884160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.277287+0000", 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.03610555, 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.038442403999999999, 2024-04-26T12:33:18.506 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127844 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277287+0000", 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.507 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277287+0000", 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277286+0000", 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277307+0000", 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0421e-05 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.508 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277314+0000", 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.776e-06 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277318+0000", 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302763+0000", 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.025445697 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.509 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302873+0000", 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00010972 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127921 4.33 4.365eb6f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.315204+0000", 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.998189, 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00056236800000000005, 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.510 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127921 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315204+0000", 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315204+0000", 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.511 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315203+0000", 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315221+0000", 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7965000000000002e-05 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315232+0000", 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1433e-05 2024-04-26T12:33:18.512 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.513 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.513 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.513 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315244+0000", 2024-04-26T12:33:18.513 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1949e-05 2024-04-26T12:33:18.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.513 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.513 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.513 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127922 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.315627+0000", 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 4294967295.9977655, 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00016928700000000001, 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127922 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.514 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315627+0000", 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315627+0000", 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315626+0000", 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.515 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315644+0000", 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7252e-05 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315653+0000", 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2839999999999995e-06 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.315660+0000", 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.781e-06 2024-04-26T12:33:18.516 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127846 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 987136~4096 in=4096b,write 1134592~4096 in=4096b,write 1179648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.277982+0000", 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.035410588, 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037846965000000003, 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.517 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127846 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277982+0000", 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277982+0000", 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.518 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.277982+0000", 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.278017+0000", 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5726999999999999e-05 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.278023+0000", 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9429999999999997e-06 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.519 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.278027+0000", 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7510000000000002e-06 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310682+0000", 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.032654618000000003 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.310766+0000", 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4522000000000002e-05 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.520 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127886 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 2437120~4096 in=4096b,write 2449408~4096 in=4096b,write 2662400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.298325+0000", 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.015067334999999999, 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017542967999999999, 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127886 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.521 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298325+0000", 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298325+0000", 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298324+0000", 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.522 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298339+0000", 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4567e-05 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298350+0000", 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0898e-05 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298357+0000", 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5810000000000002e-06 2024-04-26T12:33:18.523 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298397+0000", 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0209000000000001e-05 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.298473+0000", 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5909999999999997e-05 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.524 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127848 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2392064~4096 in=4096b,write 2428928~4096 in=4096b,write 2469888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.278617+0000", 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.034775917000000003, 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.037291004000000003, 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127848 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.278617+0000", 2024-04-26T12:33:18.525 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.278617+0000", 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.278616+0000", 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.278628+0000", 2024-04-26T12:33:18.526 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2203e-05 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.278639+0000", 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1168999999999999e-05 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.278645+0000", 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8810000000000001e-06 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296440+0000", 2024-04-26T12:33:18.527 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017794836000000001 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.296526+0000", 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6376000000000001e-05 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127887 4.3d e78/13 4:bfffac44:::100000001f8.0000000c:head v 78'3991, mlcod=78'3987)", 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.299103+0000", 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.014289257, 2024-04-26T12:33:18.528 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.016841774, 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.299103+0000", 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.299103+0000", 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.529 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.299103+0000", 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.299116+0000", 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3713000000000001e-05 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.299125+0000", 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5499999999999995e-06 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.530 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.299130+0000", 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7609999999999998e-06 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.299164+0000", 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3794999999999997e-05 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.299175+0000", 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1754e-05 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.531 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127888 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2658304~4096 in=4096b,write 2813952~4096 in=4096b,write 2854912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.300730+0000", 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012662395, 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015255098999999999, 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127888 2024-04-26T12:33:18.532 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300730+0000", 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300730+0000", 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300729+0000", 2024-04-26T12:33:18.533 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300744+0000", 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.5162e-05 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300755+0000", 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0190999999999999e-05 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300766+0000", 2024-04-26T12:33:18.534 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1535000000000001e-05 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300973+0000", 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00020632699999999999 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301050+0000", 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7168000000000004e-05 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.535 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127806 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3715072~4096 in=4096b,write 4141056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.258177+0000", 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.055215288000000001, 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.057889058, 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127806 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.536 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.258177+0000", 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.258177+0000", 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.258176+0000", 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.537 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.258188+0000", 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1946999999999999e-05 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.258203+0000", 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4728e-05 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.258213+0000", 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.7200000000000001e-06 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.538 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.269097+0000", 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010883848999999999 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.269169+0000", 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1884000000000005e-05 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127891 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.539 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.300807+0000", 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012585393, 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.015330447000000001, 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127891 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300807+0000", 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.540 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300807+0000", 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300807+0000", 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300816+0000", 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.0429999999999996e-06 2024-04-26T12:33:18.541 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300822+0000", 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300826+0000", 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5469999999999998e-06 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.542 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127892 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.300926+0000", 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.012466135999999999, 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.01524849, 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127892 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.543 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300926+0000", 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300926+0000", 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300926+0000", 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.544 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.300935+0000", 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2960000000000004e-06 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301263+0000", 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00032789700000000001 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301273+0000", 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.9510000000000001e-06 2024-04-26T12:33:18.545 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127854 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3555328~4096 in=4096b,write 3584000~4096 in=4096b,write 3743744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.281087+0000", 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.032305596999999998, 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.03512378, 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.546 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127854 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.281087+0000", 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.281087+0000", 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.547 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.281086+0000", 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.281098+0000", 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1436e-05 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.281106+0000", 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4959999999999996e-06 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.548 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.281112+0000", 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5219999999999998e-06 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307620+0000", 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.026508561999999999 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.307700+0000", 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0061000000000005e-05 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.549 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127893 4.d e78/13 4:b1164065:::100000001f8.00000035:head v 78'2003, mlcod=78'2000)", 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.301517+0000", 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011875383999999999, 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014746155, 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301517+0000", 2024-04-26T12:33:18.550 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301517+0000", 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301517+0000", 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301530+0000", 2024-04-26T12:33:18.551 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2982999999999999e-05 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301538+0000", 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7299999999999994e-06 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301544+0000", 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0889999999999996e-06 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302638+0000", 2024-04-26T12:33:18.552 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.001093723 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302659+0000", 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1319e-05 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127810 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 3600384~4096 in=4096b,write 3874816~4096 in=4096b,write 3948544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.259812+0000", 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.053580199000000002, 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.056510347000000002, 2024-04-26T12:33:18.553 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127810 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.259812+0000", 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.554 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.259812+0000", 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.259812+0000", 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.259822+0000", 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0824e-05 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.555 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.259829+0000", 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9290000000000001e-06 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.259835+0000", 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.254e-06 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.268866+0000", 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0090317910000000008 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.556 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.268930+0000", 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.3190999999999999e-05 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127856 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 471040~4096 in=4096b,write 499712~4096 in=4096b,write 618496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.282008+0000", 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.031384689, 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.034375924000000002, 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.557 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127856 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.282008+0000", 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.282008+0000", 2024-04-26T12:33:18.558 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.282007+0000", 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.282019+0000", 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1819e-05 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.282030+0000", 2024-04-26T12:33:18.559 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0854e-05 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.282038+0000", 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.313973+0000", 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.031934861000000002 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.314021+0000", 2024-04-26T12:33:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.7683999999999999e-05 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127894 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1597440~4096 in=4096b,write 1662976~4096 in=4096b,write 2015232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.301616+0000", 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011776350999999999, 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014811401, 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127894 2024-04-26T12:33:18.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301616+0000", 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301616+0000", 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.562 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301615+0000", 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301646+0000", 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0537000000000003e-05 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301655+0000", 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.9109999999999999e-06 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.563 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.301662+0000", 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0520000000000004e-06 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.304412+0000", 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0027503570000000001 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.304529+0000", 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000117086 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127812 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2490368~4096 in=4096b,write 2539520~4096 in=4096b,write 2691072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.260782+0000", 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.052610374000000001, 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.055699916000000002, 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127812 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.565 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.260782+0000", 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.260782+0000", 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.260782+0000", 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.566 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.260812+0000", 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0781999999999998e-05 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.260825+0000", 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2945999999999999e-05 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.260832+0000", 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.567 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.297792+0000", 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.036959939999999997 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.297885+0000", 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3199e-05 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127895 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.302012+0000", 2024-04-26T12:33:18.568 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.011380901000000001, 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014607547, 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127895 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302012+0000", 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.569 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302012+0000", 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302011+0000", 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302032+0000", 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0625e-05 2024-04-26T12:33:18.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302040+0000", 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1319999999999994e-06 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302047+0000", 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3320000000000003e-06 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.571 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127860 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.283614+0000", 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.029778972000000001, 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.033052686999999997, 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "queued for pg", 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127860 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.572 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283614+0000", 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283614+0000", 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283613+0000", 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.573 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283623+0000", 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.8879999999999992e-06 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283631+0000", 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0579999999999998e-06 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.283636+0000", 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6169999999999998e-06 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.574 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(client.4532.0:127896 4.13 e78/13 4:caef1406:::100000001f8.00000031:head v 78'4033, mlcod=78'4030)", 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.302698+0000", 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.010694453, 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014002914999999999, 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302698+0000", 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.575 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302698+0000", 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302698+0000", 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302711+0000", 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3648999999999999e-05 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.576 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302719+0000", 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0450000000000001e-06 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302725+0000", 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.9889999999999997e-06 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302942+0000", 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000217056 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.577 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.302959+0000", 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.6855e-05 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:127897 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2932736~4096 in=4096b,write 3022848~4096 in=4096b,write 3108864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:18.303141+0000", 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.010251708, 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013597011000000001, 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:18.578 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 127897 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.303141+0000", 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.303141+0000", 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.579 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.303140+0000", 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.303153+0000", 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.271e-05 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.303163+0000", 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0424999999999999e-05 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.580 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.303171+0000", 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2980000000000003e-06 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309378+0000", 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0062075239999999999 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:18.309434+0000", 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5844000000000003e-05 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.581 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:18.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.582 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:18.582 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:33:18.582 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 63 2024-04-26T12:33:18.582 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:18.583 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:18.583 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:18.584 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:18.585 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:18.582+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:18.585 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:18.585 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:18.585 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:18.585 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:18.585 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:18.684 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:18.683+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:18.788 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:18.786+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:18.817 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:18.817 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:18.832 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:18.847 INFO:tasks.workunit.client.0.smithi038.stdout:setting up random write file 2024-04-26T12:33:18.847 INFO:tasks.workunit.client.0.smithi038.stdout:done setting up random write file 2024-04-26T12:33:18.847 INFO:tasks.workunit.client.0.smithi038.stdout:starting fsync run 2024-04-26T12:33:18.847 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0048s fsync time: 0.0063s 2024-04-26T12:33:18.847 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0011s fsync time: 0.0185s 2024-04-26T12:33:18.847 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0012s fsync time: 0.0120s 2024-04-26T12:33:18.847 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0125s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0147s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0021s fsync time: 0.0166s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0023s fsync time: 0.0139s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0015s fsync time: 0.0141s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0179s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0015s fsync time: 0.0222s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0012s fsync time: 0.0105s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0021s fsync time: 0.0101s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0029s fsync time: 0.0125s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0131s 2024-04-26T12:33:18.848 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0067s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0106s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0136s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0229s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 1.0628s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0019s fsync time: 0.4468s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0011s fsync time: 0.0110s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0021s fsync time: 0.0105s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0017s fsync time: 0.0127s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0158s 2024-04-26T12:33:18.849 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0017s fsync time: 0.0124s 2024-04-26T12:33:18.850 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0021s fsync time: 0.0109s 2024-04-26T12:33:18.850 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0019s fsync time: 0.0116s 2024-04-26T12:33:18.850 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0019s fsync time: 0.0128s 2024-04-26T12:33:18.850 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0017s fsync time: 0.0235s 2024-04-26T12:33:18.850 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0017s fsync time: 0.0199s 2024-04-26T12:33:18.850 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0026s fsync time: 0.0148s 2024-04-26T12:33:18.851 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0178s 2024-04-26T12:33:18.851 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0016s fsync time: 0.0153s 2024-04-26T12:33:18.851 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0023s fsync time: 0.0132s 2024-04-26T12:33:18.851 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0013s fsync time: 0.0334s 2024-04-26T12:33:18.851 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0128s 2024-04-26T12:33:18.851 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0165s 2024-04-26T12:33:18.851 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0013s fsync time: 0.0230s 2024-04-26T12:33:18.851 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0242s 2024-04-26T12:33:18.852 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0017s fsync time: 0.0264s 2024-04-26T12:33:18.852 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0259s 2024-04-26T12:33:18.852 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0016s fsync time: 0.0224s 2024-04-26T12:33:18.852 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0013s fsync time: 0.0302s 2024-04-26T12:33:18.852 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0324s 2024-04-26T12:33:18.853 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0015s fsync time: 0.0102s 2024-04-26T12:33:18.853 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0013s fsync time: 0.0206s 2024-04-26T12:33:18.853 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0012s fsync time: 0.0205s 2024-04-26T12:33:18.853 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0013s fsync time: 0.0158s 2024-04-26T12:33:18.853 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0015s fsync time: 0.0110s 2024-04-26T12:33:18.853 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0013s fsync time: 0.0217s 2024-04-26T12:33:18.854 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0125s 2024-04-26T12:33:18.854 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0178s 2024-04-26T12:33:18.854 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0015s fsync time: 0.0218s 2024-04-26T12:33:18.854 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0369s 2024-04-26T12:33:18.854 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0016s fsync time: 0.0239s 2024-04-26T12:33:18.854 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0137s 2024-04-26T12:33:18.855 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0014s fsync time: 0.0223s 2024-04-26T12:33:18.855 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0020s fsync time: 0.0171s 2024-04-26T12:33:18.855 INFO:tasks.workunit.client.0.smithi038.stdout:write time: 0.0018s fsync time: 0.0107s 2024-04-26T12:33:18.855 INFO:tasks.workunit.client.0.smithi038.stdout:run done 59 fsyncs total, killing random writer 2024-04-26T12:33:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-04-26T12:33:18.856 INFO:tasks.workunit.client.0.smithi038.stderr:+ whereis lsof 2024-04-26T12:33:18.857 INFO:tasks.workunit.client.0.smithi038.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-04-26T12:33:18.864 INFO:tasks.workunit.client.0.smithi038.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-04-26T12:33:18.864 INFO:tasks.workunit.client.0.smithi038.stderr:+ lsof 2024-04-26T12:33:18.929 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:18.916+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:18.939 INFO:tasks.workunit.client.0.smithi038.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-04-26T12:33:18.939 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-04-26T12:33:18.940 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-04-26T12:33:18.940 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-04-26T12:33:18.940 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-04-26T12:33:18.940 INFO:tasks.workunit.client.0.smithi038.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-04-26T12:33:18.940 INFO:tasks.workunit.client.0.smithi038.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-04-26T12:33:18.940 INFO:tasks.workunit.client.0.smithi038.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-04-26T12:33:18.940 INFO:tasks.workunit.client.0.smithi038.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-04-26T12:33:18.940 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_gp 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_gp 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_gp 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_gp 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_par_g 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_par_g 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_par_g 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_par_g 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:slub_flus 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:slub_flus 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-04-26T12:33:18.941 INFO:tasks.workunit.client.0.smithi038.stdout:slub_flus 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-04-26T12:33:18.942 INFO:tasks.workunit.client.0.smithi038.stdout:slub_flus 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-04-26T12:33:18.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-04-26T12:33:18.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-04-26T12:33:18.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-04-26T12:33:18.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-04-26T12:33:18.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-04-26T12:33:18.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-04-26T12:33:18.942 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-04-26T12:33:18.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-04-26T12:33:18.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 8 root cwd unknown /proc/8/cwd (readlink: Permission denied) 2024-04-26T12:33:18.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 8 root rtd unknown /proc/8/root (readlink: Permission denied) 2024-04-26T12:33:18.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 8 root txt unknown /proc/8/exe (readlink: Permission denied) 2024-04-26T12:33:18.943 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 8 root NOFD /proc/8/fd (opendir: Permission denied) 2024-04-26T12:33:18.943 INFO:tasks.workunit.client.0.smithi038.stdout:mm_percpu 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2024-04-26T12:33:18.943 INFO:tasks.workunit.client.0.smithi038.stdout:mm_percpu 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2024-04-26T12:33:18.943 INFO:tasks.workunit.client.0.smithi038.stdout:mm_percpu 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2024-04-26T12:33:18.943 INFO:tasks.workunit.client.0.smithi038.stdout:mm_percpu 10 root NOFD /proc/10/fd (opendir: Permission denied) 2024-04-26T12:33:18.944 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-04-26T12:33:18.944 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-04-26T12:33:18.944 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-04-26T12:33:18.944 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-04-26T12:33:18.945 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-04-26T12:33:18.945 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-04-26T12:33:18.945 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-04-26T12:33:18.945 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_tasks 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-04-26T12:33:18.945 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-04-26T12:33:18.945 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-04-26T12:33:18.945 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-04-26T12:33:18.945 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-04-26T12:33:18.946 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_sched 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-04-26T12:33:18.946 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_sched 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-04-26T12:33:18.946 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_sched 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-04-26T12:33:18.946 INFO:tasks.workunit.client.0.smithi038.stdout:rcu_sched 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-04-26T12:33:18.946 INFO:tasks.workunit.client.0.smithi038.stdout:migration 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-04-26T12:33:18.946 INFO:tasks.workunit.client.0.smithi038.stdout:migration 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-04-26T12:33:18.946 INFO:tasks.workunit.client.0.smithi038.stdout:migration 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-04-26T12:33:18.947 INFO:tasks.workunit.client.0.smithi038.stdout:migration 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-04-26T12:33:18.947 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-04-26T12:33:18.947 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-04-26T12:33:18.947 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-04-26T12:33:18.947 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-04-26T12:33:18.947 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/0 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-04-26T12:33:18.947 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/0 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-04-26T12:33:18.947 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/0 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-04-26T12:33:18.947 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/0 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-04-26T12:33:18.948 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/1 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-04-26T12:33:18.948 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/1 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-04-26T12:33:18.948 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/1 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-04-26T12:33:18.948 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/1 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-04-26T12:33:18.948 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-04-26T12:33:18.948 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-04-26T12:33:18.948 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-04-26T12:33:18.948 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-04-26T12:33:18.948 INFO:tasks.workunit.client.0.smithi038.stdout:migration 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-04-26T12:33:18.949 INFO:tasks.workunit.client.0.smithi038.stdout:migration 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-04-26T12:33:18.949 INFO:tasks.workunit.client.0.smithi038.stdout:migration 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-04-26T12:33:18.949 INFO:tasks.workunit.client.0.smithi038.stdout:migration 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-04-26T12:33:18.949 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 21 root cwd unknown /proc/21/cwd (readlink: Permission denied) 2024-04-26T12:33:18.949 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 21 root rtd unknown /proc/21/root (readlink: Permission denied) 2024-04-26T12:33:18.949 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 21 root txt unknown /proc/21/exe (readlink: Permission denied) 2024-04-26T12:33:18.949 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 21 root NOFD /proc/21/fd (opendir: Permission denied) 2024-04-26T12:33:18.949 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-04-26T12:33:18.949 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-04-26T12:33:18.950 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-04-26T12:33:18.950 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-04-26T12:33:18.950 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/2 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-04-26T12:33:18.950 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/2 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-04-26T12:33:18.950 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/2 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-04-26T12:33:18.950 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/2 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-04-26T12:33:18.950 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-04-26T12:33:18.950 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-04-26T12:33:18.950 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:migration 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:migration 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:migration 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:migration 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 27 root cwd unknown /proc/27/cwd (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 27 root rtd unknown /proc/27/root (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 27 root txt unknown /proc/27/exe (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 27 root NOFD /proc/27/fd (opendir: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-04-26T12:33:18.951 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/3 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/3 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/3 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/3 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:migration 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:migration 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:migration 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:migration 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 33 root cwd unknown /proc/33/cwd (readlink: Permission denied) 2024-04-26T12:33:18.952 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 33 root rtd unknown /proc/33/root (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 33 root txt unknown /proc/33/exe (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 33 root NOFD /proc/33/fd (opendir: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/4 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/4 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/4 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/4 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-04-26T12:33:18.953 INFO:tasks.workunit.client.0.smithi038.stdout:migration 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-04-26T12:33:18.954 INFO:tasks.workunit.client.0.smithi038.stdout:migration 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-04-26T12:33:18.954 INFO:tasks.workunit.client.0.smithi038.stdout:migration 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-04-26T12:33:18.954 INFO:tasks.workunit.client.0.smithi038.stdout:migration 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-04-26T12:33:18.954 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2024-04-26T12:33:18.954 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2024-04-26T12:33:18.955 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2024-04-26T12:33:18.955 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 39 root NOFD /proc/39/fd (opendir: Permission denied) 2024-04-26T12:33:18.955 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-04-26T12:33:18.956 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-04-26T12:33:18.956 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-04-26T12:33:18.956 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-04-26T12:33:18.956 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/5 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-04-26T12:33:18.956 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/5 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-04-26T12:33:18.956 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/5 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-04-26T12:33:18.957 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/5 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-04-26T12:33:18.957 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-04-26T12:33:18.957 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-04-26T12:33:18.957 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-04-26T12:33:18.957 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-04-26T12:33:18.957 INFO:tasks.workunit.client.0.smithi038.stdout:migration 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-04-26T12:33:18.957 INFO:tasks.workunit.client.0.smithi038.stdout:migration 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-04-26T12:33:18.957 INFO:tasks.workunit.client.0.smithi038.stdout:migration 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-04-26T12:33:18.958 INFO:tasks.workunit.client.0.smithi038.stdout:migration 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-04-26T12:33:18.958 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 45 root cwd unknown /proc/45/cwd (readlink: Permission denied) 2024-04-26T12:33:18.958 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 45 root rtd unknown /proc/45/root (readlink: Permission denied) 2024-04-26T12:33:18.958 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 45 root txt unknown /proc/45/exe (readlink: Permission denied) 2024-04-26T12:33:18.958 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 45 root NOFD /proc/45/fd (opendir: Permission denied) 2024-04-26T12:33:18.958 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-04-26T12:33:18.958 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-04-26T12:33:18.959 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-04-26T12:33:18.959 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-04-26T12:33:18.959 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/6 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-04-26T12:33:18.959 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/6 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-04-26T12:33:18.959 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/6 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-04-26T12:33:18.960 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/6 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-04-26T12:33:18.960 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-04-26T12:33:18.960 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-04-26T12:33:18.960 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-04-26T12:33:18.960 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-04-26T12:33:18.960 INFO:tasks.workunit.client.0.smithi038.stdout:migration 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-04-26T12:33:18.961 INFO:tasks.workunit.client.0.smithi038.stdout:migration 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-04-26T12:33:18.961 INFO:tasks.workunit.client.0.smithi038.stdout:migration 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-04-26T12:33:18.961 INFO:tasks.workunit.client.0.smithi038.stdout:migration 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-04-26T12:33:18.961 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 51 root cwd unknown /proc/51/cwd (readlink: Permission denied) 2024-04-26T12:33:18.961 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 51 root rtd unknown /proc/51/root (readlink: Permission denied) 2024-04-26T12:33:18.961 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 51 root txt unknown /proc/51/exe (readlink: Permission denied) 2024-04-26T12:33:18.962 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 51 root NOFD /proc/51/fd (opendir: Permission denied) 2024-04-26T12:33:18.962 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-04-26T12:33:18.962 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-04-26T12:33:18.962 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-04-26T12:33:18.962 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-04-26T12:33:18.962 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/7 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-04-26T12:33:18.963 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/7 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-04-26T12:33:18.963 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/7 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-04-26T12:33:18.963 INFO:tasks.workunit.client.0.smithi038.stdout:cpuhp/7 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-04-26T12:33:18.963 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-04-26T12:33:18.963 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-04-26T12:33:18.963 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-04-26T12:33:18.964 INFO:tasks.workunit.client.0.smithi038.stdout:watchdog/ 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-04-26T12:33:18.964 INFO:tasks.workunit.client.0.smithi038.stdout:migration 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-04-26T12:33:18.964 INFO:tasks.workunit.client.0.smithi038.stdout:migration 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-04-26T12:33:18.964 INFO:tasks.workunit.client.0.smithi038.stdout:migration 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-04-26T12:33:18.964 INFO:tasks.workunit.client.0.smithi038.stdout:migration 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-04-26T12:33:18.964 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 57 root cwd unknown /proc/57/cwd (readlink: Permission denied) 2024-04-26T12:33:18.964 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 57 root rtd unknown /proc/57/root (readlink: Permission denied) 2024-04-26T12:33:18.965 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 57 root txt unknown /proc/57/exe (readlink: Permission denied) 2024-04-26T12:33:18.965 INFO:tasks.workunit.client.0.smithi038.stdout:ksoftirqd 57 root NOFD /proc/57/fd (opendir: Permission denied) 2024-04-26T12:33:18.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-04-26T12:33:18.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-04-26T12:33:18.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-04-26T12:33:18.965 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-04-26T12:33:18.966 INFO:tasks.workunit.client.0.smithi038.stdout:kdevtmpfs 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2024-04-26T12:33:18.966 INFO:tasks.workunit.client.0.smithi038.stdout:kdevtmpfs 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2024-04-26T12:33:18.966 INFO:tasks.workunit.client.0.smithi038.stdout:kdevtmpfs 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2024-04-26T12:33:18.966 INFO:tasks.workunit.client.0.smithi038.stdout:kdevtmpfs 68 root NOFD /proc/68/fd (opendir: Permission denied) 2024-04-26T12:33:18.966 INFO:tasks.workunit.client.0.smithi038.stdout:netns 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2024-04-26T12:33:18.967 INFO:tasks.workunit.client.0.smithi038.stdout:netns 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2024-04-26T12:33:18.967 INFO:tasks.workunit.client.0.smithi038.stdout:netns 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2024-04-26T12:33:18.967 INFO:tasks.workunit.client.0.smithi038.stdout:netns 69 root NOFD /proc/69/fd (opendir: Permission denied) 2024-04-26T12:33:18.968 INFO:tasks.workunit.client.0.smithi038.stdout:kauditd 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-04-26T12:33:18.968 INFO:tasks.workunit.client.0.smithi038.stdout:kauditd 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-04-26T12:33:18.968 INFO:tasks.workunit.client.0.smithi038.stdout:kauditd 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-04-26T12:33:18.968 INFO:tasks.workunit.client.0.smithi038.stdout:kauditd 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-04-26T12:33:18.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-04-26T12:33:18.968 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-04-26T12:33:18.969 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-04-26T12:33:18.969 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-04-26T12:33:18.969 INFO:tasks.workunit.client.0.smithi038.stdout:khungtask 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-04-26T12:33:18.969 INFO:tasks.workunit.client.0.smithi038.stdout:khungtask 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-04-26T12:33:18.969 INFO:tasks.workunit.client.0.smithi038.stdout:khungtask 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-04-26T12:33:18.970 INFO:tasks.workunit.client.0.smithi038.stdout:khungtask 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-04-26T12:33:18.970 INFO:tasks.workunit.client.0.smithi038.stdout:oom_reape 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-04-26T12:33:18.970 INFO:tasks.workunit.client.0.smithi038.stdout:oom_reape 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-04-26T12:33:18.970 INFO:tasks.workunit.client.0.smithi038.stdout:oom_reape 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-04-26T12:33:18.970 INFO:tasks.workunit.client.0.smithi038.stdout:oom_reape 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-04-26T12:33:18.970 INFO:tasks.workunit.client.0.smithi038.stdout:writeback 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2024-04-26T12:33:18.971 INFO:tasks.workunit.client.0.smithi038.stdout:writeback 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2024-04-26T12:33:18.971 INFO:tasks.workunit.client.0.smithi038.stdout:writeback 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2024-04-26T12:33:18.971 INFO:tasks.workunit.client.0.smithi038.stdout:writeback 75 root NOFD /proc/75/fd (opendir: Permission denied) 2024-04-26T12:33:18.971 INFO:tasks.workunit.client.0.smithi038.stdout:kcompactd 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-04-26T12:33:18.971 INFO:tasks.workunit.client.0.smithi038.stdout:kcompactd 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-04-26T12:33:18.972 INFO:tasks.workunit.client.0.smithi038.stdout:kcompactd 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-04-26T12:33:18.972 INFO:tasks.workunit.client.0.smithi038.stdout:kcompactd 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-04-26T12:33:18.972 INFO:tasks.workunit.client.0.smithi038.stdout:ksmd 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-04-26T12:33:18.972 INFO:tasks.workunit.client.0.smithi038.stdout:ksmd 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-04-26T12:33:18.972 INFO:tasks.workunit.client.0.smithi038.stdout:ksmd 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-04-26T12:33:18.972 INFO:tasks.workunit.client.0.smithi038.stdout:ksmd 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-04-26T12:33:18.973 INFO:tasks.workunit.client.0.smithi038.stdout:khugepage 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-04-26T12:33:18.973 INFO:tasks.workunit.client.0.smithi038.stdout:khugepage 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-04-26T12:33:18.973 INFO:tasks.workunit.client.0.smithi038.stdout:khugepage 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-04-26T12:33:18.973 INFO:tasks.workunit.client.0.smithi038.stdout:khugepage 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-04-26T12:33:18.973 INFO:tasks.workunit.client.0.smithi038.stdout:crypto 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-04-26T12:33:18.973 INFO:tasks.workunit.client.0.smithi038.stdout:crypto 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-04-26T12:33:18.974 INFO:tasks.workunit.client.0.smithi038.stdout:crypto 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-04-26T12:33:18.974 INFO:tasks.workunit.client.0.smithi038.stdout:crypto 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-04-26T12:33:18.974 INFO:tasks.workunit.client.0.smithi038.stdout:kintegrit 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-04-26T12:33:18.974 INFO:tasks.workunit.client.0.smithi038.stdout:kintegrit 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-04-26T12:33:18.974 INFO:tasks.workunit.client.0.smithi038.stdout:kintegrit 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-04-26T12:33:18.974 INFO:tasks.workunit.client.0.smithi038.stdout:kintegrit 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-04-26T12:33:18.975 INFO:tasks.workunit.client.0.smithi038.stdout:kblockd 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-04-26T12:33:18.975 INFO:tasks.workunit.client.0.smithi038.stdout:kblockd 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-04-26T12:33:18.975 INFO:tasks.workunit.client.0.smithi038.stdout:kblockd 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-04-26T12:33:18.975 INFO:tasks.workunit.client.0.smithi038.stdout:kblockd 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-04-26T12:33:18.975 INFO:tasks.workunit.client.0.smithi038.stdout:blkcg_pun 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-04-26T12:33:18.976 INFO:tasks.workunit.client.0.smithi038.stdout:blkcg_pun 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-04-26T12:33:18.976 INFO:tasks.workunit.client.0.smithi038.stdout:blkcg_pun 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-04-26T12:33:18.976 INFO:tasks.workunit.client.0.smithi038.stdout:blkcg_pun 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-04-26T12:33:18.976 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-04-26T12:33:18.977 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-04-26T12:33:18.977 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-04-26T12:33:18.977 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-04-26T12:33:18.977 INFO:tasks.workunit.client.0.smithi038.stdout:tpm_dev_w 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-04-26T12:33:18.978 INFO:tasks.workunit.client.0.smithi038.stdout:tpm_dev_w 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-04-26T12:33:18.978 INFO:tasks.workunit.client.0.smithi038.stdout:tpm_dev_w 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-04-26T12:33:18.978 INFO:tasks.workunit.client.0.smithi038.stdout:tpm_dev_w 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-04-26T12:33:18.978 INFO:tasks.workunit.client.0.smithi038.stdout:md 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-04-26T12:33:18.978 INFO:tasks.workunit.client.0.smithi038.stdout:md 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-04-26T12:33:18.979 INFO:tasks.workunit.client.0.smithi038.stdout:md 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-04-26T12:33:18.979 INFO:tasks.workunit.client.0.smithi038.stdout:md 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-04-26T12:33:18.979 INFO:tasks.workunit.client.0.smithi038.stdout:edac-poll 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-04-26T12:33:18.979 INFO:tasks.workunit.client.0.smithi038.stdout:edac-poll 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-04-26T12:33:18.979 INFO:tasks.workunit.client.0.smithi038.stdout:edac-poll 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-04-26T12:33:18.979 INFO:tasks.workunit.client.0.smithi038.stdout:edac-poll 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-04-26T12:33:18.979 INFO:tasks.workunit.client.0.smithi038.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-04-26T12:33:18.979 INFO:tasks.workunit.client.0.smithi038.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-04-26T12:33:18.980 INFO:tasks.workunit.client.0.smithi038.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-04-26T12:33:18.980 INFO:tasks.workunit.client.0.smithi038.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-04-26T12:33:18.980 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 92 root cwd unknown /proc/92/cwd (readlink: Permission denied) 2024-04-26T12:33:18.980 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 92 root rtd unknown /proc/92/root (readlink: Permission denied) 2024-04-26T12:33:18.980 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 92 root txt unknown /proc/92/exe (readlink: Permission denied) 2024-04-26T12:33:18.980 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 92 root NOFD /proc/92/fd (opendir: Permission denied) 2024-04-26T12:33:18.980 INFO:tasks.workunit.client.0.smithi038.stdout:kswapd0 109 root cwd unknown /proc/109/cwd (readlink: Permission denied) 2024-04-26T12:33:18.980 INFO:tasks.workunit.client.0.smithi038.stdout:kswapd0 109 root rtd unknown /proc/109/root (readlink: Permission denied) 2024-04-26T12:33:18.981 INFO:tasks.workunit.client.0.smithi038.stdout:kswapd0 109 root txt unknown /proc/109/exe (readlink: Permission denied) 2024-04-26T12:33:18.981 INFO:tasks.workunit.client.0.smithi038.stdout:kswapd0 109 root NOFD /proc/109/fd (opendir: Permission denied) 2024-04-26T12:33:18.981 INFO:tasks.workunit.client.0.smithi038.stdout:kthrotld 170 root cwd unknown /proc/170/cwd (readlink: Permission denied) 2024-04-26T12:33:18.981 INFO:tasks.workunit.client.0.smithi038.stdout:kthrotld 170 root rtd unknown /proc/170/root (readlink: Permission denied) 2024-04-26T12:33:18.981 INFO:tasks.workunit.client.0.smithi038.stdout:kthrotld 170 root txt unknown /proc/170/exe (readlink: Permission denied) 2024-04-26T12:33:18.981 INFO:tasks.workunit.client.0.smithi038.stdout:kthrotld 170 root NOFD /proc/170/fd (opendir: Permission denied) 2024-04-26T12:33:18.981 INFO:tasks.workunit.client.0.smithi038.stdout:acpi_ther 171 root cwd unknown /proc/171/cwd (readlink: Permission denied) 2024-04-26T12:33:18.981 INFO:tasks.workunit.client.0.smithi038.stdout:acpi_ther 171 root rtd unknown /proc/171/root (readlink: Permission denied) 2024-04-26T12:33:18.981 INFO:tasks.workunit.client.0.smithi038.stdout:acpi_ther 171 root txt unknown /proc/171/exe (readlink: Permission denied) 2024-04-26T12:33:18.982 INFO:tasks.workunit.client.0.smithi038.stdout:acpi_ther 171 root NOFD /proc/171/fd (opendir: Permission denied) 2024-04-26T12:33:18.982 INFO:tasks.workunit.client.0.smithi038.stdout:kmpath_rd 173 root cwd unknown /proc/173/cwd (readlink: Permission denied) 2024-04-26T12:33:18.982 INFO:tasks.workunit.client.0.smithi038.stdout:kmpath_rd 173 root rtd unknown /proc/173/root (readlink: Permission denied) 2024-04-26T12:33:18.982 INFO:tasks.workunit.client.0.smithi038.stdout:kmpath_rd 173 root txt unknown /proc/173/exe (readlink: Permission denied) 2024-04-26T12:33:18.982 INFO:tasks.workunit.client.0.smithi038.stdout:kmpath_rd 173 root NOFD /proc/173/fd (opendir: Permission denied) 2024-04-26T12:33:18.982 INFO:tasks.workunit.client.0.smithi038.stdout:kaluad 174 root cwd unknown /proc/174/cwd (readlink: Permission denied) 2024-04-26T12:33:18.982 INFO:tasks.workunit.client.0.smithi038.stdout:kaluad 174 root rtd unknown /proc/174/root (readlink: Permission denied) 2024-04-26T12:33:18.982 INFO:tasks.workunit.client.0.smithi038.stdout:kaluad 174 root txt unknown /proc/174/exe (readlink: Permission denied) 2024-04-26T12:33:18.983 INFO:tasks.workunit.client.0.smithi038.stdout:kaluad 174 root NOFD /proc/174/fd (opendir: Permission denied) 2024-04-26T12:33:18.983 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 176 root cwd unknown /proc/176/cwd (readlink: Permission denied) 2024-04-26T12:33:18.983 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 176 root rtd unknown /proc/176/root (readlink: Permission denied) 2024-04-26T12:33:18.984 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 176 root txt unknown /proc/176/exe (readlink: Permission denied) 2024-04-26T12:33:18.984 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 176 root NOFD /proc/176/fd (opendir: Permission denied) 2024-04-26T12:33:18.984 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 177 root cwd unknown /proc/177/cwd (readlink: Permission denied) 2024-04-26T12:33:18.984 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 177 root rtd unknown /proc/177/root (readlink: Permission denied) 2024-04-26T12:33:18.984 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 177 root txt unknown /proc/177/exe (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 177 root NOFD /proc/177/fd (opendir: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:ipv6_addr 178 root cwd unknown /proc/178/cwd (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:ipv6_addr 178 root rtd unknown /proc/178/root (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:ipv6_addr 178 root txt unknown /proc/178/exe (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:ipv6_addr 178 root NOFD /proc/178/fd (opendir: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:kstrp 179 root cwd unknown /proc/179/cwd (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:kstrp 179 root rtd unknown /proc/179/root (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:kstrp 179 root txt unknown /proc/179/exe (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:kstrp 179 root NOFD /proc/179/fd (opendir: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:zswap-shr 218 root cwd unknown /proc/218/cwd (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:zswap-shr 218 root rtd unknown /proc/218/root (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:zswap-shr 218 root txt unknown /proc/218/exe (readlink: Permission denied) 2024-04-26T12:33:18.985 INFO:tasks.workunit.client.0.smithi038.stdout:zswap-shr 218 root NOFD /proc/218/fd (opendir: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 232 root cwd unknown /proc/232/cwd (readlink: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 232 root rtd unknown /proc/232/root (readlink: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 232 root txt unknown /proc/232/exe (readlink: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 232 root NOFD /proc/232/fd (opendir: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 238 root cwd unknown /proc/238/cwd (readlink: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 238 root rtd unknown /proc/238/root (readlink: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 238 root txt unknown /proc/238/exe (readlink: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 238 root NOFD /proc/238/fd (opendir: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 266 root cwd unknown /proc/266/cwd (readlink: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 266 root rtd unknown /proc/266/root (readlink: Permission denied) 2024-04-26T12:33:18.986 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 266 root txt unknown /proc/266/exe (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 266 root NOFD /proc/266/fd (opendir: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 286 root cwd unknown /proc/286/cwd (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 286 root rtd unknown /proc/286/root (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 286 root txt unknown /proc/286/exe (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 286 root NOFD /proc/286/fd (opendir: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 288 root cwd unknown /proc/288/cwd (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 288 root rtd unknown /proc/288/root (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 288 root txt unknown /proc/288/exe (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 288 root NOFD /proc/288/fd (opendir: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 293 root cwd unknown /proc/293/cwd (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 293 root rtd unknown /proc/293/root (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 293 root txt unknown /proc/293/exe (readlink: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/5 293 root NOFD /proc/293/fd (opendir: Permission denied) 2024-04-26T12:33:18.987 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 364 root cwd unknown /proc/364/cwd (readlink: Permission denied) 2024-04-26T12:33:18.988 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 364 root rtd unknown /proc/364/root (readlink: Permission denied) 2024-04-26T12:33:18.988 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 364 root txt unknown /proc/364/exe (readlink: Permission denied) 2024-04-26T12:33:18.988 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 364 root NOFD /proc/364/fd (opendir: Permission denied) 2024-04-26T12:33:18.988 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 379 root cwd unknown /proc/379/cwd (readlink: Permission denied) 2024-04-26T12:33:18.988 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 379 root rtd unknown /proc/379/root (readlink: Permission denied) 2024-04-26T12:33:18.988 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 379 root txt unknown /proc/379/exe (readlink: Permission denied) 2024-04-26T12:33:18.988 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 379 root NOFD /proc/379/fd (opendir: Permission denied) 2024-04-26T12:33:18.988 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 424 root cwd unknown /proc/424/cwd (readlink: Permission denied) 2024-04-26T12:33:18.988 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 424 root rtd unknown /proc/424/root (readlink: Permission denied) 2024-04-26T12:33:18.989 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 424 root txt unknown /proc/424/exe (readlink: Permission denied) 2024-04-26T12:33:18.989 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 424 root NOFD /proc/424/fd (opendir: Permission denied) 2024-04-26T12:33:18.989 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-wq 425 root cwd unknown /proc/425/cwd (readlink: Permission denied) 2024-04-26T12:33:18.989 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-wq 425 root rtd unknown /proc/425/root (readlink: Permission denied) 2024-04-26T12:33:18.989 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-wq 425 root txt unknown /proc/425/exe (readlink: Permission denied) 2024-04-26T12:33:18.989 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-wq 425 root NOFD /proc/425/fd (opendir: Permission denied) 2024-04-26T12:33:18.989 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-rese 426 root cwd unknown /proc/426/cwd (readlink: Permission denied) 2024-04-26T12:33:18.989 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-rese 426 root rtd unknown /proc/426/root (readlink: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-rese 426 root txt unknown /proc/426/exe (readlink: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-rese 426 root NOFD /proc/426/fd (opendir: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-dele 427 root cwd unknown /proc/427/cwd (readlink: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-dele 427 root rtd unknown /proc/427/root (readlink: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-dele 427 root txt unknown /proc/427/exe (readlink: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:nvme-dele 427 root NOFD /proc/427/fd (opendir: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:ata_sff 431 root cwd unknown /proc/431/cwd (readlink: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:ata_sff 431 root rtd unknown /proc/431/root (readlink: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:ata_sff 431 root txt unknown /proc/431/exe (readlink: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:ata_sff 431 root NOFD /proc/431/fd (opendir: Permission denied) 2024-04-26T12:33:18.990 INFO:tasks.workunit.client.0.smithi038.stdout:ixgbe 436 root cwd unknown /proc/436/cwd (readlink: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:ixgbe 436 root rtd unknown /proc/436/root (readlink: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:ixgbe 436 root txt unknown /proc/436/exe (readlink: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:ixgbe 436 root NOFD /proc/436/fd (opendir: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_0 440 root cwd unknown /proc/440/cwd (readlink: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_0 440 root rtd unknown /proc/440/root (readlink: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_0 440 root txt unknown /proc/440/exe (readlink: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_0 440 root NOFD /proc/440/fd (opendir: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 441 root cwd unknown /proc/441/cwd (readlink: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 441 root rtd unknown /proc/441/root (readlink: Permission denied) 2024-04-26T12:33:18.991 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 441 root txt unknown /proc/441/exe (readlink: Permission denied) 2024-04-26T12:33:18.992 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 441 root NOFD /proc/441/fd (opendir: Permission denied) 2024-04-26T12:33:18.992 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_1 442 root cwd unknown /proc/442/cwd (readlink: Permission denied) 2024-04-26T12:33:18.992 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_1 442 root rtd unknown /proc/442/root (readlink: Permission denied) 2024-04-26T12:33:18.992 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_1 442 root txt unknown /proc/442/exe (readlink: Permission denied) 2024-04-26T12:33:18.992 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_1 442 root NOFD /proc/442/fd (opendir: Permission denied) 2024-04-26T12:33:18.992 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 443 root cwd unknown /proc/443/cwd (readlink: Permission denied) 2024-04-26T12:33:18.992 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 443 root rtd unknown /proc/443/root (readlink: Permission denied) 2024-04-26T12:33:18.992 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 443 root txt unknown /proc/443/exe (readlink: Permission denied) 2024-04-26T12:33:18.992 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 443 root NOFD /proc/443/fd (opendir: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_2 444 root cwd unknown /proc/444/cwd (readlink: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_2 444 root rtd unknown /proc/444/root (readlink: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_2 444 root txt unknown /proc/444/exe (readlink: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_2 444 root NOFD /proc/444/fd (opendir: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 445 root cwd unknown /proc/445/cwd (readlink: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 445 root rtd unknown /proc/445/root (readlink: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 445 root txt unknown /proc/445/exe (readlink: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 445 root NOFD /proc/445/fd (opendir: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_3 446 root cwd unknown /proc/446/cwd (readlink: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_3 446 root rtd unknown /proc/446/root (readlink: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_3 446 root txt unknown /proc/446/exe (readlink: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_3 446 root NOFD /proc/446/fd (opendir: Permission denied) 2024-04-26T12:33:18.993 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 447 root cwd unknown /proc/447/cwd (readlink: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 447 root rtd unknown /proc/447/root (readlink: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 447 root txt unknown /proc/447/exe (readlink: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 447 root NOFD /proc/447/fd (opendir: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_4 448 root cwd unknown /proc/448/cwd (readlink: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_4 448 root rtd unknown /proc/448/root (readlink: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_4 448 root txt unknown /proc/448/exe (readlink: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_4 448 root NOFD /proc/448/fd (opendir: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-04-26T12:33:18.994 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_5 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_5 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_5 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_5 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_6 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_6 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_6 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_6 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-04-26T12:33:18.995 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_7 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_7 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_7 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_7 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_8 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_8 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_8 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-04-26T12:33:18.996 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_8 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_9 458 root cwd unknown /proc/458/cwd (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_9 458 root rtd unknown /proc/458/root (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_9 458 root txt unknown /proc/458/exe (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_eh_9 458 root NOFD /proc/458/fd (opendir: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:scsi_tmf_ 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-04-26T12:33:18.997 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 490 root cwd unknown /proc/490/cwd (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 490 root rtd unknown /proc/490/root (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 490 root txt unknown /proc/490/exe (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 490 root NOFD /proc/490/fd (opendir: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:jbd2/sda1 492 root cwd unknown /proc/492/cwd (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:jbd2/sda1 492 root rtd unknown /proc/492/root (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:jbd2/sda1 492 root txt unknown /proc/492/exe (readlink: Permission denied) 2024-04-26T12:33:18.998 INFO:tasks.workunit.client.0.smithi038.stdout:jbd2/sda1 492 root NOFD /proc/492/fd (opendir: Permission denied) 2024-04-26T12:33:18.999 INFO:tasks.workunit.client.0.smithi038.stdout:ext4-rsv- 493 root cwd unknown /proc/493/cwd (readlink: Permission denied) 2024-04-26T12:33:18.999 INFO:tasks.workunit.client.0.smithi038.stdout:ext4-rsv- 493 root rtd unknown /proc/493/root (readlink: Permission denied) 2024-04-26T12:33:18.999 INFO:tasks.workunit.client.0.smithi038.stdout:ext4-rsv- 493 root txt unknown /proc/493/exe (readlink: Permission denied) 2024-04-26T12:33:18.999 INFO:tasks.workunit.client.0.smithi038.stdout:ext4-rsv- 493 root NOFD /proc/493/fd (opendir: Permission denied) 2024-04-26T12:33:18.999 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 548 root cwd unknown /proc/548/cwd (readlink: Permission denied) 2024-04-26T12:33:18.999 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 548 root rtd unknown /proc/548/root (readlink: Permission denied) 2024-04-26T12:33:18.999 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 548 root txt unknown /proc/548/exe (readlink: Permission denied) 2024-04-26T12:33:18.999 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 548 root NOFD /proc/548/fd (opendir: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-j 595 root cwd unknown /proc/595/cwd (readlink: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-j 595 root rtd unknown /proc/595/root (readlink: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-j 595 root txt unknown /proc/595/exe (readlink: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-j 595 root NOFD /proc/595/fd (opendir: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:ext4lazyi 599 root cwd unknown /proc/599/cwd (readlink: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:ext4lazyi 599 root rtd unknown /proc/599/root (readlink: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:ext4lazyi 599 root txt unknown /proc/599/exe (readlink: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:ext4lazyi 599 root NOFD /proc/599/fd (opendir: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-u 662 root cwd unknown /proc/662/cwd (readlink: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-u 662 root rtd unknown /proc/662/root (readlink: Permission denied) 2024-04-26T12:33:19.000 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-u 662 root txt unknown /proc/662/exe (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-u 662 root NOFD /proc/662/fd (opendir: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:rpcbind 667 rpc cwd unknown /proc/667/cwd (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:rpcbind 667 rpc rtd unknown /proc/667/root (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:rpcbind 667 rpc txt unknown /proc/667/exe (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:rpcbind 667 rpc NOFD /proc/667/fd (opendir: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 root cwd unknown /proc/668/cwd (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 root rtd unknown /proc/668/root (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 root txt unknown /proc/668/exe (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 root NOFD /proc/668/fd (opendir: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 669 auditd root cwd unknown /proc/668/task/669/cwd (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 669 auditd root rtd unknown /proc/668/task/669/root (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 669 auditd root txt unknown /proc/668/task/669/exe (readlink: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 669 auditd root NOFD /proc/668/task/669/fd (opendir: Permission denied) 2024-04-26T12:33:19.001 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 671 auditd root cwd unknown /proc/668/task/671/cwd (readlink: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 671 auditd root rtd unknown /proc/668/task/671/root (readlink: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 671 auditd root txt unknown /proc/668/task/671/exe (readlink: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:auditd 668 671 auditd root NOFD /proc/668/task/671/fd (opendir: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:sedispatc 670 root cwd unknown /proc/670/cwd (readlink: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:sedispatc 670 root rtd unknown /proc/670/root (readlink: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:sedispatc 670 root txt unknown /proc/670/exe (readlink: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:sedispatc 670 root NOFD /proc/670/fd (opendir: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:rpciod 674 root cwd unknown /proc/674/cwd (readlink: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:rpciod 674 root rtd unknown /proc/674/root (readlink: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:rpciod 674 root txt unknown /proc/674/exe (readlink: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:rpciod 674 root NOFD /proc/674/fd (opendir: Permission denied) 2024-04-26T12:33:19.002 INFO:tasks.workunit.client.0.smithi038.stdout:xprtiod 675 root cwd unknown /proc/675/cwd (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:xprtiod 675 root rtd unknown /proc/675/root (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:xprtiod 675 root txt unknown /proc/675/exe (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:xprtiod 675 root NOFD /proc/675/fd (opendir: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 719 root cwd unknown /proc/719/cwd (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 719 root rtd unknown /proc/719/root (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 719 root txt unknown /proc/719/exe (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 719 root NOFD /proc/719/fd (opendir: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:ipmi-msgh 720 root cwd unknown /proc/720/cwd (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:ipmi-msgh 720 root rtd unknown /proc/720/root (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:ipmi-msgh 720 root txt unknown /proc/720/exe (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:ipmi-msgh 720 root NOFD /proc/720/fd (opendir: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:kipmi0 731 root cwd unknown /proc/731/cwd (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:kipmi0 731 root rtd unknown /proc/731/root (readlink: Permission denied) 2024-04-26T12:33:19.003 INFO:tasks.workunit.client.0.smithi038.stdout:kipmi0 731 root txt unknown /proc/731/exe (readlink: Permission denied) 2024-04-26T12:33:19.004 INFO:tasks.workunit.client.0.smithi038.stdout:kipmi0 731 root NOFD /proc/731/fd (opendir: Permission denied) 2024-04-26T12:33:19.004 INFO:tasks.workunit.client.0.smithi038.stdout:avahi-dae 811 avahi cwd unknown /proc/811/cwd (readlink: Permission denied) 2024-04-26T12:33:19.004 INFO:tasks.workunit.client.0.smithi038.stdout:avahi-dae 811 avahi rtd unknown /proc/811/root (readlink: Permission denied) 2024-04-26T12:33:19.004 INFO:tasks.workunit.client.0.smithi038.stdout:avahi-dae 811 avahi txt unknown /proc/811/exe (readlink: Permission denied) 2024-04-26T12:33:19.004 INFO:tasks.workunit.client.0.smithi038.stdout:avahi-dae 811 avahi NOFD /proc/811/fd (opendir: Permission denied) 2024-04-26T12:33:19.004 INFO:tasks.workunit.client.0.smithi038.stdout:sssd 812 root cwd unknown /proc/812/cwd (readlink: Permission denied) 2024-04-26T12:33:19.004 INFO:tasks.workunit.client.0.smithi038.stdout:sssd 812 root rtd unknown /proc/812/root (readlink: Permission denied) 2024-04-26T12:33:19.004 INFO:tasks.workunit.client.0.smithi038.stdout:sssd 812 root txt unknown /proc/812/exe (readlink: Permission denied) 2024-04-26T12:33:19.004 INFO:tasks.workunit.client.0.smithi038.stdout:sssd 812 root NOFD /proc/812/fd (opendir: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 813 root cwd unknown /proc/813/cwd (readlink: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 813 root rtd unknown /proc/813/root (readlink: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 813 root txt unknown /proc/813/exe (readlink: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 813 root NOFD /proc/813/fd (opendir: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 813 828 gmain root cwd unknown /proc/813/task/828/cwd (readlink: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 813 828 gmain root rtd unknown /proc/813/task/828/root (readlink: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 813 828 gmain root txt unknown /proc/813/task/828/exe (readlink: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:irqbalanc 813 828 gmain root NOFD /proc/813/task/828/fd (opendir: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-daem 814 dbus cwd unknown /proc/814/cwd (readlink: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-daem 814 dbus rtd unknown /proc/814/root (readlink: Permission denied) 2024-04-26T12:33:19.005 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-daem 814 dbus txt unknown /proc/814/exe (readlink: Permission denied) 2024-04-26T12:33:19.006 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-daem 814 dbus NOFD /proc/814/fd (opendir: Permission denied) 2024-04-26T12:33:19.006 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-daem 814 867 dbus-daem dbus cwd unknown /proc/814/task/867/cwd (readlink: Permission denied) 2024-04-26T12:33:19.006 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-daem 814 867 dbus-daem dbus rtd unknown /proc/814/task/867/root (readlink: Permission denied) 2024-04-26T12:33:19.006 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-daem 814 867 dbus-daem dbus txt unknown /proc/814/task/867/exe (readlink: Permission denied) 2024-04-26T12:33:19.006 INFO:tasks.workunit.client.0.smithi038.stdout:dbus-daem 814 867 dbus-daem dbus NOFD /proc/814/task/867/fd (opendir: Permission denied) 2024-04-26T12:33:19.006 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 root cwd unknown /proc/816/cwd (readlink: Permission denied) 2024-04-26T12:33:19.006 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 root rtd unknown /proc/816/root (readlink: Permission denied) 2024-04-26T12:33:19.006 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 root txt unknown /proc/816/exe (readlink: Permission denied) 2024-04-26T12:33:19.006 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 root NOFD /proc/816/fd (opendir: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 866 gmain root cwd unknown /proc/816/task/866/cwd (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 866 gmain root rtd unknown /proc/816/task/866/root (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 866 gmain root txt unknown /proc/816/task/866/exe (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 866 gmain root NOFD /proc/816/task/866/fd (opendir: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 868 gdbus root cwd unknown /proc/816/task/868/cwd (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 868 gdbus root rtd unknown /proc/816/task/868/root (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 868 gdbus root txt unknown /proc/816/task/868/exe (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:NetworkMa 816 868 gdbus root NOFD /proc/816/task/868/fd (opendir: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 polkitd cwd unknown /proc/819/cwd (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 polkitd rtd unknown /proc/819/root (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 polkitd txt unknown /proc/819/exe (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 polkitd NOFD /proc/819/fd (opendir: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 892 gmain polkitd cwd unknown /proc/819/task/892/cwd (readlink: Permission denied) 2024-04-26T12:33:19.007 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 892 gmain polkitd rtd unknown /proc/819/task/892/root (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 892 gmain polkitd txt unknown /proc/819/task/892/exe (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 892 gmain polkitd NOFD /proc/819/task/892/fd (opendir: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 893 gdbus polkitd cwd unknown /proc/819/task/893/cwd (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 893 gdbus polkitd rtd unknown /proc/819/task/893/root (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 893 gdbus polkitd txt unknown /proc/819/task/893/exe (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 893 gdbus polkitd NOFD /proc/819/task/893/fd (opendir: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 894 JS\x20Hel polkitd cwd unknown /proc/819/task/894/cwd (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 894 JS\x20Hel polkitd rtd unknown /proc/819/task/894/root (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 894 JS\x20Hel polkitd txt unknown /proc/819/task/894/exe (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 894 JS\x20Hel polkitd NOFD /proc/819/task/894/fd (opendir: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 895 JS\x20Hel polkitd cwd unknown /proc/819/task/895/cwd (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 895 JS\x20Hel polkitd rtd unknown /proc/819/task/895/root (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 895 JS\x20Hel polkitd txt unknown /proc/819/task/895/exe (readlink: Permission denied) 2024-04-26T12:33:19.008 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 895 JS\x20Hel polkitd NOFD /proc/819/task/895/fd (opendir: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 896 JS\x20Hel polkitd cwd unknown /proc/819/task/896/cwd (readlink: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 896 JS\x20Hel polkitd rtd unknown /proc/819/task/896/root (readlink: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 896 JS\x20Hel polkitd txt unknown /proc/819/task/896/exe (readlink: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 896 JS\x20Hel polkitd NOFD /proc/819/task/896/fd (opendir: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 897 JS\x20Hel polkitd cwd unknown /proc/819/task/897/cwd (readlink: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 897 JS\x20Hel polkitd rtd unknown /proc/819/task/897/root (readlink: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 897 JS\x20Hel polkitd txt unknown /proc/819/task/897/exe (readlink: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 897 JS\x20Hel polkitd NOFD /proc/819/task/897/fd (opendir: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 898 JS\x20Hel polkitd cwd unknown /proc/819/task/898/cwd (readlink: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 898 JS\x20Hel polkitd rtd unknown /proc/819/task/898/root (readlink: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 898 JS\x20Hel polkitd txt unknown /proc/819/task/898/exe (readlink: Permission denied) 2024-04-26T12:33:19.009 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 898 JS\x20Hel polkitd NOFD /proc/819/task/898/fd (opendir: Permission denied) 2024-04-26T12:33:19.010 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 899 JS\x20Hel polkitd cwd unknown /proc/819/task/899/cwd (readlink: Permission denied) 2024-04-26T12:33:19.010 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 899 JS\x20Hel polkitd rtd unknown /proc/819/task/899/root (readlink: Permission denied) 2024-04-26T12:33:19.010 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 899 JS\x20Hel polkitd txt unknown /proc/819/task/899/exe (readlink: Permission denied) 2024-04-26T12:33:19.010 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 899 JS\x20Hel polkitd NOFD /proc/819/task/899/fd (opendir: Permission denied) 2024-04-26T12:33:19.010 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 900 JS\x20Hel polkitd cwd unknown /proc/819/task/900/cwd (readlink: Permission denied) 2024-04-26T12:33:19.010 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 900 JS\x20Hel polkitd rtd unknown /proc/819/task/900/root (readlink: Permission denied) 2024-04-26T12:33:19.010 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 900 JS\x20Hel polkitd txt unknown /proc/819/task/900/exe (readlink: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 900 JS\x20Hel polkitd NOFD /proc/819/task/900/fd (opendir: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 901 JS\x20Hel polkitd cwd unknown /proc/819/task/901/cwd (readlink: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 901 JS\x20Hel polkitd rtd unknown /proc/819/task/901/root (readlink: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 901 JS\x20Hel polkitd txt unknown /proc/819/task/901/exe (readlink: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 901 JS\x20Hel polkitd NOFD /proc/819/task/901/fd (opendir: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 909 polkitd polkitd cwd unknown /proc/819/task/909/cwd (readlink: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 909 polkitd polkitd rtd unknown /proc/819/task/909/root (readlink: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 909 polkitd polkitd txt unknown /proc/819/task/909/exe (readlink: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:polkitd 819 909 polkitd polkitd NOFD /proc/819/task/909/fd (opendir: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:lsmd 820 libstoragemgmt cwd unknown /proc/820/cwd (readlink: Permission denied) 2024-04-26T12:33:19.011 INFO:tasks.workunit.client.0.smithi038.stdout:lsmd 820 libstoragemgmt rtd unknown /proc/820/root (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:lsmd 820 libstoragemgmt txt unknown /proc/820/exe (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:lsmd 820 libstoragemgmt NOFD /proc/820/fd (opendir: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:smartd 830 root cwd unknown /proc/830/cwd (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:smartd 830 root rtd unknown /proc/830/root (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:smartd 830 root txt unknown /proc/830/exe (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:smartd 830 root NOFD /proc/830/fd (opendir: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:mcelog 833 root cwd unknown /proc/833/cwd (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:mcelog 833 root rtd unknown /proc/833/root (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:mcelog 833 root txt unknown /proc/833/exe (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:mcelog 833 root NOFD /proc/833/fd (opendir: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:avahi-dae 871 avahi cwd unknown /proc/871/cwd (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:avahi-dae 871 avahi rtd unknown /proc/871/root (readlink: Permission denied) 2024-04-26T12:33:19.012 INFO:tasks.workunit.client.0.smithi038.stdout:avahi-dae 871 avahi txt unknown /proc/871/exe (readlink: Permission denied) 2024-04-26T12:33:19.013 INFO:tasks.workunit.client.0.smithi038.stdout:avahi-dae 871 avahi NOFD /proc/871/fd (opendir: Permission denied) 2024-04-26T12:33:19.013 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 875 root cwd unknown /proc/875/cwd (readlink: Permission denied) 2024-04-26T12:33:19.013 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 875 root rtd unknown /proc/875/root (readlink: Permission denied) 2024-04-26T12:33:19.013 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 875 root txt unknown /proc/875/exe (readlink: Permission denied) 2024-04-26T12:33:19.013 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 875 root NOFD /proc/875/fd (opendir: Permission denied) 2024-04-26T12:33:19.013 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 root cwd unknown /proc/876/cwd (readlink: Permission denied) 2024-04-26T12:33:19.013 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 root rtd unknown /proc/876/root (readlink: Permission denied) 2024-04-26T12:33:19.014 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 root txt unknown /proc/876/exe (readlink: Permission denied) 2024-04-26T12:33:19.014 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 root NOFD /proc/876/fd (opendir: Permission denied) 2024-04-26T12:33:19.014 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1108 tuned root cwd unknown /proc/876/task/1108/cwd (readlink: Permission denied) 2024-04-26T12:33:19.014 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1108 tuned root rtd unknown /proc/876/task/1108/root (readlink: Permission denied) 2024-04-26T12:33:19.014 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1108 tuned root txt unknown /proc/876/task/1108/exe (readlink: Permission denied) 2024-04-26T12:33:19.014 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1108 tuned root NOFD /proc/876/task/1108/fd (opendir: Permission denied) 2024-04-26T12:33:19.014 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1113 tuned root cwd unknown /proc/876/task/1113/cwd (readlink: Permission denied) 2024-04-26T12:33:19.014 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1113 tuned root rtd unknown /proc/876/task/1113/root (readlink: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1113 tuned root txt unknown /proc/876/task/1113/exe (readlink: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1113 tuned root NOFD /proc/876/task/1113/fd (opendir: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1130 tuned root cwd unknown /proc/876/task/1130/cwd (readlink: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1130 tuned root rtd unknown /proc/876/task/1130/root (readlink: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1130 tuned root txt unknown /proc/876/task/1130/exe (readlink: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1130 tuned root NOFD /proc/876/task/1130/fd (opendir: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1131 tuned root cwd unknown /proc/876/task/1131/cwd (readlink: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1131 tuned root rtd unknown /proc/876/task/1131/root (readlink: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1131 tuned root txt unknown /proc/876/task/1131/exe (readlink: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:tuned 876 1131 tuned root NOFD /proc/876/task/1131/fd (opendir: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:rhsmcertd 879 root cwd unknown /proc/879/cwd (readlink: Permission denied) 2024-04-26T12:33:19.015 INFO:tasks.workunit.client.0.smithi038.stdout:rhsmcertd 879 root rtd unknown /proc/879/root (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:rhsmcertd 879 root txt unknown /proc/879/exe (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:rhsmcertd 879 root NOFD /proc/879/fd (opendir: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 root cwd unknown /proc/884/cwd (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 root rtd unknown /proc/884/root (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 root txt unknown /proc/884/exe (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 root NOFD /proc/884/fd (opendir: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 886 gssproxy root cwd unknown /proc/884/task/886/cwd (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 886 gssproxy root rtd unknown /proc/884/task/886/root (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 886 gssproxy root txt unknown /proc/884/task/886/exe (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 886 gssproxy root NOFD /proc/884/task/886/fd (opendir: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 887 gssproxy root cwd unknown /proc/884/task/887/cwd (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 887 gssproxy root rtd unknown /proc/884/task/887/root (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 887 gssproxy root txt unknown /proc/884/task/887/exe (readlink: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 887 gssproxy root NOFD /proc/884/task/887/fd (opendir: Permission denied) 2024-04-26T12:33:19.016 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 888 gssproxy root cwd unknown /proc/884/task/888/cwd (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 888 gssproxy root rtd unknown /proc/884/task/888/root (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 888 gssproxy root txt unknown /proc/884/task/888/exe (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 888 gssproxy root NOFD /proc/884/task/888/fd (opendir: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 889 gssproxy root cwd unknown /proc/884/task/889/cwd (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 889 gssproxy root rtd unknown /proc/884/task/889/root (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 889 gssproxy root txt unknown /proc/884/task/889/exe (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 889 gssproxy root NOFD /proc/884/task/889/fd (opendir: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 890 gssproxy root cwd unknown /proc/884/task/890/cwd (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 890 gssproxy root rtd unknown /proc/884/task/890/root (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 890 gssproxy root txt unknown /proc/884/task/890/exe (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:gssproxy 884 890 gssproxy root NOFD /proc/884/task/890/fd (opendir: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:sssd_be 902 root cwd unknown /proc/902/cwd (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:sssd_be 902 root rtd unknown /proc/902/root (readlink: Permission denied) 2024-04-26T12:33:19.017 INFO:tasks.workunit.client.0.smithi038.stdout:sssd_be 902 root txt unknown /proc/902/exe (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:sssd_be 902 root NOFD /proc/902/fd (opendir: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:sssd_nss 910 root cwd unknown /proc/910/cwd (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:sssd_nss 910 root rtd unknown /proc/910/root (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:sssd_nss 910 root txt unknown /proc/910/exe (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:sssd_nss 910 root NOFD /proc/910/fd (opendir: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:cupsd 951 root cwd unknown /proc/951/cwd (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:cupsd 951 root rtd unknown /proc/951/root (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:cupsd 951 root txt unknown /proc/951/exe (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:cupsd 951 root NOFD /proc/951/fd (opendir: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-l 952 root cwd unknown /proc/952/cwd (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-l 952 root rtd unknown /proc/952/root (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-l 952 root txt unknown /proc/952/exe (readlink: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:systemd-l 952 root NOFD /proc/952/fd (opendir: Permission denied) 2024-04-26T12:33:19.018 INFO:tasks.workunit.client.0.smithi038.stdout:atd 954 root cwd unknown /proc/954/cwd (readlink: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:atd 954 root rtd unknown /proc/954/root (readlink: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:atd 954 root txt unknown /proc/954/exe (readlink: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:atd 954 root NOFD /proc/954/fd (opendir: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:crond 955 root cwd unknown /proc/955/cwd (readlink: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:crond 955 root rtd unknown /proc/955/root (readlink: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:crond 955 root txt unknown /proc/955/exe (readlink: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:crond 955 root NOFD /proc/955/fd (opendir: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:nrpe 1161 nrpe cwd unknown /proc/1161/cwd (readlink: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:nrpe 1161 nrpe rtd unknown /proc/1161/root (readlink: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:nrpe 1161 nrpe txt unknown /proc/1161/exe (readlink: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:nrpe 1161 nrpe NOFD /proc/1161/fd (opendir: Permission denied) 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu cwd DIR 8,1 4096 2 / 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu rtd DIR 8,1 4096 2 / 2024-04-26T12:33:19.019 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu txt REG 8,1 1601312 8305 /usr/lib/systemd/systemd 2024-04-26T12:33:19.020 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 1598808 5171 /usr/lib64/libm-2.28.so 2024-04-26T12:33:19.020 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 636728 7430 /usr/lib64/libudev.so.1.6.11 2024-04-26T12:33:19.020 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 735192 5316 /usr/lib64/libsepol.so.1 2024-04-26T12:33:19.020 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 1760264 5414 /usr/lib64/libunistring.so.2.1.0 2024-04-26T12:33:19.020 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 144392 5392 /usr/lib64/libgpg-error.so.0.24.2 2024-04-26T12:33:19.020 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 66912 5574 /usr/lib64/libjson-c.so.4.0.0 2024-04-26T12:33:19.020 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 371224 7497 /usr/lib64/libdevmapper.so.1.02 2024-04-26T12:33:19.020 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 26192 5481 /usr/lib64/libattr.so.1.1.2448 2024-04-26T12:33:19.020 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu DEL REG 8,1 7507 /usr/lib64/libcrypto.so.1.1.1k 2024-04-26T12:33:19.021 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu DEL REG 8,1 7509 /usr/lib64/libssl.so.1.1.1k 2024-04-26T12:33:19.021 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 99600 5318 /usr/lib64/libz.so.1.2.11 2024-04-26T12:33:19.021 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 24928 5576 /usr/lib64/libcap-ng.so.0.0.0 2024-04-26T12:33:19.021 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu DEL REG 8,1 5382 /usr/lib64/libuuid.so.1.3.0 2024-04-26T12:33:19.021 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-26T12:33:19.021 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 543160 4872 /usr/lib64/libpcre2-8.so.0.7.1 2024-04-26T12:33:19.021 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu DEL REG 8,1 7499 /usr/lib64/libblkid.so.1.1.0 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 119760 5781 /usr/lib64/liblz4.so.1.8.3 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 192016 5359 /usr/lib64/liblzma.so.5.2.4 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 162224 5584 /usr/lib64/libidn2.so.0.3.6 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 1187360 5616 /usr/lib64/libgcrypt.so.20.2.5 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 526360 7535 /usr/lib64/libcryptsetup.so.12.6.0 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 54816 5483 /usr/lib64/libacl.so.1.1.2253 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 33752 5371 /usr/lib64/libcap.so.2.48 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 99664 6703 /usr/lib64/libgcc_s-8-20210514.so.1 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 100200 7532 /usr/lib64/libkmod.so.2.3.3 2024-04-26T12:33:19.022 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 135792 5578 /usr/lib64/libaudit.so.1.0.0 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 66504 7674 /usr/lib64/libpam.so.0.84.2 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu DEL REG 8,1 7306 /usr/lib64/libmount.so.1.1.0 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 168536 4876 /usr/lib64/libselinux.so.1 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 128784 6087 /usr/lib64/libseccomp.so.2.5.2 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 42744 5185 /usr/lib64/librt-2.28.so 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 2740672 8300 /usr/lib/systemd/libsystemd-shared-239.so 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 0r CHR 1,3 0t0 2059 /dev/null 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 1u unix 0x0000000000000000 0t0 23082 type=STREAM 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 2u unix 0x0000000000000000 0t0 23082 type=STREAM 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 3u unix 0x0000000000000000 0t0 23099 type=DGRAM 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 4u a_inode 0,14 0 15609 [eventpoll] 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 5u a_inode 0,14 0 15609 [signalfd] 2024-04-26T12:33:19.023 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 6r DIR 0,26 0 813 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 7u a_inode 0,14 0 15609 [timerfd] 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 8u netlink 0t0 23108 KOBJECT_UEVENT 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 9u a_inode 0,14 0 15609 [eventpoll] 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 10r a_inode 0,14 0 15609 inotify 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 11u unix 0x0000000000000000 0t0 32855 /run/user/1000/bus type=STREAM 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 12r REG 0,5 0 23113 /proc/1364/mountinfo 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 13r a_inode 0,14 0 15609 inotify 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 15u unix 0x0000000000000000 0t0 32843 /run/user/1000/systemd/notify type=DGRAM 2024-04-26T12:33:19.024 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 16u unix 0x0000000000000000 0t0 32845 type=DGRAM 2024-04-26T12:33:19.025 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 17u unix 0x0000000000000000 0t0 32846 type=DGRAM 2024-04-26T12:33:19.025 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 18u unix 0x0000000000000000 0t0 32847 /run/user/1000/systemd/private type=STREAM 2024-04-26T12:33:19.025 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 19u unix 0x0000000000000000 0t0 32849 type=STREAM 2024-04-26T12:33:19.025 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 20u a_inode 0,14 0 15609 [timerfd] 2024-04-26T12:33:19.025 INFO:tasks.workunit.client.0.smithi038.stdout:systemd 1364 ubuntu 26u netlink 0t0 32858 SELINUX 2024-04-26T12:33:19.025 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 1377 ubuntu cwd unknown /proc/1377/cwd (readlink: Permission denied) 2024-04-26T12:33:19.026 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 1377 ubuntu rtd unknown /proc/1377/root (readlink: Permission denied) 2024-04-26T12:33:19.026 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 1377 ubuntu txt unknown /proc/1377/exe (readlink: Permission denied) 2024-04-26T12:33:19.026 INFO:tasks.workunit.client.0.smithi038.stdout:(sd-pam) 1377 ubuntu NOFD /proc/1377/fd (opendir: Permission denied) 2024-04-26T12:33:19.026 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 6027 root cwd unknown /proc/6027/cwd (readlink: Permission denied) 2024-04-26T12:33:19.026 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 6027 root rtd unknown /proc/6027/root (readlink: Permission denied) 2024-04-26T12:33:19.026 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 6027 root txt unknown /proc/6027/exe (readlink: Permission denied) 2024-04-26T12:33:19.026 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 6027 root NOFD /proc/6027/fd (opendir: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 6028 root cwd unknown /proc/6028/cwd (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 6028 root rtd unknown /proc/6028/root (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 6028 root txt unknown /proc/6028/exe (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:agetty 6028 root NOFD /proc/6028/fd (opendir: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 6031 root cwd unknown /proc/6031/cwd (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 6031 root rtd unknown /proc/6031/root (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 6031 root txt unknown /proc/6031/exe (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 6031 root NOFD /proc/6031/fd (opendir: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 root cwd unknown /proc/6599/cwd (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 root rtd unknown /proc/6599/root (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 root txt unknown /proc/6599/exe (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 root NOFD /proc/6599/fd (opendir: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 6601 in:imjour root cwd unknown /proc/6599/task/6601/cwd (readlink: Permission denied) 2024-04-26T12:33:19.027 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 6601 in:imjour root rtd unknown /proc/6599/task/6601/root (readlink: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 6601 in:imjour root txt unknown /proc/6599/task/6601/exe (readlink: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 6601 in:imjour root NOFD /proc/6599/task/6601/fd (opendir: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 6602 rs:main root cwd unknown /proc/6599/task/6602/cwd (readlink: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 6602 rs:main root rtd unknown /proc/6599/task/6602/root (readlink: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 6602 rs:main root txt unknown /proc/6599/task/6602/exe (readlink: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:rsyslogd 6599 6602 rs:main root NOFD /proc/6599/task/6602/fd (opendir: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 25569 root cwd unknown /proc/25569/cwd (readlink: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 25569 root rtd unknown /proc/25569/root (readlink: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 25569 root txt unknown /proc/25569/exe (readlink: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 25569 root NOFD /proc/25569/fd (opendir: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 25571 root cwd unknown /proc/25571/cwd (readlink: Permission denied) 2024-04-26T12:33:19.028 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 25571 root rtd unknown /proc/25571/root (readlink: Permission denied) 2024-04-26T12:33:19.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 25571 root txt unknown /proc/25571/exe (readlink: Permission denied) 2024-04-26T12:33:19.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/3 25571 root NOFD /proc/25571/fd (opendir: Permission denied) 2024-04-26T12:33:19.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 25710 root cwd unknown /proc/25710/cwd (readlink: Permission denied) 2024-04-26T12:33:19.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 25710 root rtd unknown /proc/25710/root (readlink: Permission denied) 2024-04-26T12:33:19.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 25710 root txt unknown /proc/25710/exe (readlink: Permission denied) 2024-04-26T12:33:19.029 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/4 25710 root NOFD /proc/25710/fd (opendir: Permission denied) 2024-04-26T12:33:19.029 INFO:tasks.workunit.client.0.smithi038.stdout:ksmtuned 25841 root cwd unknown /proc/25841/cwd (readlink: Permission denied) 2024-04-26T12:33:19.029 INFO:tasks.workunit.client.0.smithi038.stdout:ksmtuned 25841 root rtd unknown /proc/25841/root (readlink: Permission denied) 2024-04-26T12:33:19.030 INFO:tasks.workunit.client.0.smithi038.stdout:ksmtuned 25841 root txt unknown /proc/25841/exe (readlink: Permission denied) 2024-04-26T12:33:19.030 INFO:tasks.workunit.client.0.smithi038.stdout:ksmtuned 25841 root NOFD /proc/25841/fd (opendir: Permission denied) 2024-04-26T12:33:19.030 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 27440 root cwd unknown /proc/27440/cwd (readlink: Permission denied) 2024-04-26T12:33:19.030 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 27440 root rtd unknown /proc/27440/root (readlink: Permission denied) 2024-04-26T12:33:19.030 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 27440 root txt unknown /proc/27440/exe (readlink: Permission denied) 2024-04-26T12:33:19.030 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 27440 root NOFD /proc/27440/fd (opendir: Permission denied) 2024-04-26T12:33:19.030 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 27695 root cwd unknown /proc/27695/cwd (readlink: Permission denied) 2024-04-26T12:33:19.030 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 27695 root rtd unknown /proc/27695/root (readlink: Permission denied) 2024-04-26T12:33:19.030 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 27695 root txt unknown /proc/27695/exe (readlink: Permission denied) 2024-04-26T12:33:19.031 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 27695 root NOFD /proc/27695/fd (opendir: Permission denied) 2024-04-26T12:33:19.031 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28125 root cwd unknown /proc/28125/cwd (readlink: Permission denied) 2024-04-26T12:33:19.031 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28125 root rtd unknown /proc/28125/root (readlink: Permission denied) 2024-04-26T12:33:19.031 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28125 root txt unknown /proc/28125/exe (readlink: Permission denied) 2024-04-26T12:33:19.031 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28125 root NOFD /proc/28125/fd (opendir: Permission denied) 2024-04-26T12:33:19.031 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28162 root cwd unknown /proc/28162/cwd (readlink: Permission denied) 2024-04-26T12:33:19.032 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28162 root rtd unknown /proc/28162/root (readlink: Permission denied) 2024-04-26T12:33:19.032 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28162 root txt unknown /proc/28162/exe (readlink: Permission denied) 2024-04-26T12:33:19.032 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28162 root NOFD /proc/28162/fd (opendir: Permission denied) 2024-04-26T12:33:19.032 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28199 root cwd unknown /proc/28199/cwd (readlink: Permission denied) 2024-04-26T12:33:19.032 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28199 root rtd unknown /proc/28199/root (readlink: Permission denied) 2024-04-26T12:33:19.032 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28199 root txt unknown /proc/28199/exe (readlink: Permission denied) 2024-04-26T12:33:19.032 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28199 root NOFD /proc/28199/fd (opendir: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28236 root cwd unknown /proc/28236/cwd (readlink: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28236 root rtd unknown /proc/28236/root (readlink: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28236 root txt unknown /proc/28236/exe (readlink: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28236 root NOFD /proc/28236/fd (opendir: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28273 root cwd unknown /proc/28273/cwd (readlink: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28273 root rtd unknown /proc/28273/root (readlink: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28273 root txt unknown /proc/28273/exe (readlink: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:kdmflush/ 28273 root NOFD /proc/28273/fd (opendir: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:xfsalloc 28486 root cwd unknown /proc/28486/cwd (readlink: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:xfsalloc 28486 root rtd unknown /proc/28486/root (readlink: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:xfsalloc 28486 root txt unknown /proc/28486/exe (readlink: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:xfsalloc 28486 root NOFD /proc/28486/fd (opendir: Permission denied) 2024-04-26T12:33:19.033 INFO:tasks.workunit.client.0.smithi038.stdout:xfs_mru_c 28487 root cwd unknown /proc/28487/cwd (readlink: Permission denied) 2024-04-26T12:33:19.034 INFO:tasks.workunit.client.0.smithi038.stdout:xfs_mru_c 28487 root rtd unknown /proc/28487/root (readlink: Permission denied) 2024-04-26T12:33:19.034 INFO:tasks.workunit.client.0.smithi038.stdout:xfs_mru_c 28487 root txt unknown /proc/28487/exe (readlink: Permission denied) 2024-04-26T12:33:19.034 INFO:tasks.workunit.client.0.smithi038.stdout:xfs_mru_c 28487 root NOFD /proc/28487/fd (opendir: Permission denied) 2024-04-26T12:33:19.034 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-buf/d 28488 root cwd unknown /proc/28488/cwd (readlink: Permission denied) 2024-04-26T12:33:19.034 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-buf/d 28488 root rtd unknown /proc/28488/root (readlink: Permission denied) 2024-04-26T12:33:19.034 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-buf/d 28488 root txt unknown /proc/28488/exe (readlink: Permission denied) 2024-04-26T12:33:19.034 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-buf/d 28488 root NOFD /proc/28488/fd (opendir: Permission denied) 2024-04-26T12:33:19.034 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-conv/ 28489 root cwd unknown /proc/28489/cwd (readlink: Permission denied) 2024-04-26T12:33:19.035 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-conv/ 28489 root rtd unknown /proc/28489/root (readlink: Permission denied) 2024-04-26T12:33:19.035 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-conv/ 28489 root txt unknown /proc/28489/exe (readlink: Permission denied) 2024-04-26T12:33:19.035 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-conv/ 28489 root NOFD /proc/28489/fd (opendir: Permission denied) 2024-04-26T12:33:19.035 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-cil/d 28490 root cwd unknown /proc/28490/cwd (readlink: Permission denied) 2024-04-26T12:33:19.035 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-cil/d 28490 root rtd unknown /proc/28490/root (readlink: Permission denied) 2024-04-26T12:33:19.035 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-cil/d 28490 root txt unknown /proc/28490/exe (readlink: Permission denied) 2024-04-26T12:33:19.035 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-cil/d 28490 root NOFD /proc/28490/fd (opendir: Permission denied) 2024-04-26T12:33:19.035 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-recla 28491 root cwd unknown /proc/28491/cwd (readlink: Permission denied) 2024-04-26T12:33:19.036 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-recla 28491 root rtd unknown /proc/28491/root (readlink: Permission denied) 2024-04-26T12:33:19.036 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-recla 28491 root txt unknown /proc/28491/exe (readlink: Permission denied) 2024-04-26T12:33:19.036 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-recla 28491 root NOFD /proc/28491/fd (opendir: Permission denied) 2024-04-26T12:33:19.036 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-block 28492 root cwd unknown /proc/28492/cwd (readlink: Permission denied) 2024-04-26T12:33:19.036 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-block 28492 root rtd unknown /proc/28492/root (readlink: Permission denied) 2024-04-26T12:33:19.036 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-block 28492 root txt unknown /proc/28492/exe (readlink: Permission denied) 2024-04-26T12:33:19.036 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-block 28492 root NOFD /proc/28492/fd (opendir: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-log/d 28493 root cwd unknown /proc/28493/cwd (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-log/d 28493 root rtd unknown /proc/28493/root (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-log/d 28493 root txt unknown /proc/28493/exe (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:xfs-log/d 28493 root NOFD /proc/28493/fd (opendir: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:xfsaild/d 28494 root cwd unknown /proc/28494/cwd (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:xfsaild/d 28494 root rtd unknown /proc/28494/root (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:xfsaild/d 28494 root txt unknown /proc/28494/exe (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:xfsaild/d 28494 root NOFD /proc/28494/fd (opendir: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 28495 root cwd unknown /proc/28495/cwd (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 28495 root rtd unknown /proc/28495/root (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 28495 root txt unknown /proc/28495/exe (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/7 28495 root NOFD /proc/28495/fd (opendir: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 32205 root cwd unknown /proc/32205/cwd (readlink: Permission denied) 2024-04-26T12:33:19.037 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 32205 root rtd unknown /proc/32205/root (readlink: Permission denied) 2024-04-26T12:33:19.038 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 32205 root txt unknown /proc/32205/exe (readlink: Permission denied) 2024-04-26T12:33:19.038 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 32205 root NOFD /proc/32205/fd (opendir: Permission denied) 2024-04-26T12:33:19.038 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 32209 ubuntu cwd unknown /proc/32209/cwd (readlink: Permission denied) 2024-04-26T12:33:19.038 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 32209 ubuntu rtd unknown /proc/32209/root (readlink: Permission denied) 2024-04-26T12:33:19.038 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 32209 ubuntu txt unknown /proc/32209/exe (readlink: Permission denied) 2024-04-26T12:33:19.038 INFO:tasks.workunit.client.0.smithi038.stdout:sshd 32209 ubuntu NOFD /proc/32209/fd (opendir: Permission denied) 2024-04-26T12:33:19.038 INFO:tasks.workunit.client.0.smithi038.stdout:chronyd 32279 chrony cwd unknown /proc/32279/cwd (readlink: Permission denied) 2024-04-26T12:33:19.038 INFO:tasks.workunit.client.0.smithi038.stdout:chronyd 32279 chrony rtd unknown /proc/32279/root (readlink: Permission denied) 2024-04-26T12:33:19.042 INFO:tasks.workunit.client.0.smithi038.stdout:chronyd 32279 chrony txt unknown /proc/32279/exe (readlink: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:chronyd 32279 chrony NOFD /proc/32279/fd (opendir: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 32288 root cwd unknown /proc/32288/cwd (readlink: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 32288 root rtd unknown /proc/32288/root (readlink: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 32288 root txt unknown /proc/32288/exe (readlink: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/2 32288 root NOFD /proc/32288/fd (opendir: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 32472 root cwd unknown /proc/32472/cwd (readlink: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 32472 root rtd unknown /proc/32472/root (readlink: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 32472 root txt unknown /proc/32472/exe (readlink: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/6 32472 root NOFD /proc/32472/fd (opendir: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-cras 32598 ceph cwd unknown /proc/32598/cwd (readlink: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-cras 32598 ceph rtd unknown /proc/32598/root (readlink: Permission denied) 2024-04-26T12:33:19.043 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-cras 32598 ceph txt unknown /proc/32598/exe (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-cras 32598 ceph NOFD /proc/32598/fd (opendir: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 38403 root cwd unknown /proc/38403/cwd (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 38403 root rtd unknown /proc/38403/root (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 38403 root txt unknown /proc/38403/exe (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/0 38403 root NOFD /proc/38403/fd (opendir: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39617 root cwd unknown /proc/39617/cwd (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39617 root rtd unknown /proc/39617/root (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39617 root txt unknown /proc/39617/exe (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39617 root NOFD /proc/39617/fd (opendir: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39620 root cwd unknown /proc/39620/cwd (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39620 root rtd unknown /proc/39620/root (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39620 root txt unknown /proc/39620/exe (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39620 root NOFD /proc/39620/fd (opendir: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39626 root cwd unknown /proc/39626/cwd (readlink: Permission denied) 2024-04-26T12:33:19.044 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39626 root rtd unknown /proc/39626/root (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39626 root txt unknown /proc/39626/exe (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39626 root NOFD /proc/39626/fd (opendir: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39634 root cwd unknown /proc/39634/cwd (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39634 root rtd unknown /proc/39634/root (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39634 root txt unknown /proc/39634/exe (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39634 root NOFD /proc/39634/fd (opendir: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39649 root cwd unknown /proc/39649/cwd (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39649 root rtd unknown /proc/39649/root (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39649 root txt unknown /proc/39649/exe (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 39649 root NOFD /proc/39649/fd (opendir: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39733 root cwd unknown /proc/39733/cwd (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39733 root rtd unknown /proc/39733/root (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39733 root txt unknown /proc/39733/exe (readlink: Permission denied) 2024-04-26T12:33:19.045 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39733 root NOFD /proc/39733/fd (opendir: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39735 root cwd unknown /proc/39735/cwd (readlink: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39735 root rtd unknown /proc/39735/root (readlink: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39735 root txt unknown /proc/39735/exe (readlink: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39735 root NOFD /proc/39735/fd (opendir: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39740 root cwd unknown /proc/39740/cwd (readlink: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39740 root rtd unknown /proc/39740/root (readlink: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39740 root txt unknown /proc/39740/exe (readlink: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39740 root NOFD /proc/39740/fd (opendir: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39741 root cwd unknown /proc/39741/cwd (readlink: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39741 root rtd unknown /proc/39741/root (readlink: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39741 root txt unknown /proc/39741/exe (readlink: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39741 root NOFD /proc/39741/fd (opendir: Permission denied) 2024-04-26T12:33:19.046 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39744 root cwd unknown /proc/39744/cwd (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39744 root rtd unknown /proc/39744/root (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39744 root txt unknown /proc/39744/exe (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 39744 root NOFD /proc/39744/fd (opendir: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 root cwd unknown /proc/39748/cwd (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 root rtd unknown /proc/39748/root (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 root txt unknown /proc/39748/exe (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 root NOFD /proc/39748/fd (opendir: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39752 log root cwd unknown /proc/39748/task/39752/cwd (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39752 log root rtd unknown /proc/39748/task/39752/root (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39752 log root txt unknown /proc/39748/task/39752/exe (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39752 log root NOFD /proc/39748/task/39752/fd (opendir: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39755 service root cwd unknown /proc/39748/task/39755/cwd (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39755 service root rtd unknown /proc/39748/task/39755/root (readlink: Permission denied) 2024-04-26T12:33:19.047 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39755 service root txt unknown /proc/39748/task/39755/exe (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39755 service root NOFD /proc/39748/task/39755/fd (opendir: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39757 admin_soc root cwd unknown /proc/39748/task/39757/cwd (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39757 admin_soc root rtd unknown /proc/39748/task/39757/root (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39757 admin_soc root txt unknown /proc/39748/task/39757/exe (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39757 admin_soc root NOFD /proc/39748/task/39757/fd (opendir: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39762 signal_ha root cwd unknown /proc/39748/task/39762/cwd (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39762 signal_ha root rtd unknown /proc/39748/task/39762/root (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39762 signal_ha root txt unknown /proc/39748/task/39762/exe (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39762 signal_ha root NOFD /proc/39748/task/39762/fd (opendir: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39776 rocksdb:l root cwd unknown /proc/39748/task/39776/cwd (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39776 rocksdb:l root rtd unknown /proc/39748/task/39776/root (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39776 rocksdb:l root txt unknown /proc/39748/task/39776/exe (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39776 rocksdb:l root NOFD /proc/39748/task/39776/fd (opendir: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39779 rocksdb:h root cwd unknown /proc/39748/task/39779/cwd (readlink: Permission denied) 2024-04-26T12:33:19.048 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39779 rocksdb:h root rtd unknown /proc/39748/task/39779/root (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39779 rocksdb:h root txt unknown /proc/39748/task/39779/exe (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39779 rocksdb:h root NOFD /proc/39748/task/39779/fd (opendir: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39795 ceph-mon root cwd unknown /proc/39748/task/39795/cwd (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39795 ceph-mon root rtd unknown /proc/39748/task/39795/root (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39795 ceph-mon root txt unknown /proc/39748/task/39795/exe (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39795 ceph-mon root NOFD /proc/39748/task/39795/fd (opendir: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39796 fn_monsto root cwd unknown /proc/39748/task/39796/cwd (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39796 fn_monsto root rtd unknown /proc/39748/task/39796/root (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39796 fn_monsto root txt unknown /proc/39748/task/39796/exe (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39796 fn_monsto root NOFD /proc/39748/task/39796/fd (opendir: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39797 msgr-work root cwd unknown /proc/39748/task/39797/cwd (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39797 msgr-work root rtd unknown /proc/39748/task/39797/root (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39797 msgr-work root txt unknown /proc/39748/task/39797/exe (readlink: Permission denied) 2024-04-26T12:33:19.049 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39797 msgr-work root NOFD /proc/39748/task/39797/fd (opendir: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39798 msgr-work root cwd unknown /proc/39748/task/39798/cwd (readlink: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39798 msgr-work root rtd unknown /proc/39748/task/39798/root (readlink: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39798 msgr-work root txt unknown /proc/39748/task/39798/exe (readlink: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39798 msgr-work root NOFD /proc/39748/task/39798/fd (opendir: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39799 msgr-work root cwd unknown /proc/39748/task/39799/cwd (readlink: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39799 msgr-work root rtd unknown /proc/39748/task/39799/root (readlink: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39799 msgr-work root txt unknown /proc/39748/task/39799/exe (readlink: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39799 msgr-work root NOFD /proc/39748/task/39799/fd (opendir: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39800 OpHistory root cwd unknown /proc/39748/task/39800/cwd (readlink: Permission denied) 2024-04-26T12:33:19.050 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39800 OpHistory root rtd unknown /proc/39748/task/39800/root (readlink: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39800 OpHistory root txt unknown /proc/39748/task/39800/exe (readlink: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39800 OpHistory root NOFD /proc/39748/task/39800/fd (opendir: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39817 fin root cwd unknown /proc/39748/task/39817/cwd (readlink: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39817 fin root rtd unknown /proc/39748/task/39817/root (readlink: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39817 fin root txt unknown /proc/39748/task/39817/exe (readlink: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39817 fin root NOFD /proc/39748/task/39817/fd (opendir: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39818 safe_time root cwd unknown /proc/39748/task/39818/cwd (readlink: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39818 safe_time root rtd unknown /proc/39748/task/39818/root (readlink: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39818 safe_time root txt unknown /proc/39748/task/39818/exe (readlink: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39818 safe_time root NOFD /proc/39748/task/39818/fd (opendir: Permission denied) 2024-04-26T12:33:19.051 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39819 cpu_tp root cwd unknown /proc/39748/task/39819/cwd (readlink: Permission denied) 2024-04-26T12:33:19.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39819 cpu_tp root rtd unknown /proc/39748/task/39819/root (readlink: Permission denied) 2024-04-26T12:33:19.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39819 cpu_tp root txt unknown /proc/39748/task/39819/exe (readlink: Permission denied) 2024-04-26T12:33:19.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39819 cpu_tp root NOFD /proc/39748/task/39819/fd (opendir: Permission denied) 2024-04-26T12:33:19.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39820 cpu_tp root cwd unknown /proc/39748/task/39820/cwd (readlink: Permission denied) 2024-04-26T12:33:19.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39820 cpu_tp root rtd unknown /proc/39748/task/39820/root (readlink: Permission denied) 2024-04-26T12:33:19.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39820 cpu_tp root txt unknown /proc/39748/task/39820/exe (readlink: Permission denied) 2024-04-26T12:33:19.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39820 cpu_tp root NOFD /proc/39748/task/39820/fd (opendir: Permission denied) 2024-04-26T12:33:19.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39821 cpu_tp root cwd unknown /proc/39748/task/39821/cwd (readlink: Permission denied) 2024-04-26T12:33:19.052 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39821 cpu_tp root rtd unknown /proc/39748/task/39821/root (readlink: Permission denied) 2024-04-26T12:33:19.053 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39821 cpu_tp root txt unknown /proc/39748/task/39821/exe (readlink: Permission denied) 2024-04-26T12:33:19.053 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39821 cpu_tp root NOFD /proc/39748/task/39821/fd (opendir: Permission denied) 2024-04-26T12:33:19.053 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39822 cpu_tp root cwd unknown /proc/39748/task/39822/cwd (readlink: Permission denied) 2024-04-26T12:33:19.053 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39822 cpu_tp root rtd unknown /proc/39748/task/39822/root (readlink: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39822 cpu_tp root txt unknown /proc/39748/task/39822/exe (readlink: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39822 cpu_tp root NOFD /proc/39748/task/39822/fd (opendir: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39823 ms_dispat root cwd unknown /proc/39748/task/39823/cwd (readlink: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39823 ms_dispat root rtd unknown /proc/39748/task/39823/root (readlink: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39823 ms_dispat root txt unknown /proc/39748/task/39823/exe (readlink: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39823 ms_dispat root NOFD /proc/39748/task/39823/fd (opendir: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39824 ms_local root cwd unknown /proc/39748/task/39824/cwd (readlink: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39824 ms_local root rtd unknown /proc/39748/task/39824/root (readlink: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39824 ms_local root txt unknown /proc/39748/task/39824/exe (readlink: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39824 ms_local root NOFD /proc/39748/task/39824/fd (opendir: Permission denied) 2024-04-26T12:33:19.055 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39825 safe_time root cwd unknown /proc/39748/task/39825/cwd (readlink: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39825 safe_time root rtd unknown /proc/39748/task/39825/root (readlink: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39825 safe_time root txt unknown /proc/39748/task/39825/exe (readlink: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39825 safe_time root NOFD /proc/39748/task/39825/fd (opendir: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39826 ms_dispat root cwd unknown /proc/39748/task/39826/cwd (readlink: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39826 ms_dispat root rtd unknown /proc/39748/task/39826/root (readlink: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39826 ms_dispat root txt unknown /proc/39748/task/39826/exe (readlink: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39826 ms_dispat root NOFD /proc/39748/task/39826/fd (opendir: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39827 ms_local root cwd unknown /proc/39748/task/39827/cwd (readlink: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39827 ms_local root rtd unknown /proc/39748/task/39827/root (readlink: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39827 ms_local root txt unknown /proc/39748/task/39827/exe (readlink: Permission denied) 2024-04-26T12:33:19.056 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39748 39827 ms_local root NOFD /proc/39748/task/39827/fd (opendir: Permission denied) 2024-04-26T12:33:19.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 root cwd unknown /proc/39749/cwd (readlink: Permission denied) 2024-04-26T12:33:19.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 root rtd unknown /proc/39749/root (readlink: Permission denied) 2024-04-26T12:33:19.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 root txt unknown /proc/39749/exe (readlink: Permission denied) 2024-04-26T12:33:19.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 root NOFD /proc/39749/fd (opendir: Permission denied) 2024-04-26T12:33:19.057 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39751 log root cwd unknown /proc/39749/task/39751/cwd (readlink: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39751 log root rtd unknown /proc/39749/task/39751/root (readlink: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39751 log root txt unknown /proc/39749/task/39751/exe (readlink: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39751 log root NOFD /proc/39749/task/39751/fd (opendir: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39754 service root cwd unknown /proc/39749/task/39754/cwd (readlink: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39754 service root rtd unknown /proc/39749/task/39754/root (readlink: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39754 service root txt unknown /proc/39749/task/39754/exe (readlink: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39754 service root NOFD /proc/39749/task/39754/fd (opendir: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39756 admin_soc root cwd unknown /proc/39749/task/39756/cwd (readlink: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39756 admin_soc root rtd unknown /proc/39749/task/39756/root (readlink: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39756 admin_soc root txt unknown /proc/39749/task/39756/exe (readlink: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39756 admin_soc root NOFD /proc/39749/task/39756/fd (opendir: Permission denied) 2024-04-26T12:33:19.058 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39759 signal_ha root cwd unknown /proc/39749/task/39759/cwd (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39759 signal_ha root rtd unknown /proc/39749/task/39759/root (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39759 signal_ha root txt unknown /proc/39749/task/39759/exe (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39759 signal_ha root NOFD /proc/39749/task/39759/fd (opendir: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39760 rocksdb:l root cwd unknown /proc/39749/task/39760/cwd (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39760 rocksdb:l root rtd unknown /proc/39749/task/39760/root (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39760 rocksdb:l root txt unknown /proc/39749/task/39760/exe (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39760 rocksdb:l root NOFD /proc/39749/task/39760/fd (opendir: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39761 rocksdb:h root cwd unknown /proc/39749/task/39761/cwd (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39761 rocksdb:h root rtd unknown /proc/39749/task/39761/root (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39761 rocksdb:h root txt unknown /proc/39749/task/39761/exe (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39761 rocksdb:h root NOFD /proc/39749/task/39761/fd (opendir: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39828 ceph-mon root cwd unknown /proc/39749/task/39828/cwd (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39828 ceph-mon root rtd unknown /proc/39749/task/39828/root (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39828 ceph-mon root txt unknown /proc/39749/task/39828/exe (readlink: Permission denied) 2024-04-26T12:33:19.059 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39828 ceph-mon root NOFD /proc/39749/task/39828/fd (opendir: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39829 fn_monsto root cwd unknown /proc/39749/task/39829/cwd (readlink: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39829 fn_monsto root rtd unknown /proc/39749/task/39829/root (readlink: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39829 fn_monsto root txt unknown /proc/39749/task/39829/exe (readlink: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39829 fn_monsto root NOFD /proc/39749/task/39829/fd (opendir: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39830 msgr-work root cwd unknown /proc/39749/task/39830/cwd (readlink: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39830 msgr-work root rtd unknown /proc/39749/task/39830/root (readlink: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39830 msgr-work root txt unknown /proc/39749/task/39830/exe (readlink: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39830 msgr-work root NOFD /proc/39749/task/39830/fd (opendir: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39831 msgr-work root cwd unknown /proc/39749/task/39831/cwd (readlink: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39831 msgr-work root rtd unknown /proc/39749/task/39831/root (readlink: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39831 msgr-work root txt unknown /proc/39749/task/39831/exe (readlink: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39831 msgr-work root NOFD /proc/39749/task/39831/fd (opendir: Permission denied) 2024-04-26T12:33:19.060 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39832 msgr-work root cwd unknown /proc/39749/task/39832/cwd (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39832 msgr-work root rtd unknown /proc/39749/task/39832/root (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39832 msgr-work root txt unknown /proc/39749/task/39832/exe (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39832 msgr-work root NOFD /proc/39749/task/39832/fd (opendir: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39833 OpHistory root cwd unknown /proc/39749/task/39833/cwd (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39833 OpHistory root rtd unknown /proc/39749/task/39833/root (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39833 OpHistory root txt unknown /proc/39749/task/39833/exe (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39833 OpHistory root NOFD /proc/39749/task/39833/fd (opendir: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39837 fin root cwd unknown /proc/39749/task/39837/cwd (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39837 fin root rtd unknown /proc/39749/task/39837/root (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39837 fin root txt unknown /proc/39749/task/39837/exe (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39837 fin root NOFD /proc/39749/task/39837/fd (opendir: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39838 safe_time root cwd unknown /proc/39749/task/39838/cwd (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39838 safe_time root rtd unknown /proc/39749/task/39838/root (readlink: Permission denied) 2024-04-26T12:33:19.061 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39838 safe_time root txt unknown /proc/39749/task/39838/exe (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39838 safe_time root NOFD /proc/39749/task/39838/fd (opendir: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39839 cpu_tp root cwd unknown /proc/39749/task/39839/cwd (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39839 cpu_tp root rtd unknown /proc/39749/task/39839/root (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39839 cpu_tp root txt unknown /proc/39749/task/39839/exe (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39839 cpu_tp root NOFD /proc/39749/task/39839/fd (opendir: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39840 cpu_tp root cwd unknown /proc/39749/task/39840/cwd (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39840 cpu_tp root rtd unknown /proc/39749/task/39840/root (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39840 cpu_tp root txt unknown /proc/39749/task/39840/exe (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39840 cpu_tp root NOFD /proc/39749/task/39840/fd (opendir: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39841 cpu_tp root cwd unknown /proc/39749/task/39841/cwd (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39841 cpu_tp root rtd unknown /proc/39749/task/39841/root (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39841 cpu_tp root txt unknown /proc/39749/task/39841/exe (readlink: Permission denied) 2024-04-26T12:33:19.062 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39841 cpu_tp root NOFD /proc/39749/task/39841/fd (opendir: Permission denied) 2024-04-26T12:33:19.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39842 cpu_tp root cwd unknown /proc/39749/task/39842/cwd (readlink: Permission denied) 2024-04-26T12:33:19.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39842 cpu_tp root rtd unknown /proc/39749/task/39842/root (readlink: Permission denied) 2024-04-26T12:33:19.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39842 cpu_tp root txt unknown /proc/39749/task/39842/exe (readlink: Permission denied) 2024-04-26T12:33:19.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39842 cpu_tp root NOFD /proc/39749/task/39842/fd (opendir: Permission denied) 2024-04-26T12:33:19.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39843 ms_dispat root cwd unknown /proc/39749/task/39843/cwd (readlink: Permission denied) 2024-04-26T12:33:19.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39843 ms_dispat root rtd unknown /proc/39749/task/39843/root (readlink: Permission denied) 2024-04-26T12:33:19.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39843 ms_dispat root txt unknown /proc/39749/task/39843/exe (readlink: Permission denied) 2024-04-26T12:33:19.063 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39843 ms_dispat root NOFD /proc/39749/task/39843/fd (opendir: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39844 ms_local root cwd unknown /proc/39749/task/39844/cwd (readlink: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39844 ms_local root rtd unknown /proc/39749/task/39844/root (readlink: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39844 ms_local root txt unknown /proc/39749/task/39844/exe (readlink: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39844 ms_local root NOFD /proc/39749/task/39844/fd (opendir: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39845 safe_time root cwd unknown /proc/39749/task/39845/cwd (readlink: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39845 safe_time root rtd unknown /proc/39749/task/39845/root (readlink: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39845 safe_time root txt unknown /proc/39749/task/39845/exe (readlink: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39845 safe_time root NOFD /proc/39749/task/39845/fd (opendir: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39846 ms_dispat root cwd unknown /proc/39749/task/39846/cwd (readlink: Permission denied) 2024-04-26T12:33:19.064 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39846 ms_dispat root rtd unknown /proc/39749/task/39846/root (readlink: Permission denied) 2024-04-26T12:33:19.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39846 ms_dispat root txt unknown /proc/39749/task/39846/exe (readlink: Permission denied) 2024-04-26T12:33:19.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39846 ms_dispat root NOFD /proc/39749/task/39846/fd (opendir: Permission denied) 2024-04-26T12:33:19.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39847 ms_local root cwd unknown /proc/39749/task/39847/cwd (readlink: Permission denied) 2024-04-26T12:33:19.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39847 ms_local root rtd unknown /proc/39749/task/39847/root (readlink: Permission denied) 2024-04-26T12:33:19.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39847 ms_local root txt unknown /proc/39749/task/39847/exe (readlink: Permission denied) 2024-04-26T12:33:19.065 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39749 39847 ms_local root NOFD /proc/39749/task/39847/fd (opendir: Permission denied) 2024-04-26T12:33:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 root cwd unknown /proc/39750/cwd (readlink: Permission denied) 2024-04-26T12:33:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 root rtd unknown /proc/39750/root (readlink: Permission denied) 2024-04-26T12:33:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 root txt unknown /proc/39750/exe (readlink: Permission denied) 2024-04-26T12:33:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 root NOFD /proc/39750/fd (opendir: Permission denied) 2024-04-26T12:33:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39834 log root cwd unknown /proc/39750/task/39834/cwd (readlink: Permission denied) 2024-04-26T12:33:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39834 log root rtd unknown /proc/39750/task/39834/root (readlink: Permission denied) 2024-04-26T12:33:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39834 log root txt unknown /proc/39750/task/39834/exe (readlink: Permission denied) 2024-04-26T12:33:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39834 log root NOFD /proc/39750/task/39834/fd (opendir: Permission denied) 2024-04-26T12:33:19.066 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39835 service root cwd unknown /proc/39750/task/39835/cwd (readlink: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39835 service root rtd unknown /proc/39750/task/39835/root (readlink: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39835 service root txt unknown /proc/39750/task/39835/exe (readlink: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39835 service root NOFD /proc/39750/task/39835/fd (opendir: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39836 admin_soc root cwd unknown /proc/39750/task/39836/cwd (readlink: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39836 admin_soc root rtd unknown /proc/39750/task/39836/root (readlink: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39836 admin_soc root txt unknown /proc/39750/task/39836/exe (readlink: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39836 admin_soc root NOFD /proc/39750/task/39836/fd (opendir: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39848 signal_ha root cwd unknown /proc/39750/task/39848/cwd (readlink: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39848 signal_ha root rtd unknown /proc/39750/task/39848/root (readlink: Permission denied) 2024-04-26T12:33:19.067 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39848 signal_ha root txt unknown /proc/39750/task/39848/exe (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39848 signal_ha root NOFD /proc/39750/task/39848/fd (opendir: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39849 rocksdb:l root cwd unknown /proc/39750/task/39849/cwd (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39849 rocksdb:l root rtd unknown /proc/39750/task/39849/root (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39849 rocksdb:l root txt unknown /proc/39750/task/39849/exe (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39849 rocksdb:l root NOFD /proc/39750/task/39849/fd (opendir: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39850 rocksdb:h root cwd unknown /proc/39750/task/39850/cwd (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39850 rocksdb:h root rtd unknown /proc/39750/task/39850/root (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39850 rocksdb:h root txt unknown /proc/39750/task/39850/exe (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39850 rocksdb:h root NOFD /proc/39750/task/39850/fd (opendir: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39866 ceph-mon root cwd unknown /proc/39750/task/39866/cwd (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39866 ceph-mon root rtd unknown /proc/39750/task/39866/root (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39866 ceph-mon root txt unknown /proc/39750/task/39866/exe (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39866 ceph-mon root NOFD /proc/39750/task/39866/fd (opendir: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39867 fn_monsto root cwd unknown /proc/39750/task/39867/cwd (readlink: Permission denied) 2024-04-26T12:33:19.068 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39867 fn_monsto root rtd unknown /proc/39750/task/39867/root (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39867 fn_monsto root txt unknown /proc/39750/task/39867/exe (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39867 fn_monsto root NOFD /proc/39750/task/39867/fd (opendir: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39868 msgr-work root cwd unknown /proc/39750/task/39868/cwd (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39868 msgr-work root rtd unknown /proc/39750/task/39868/root (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39868 msgr-work root txt unknown /proc/39750/task/39868/exe (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39868 msgr-work root NOFD /proc/39750/task/39868/fd (opendir: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39869 msgr-work root cwd unknown /proc/39750/task/39869/cwd (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39869 msgr-work root rtd unknown /proc/39750/task/39869/root (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39869 msgr-work root txt unknown /proc/39750/task/39869/exe (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39869 msgr-work root NOFD /proc/39750/task/39869/fd (opendir: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39870 msgr-work root cwd unknown /proc/39750/task/39870/cwd (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39870 msgr-work root rtd unknown /proc/39750/task/39870/root (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39870 msgr-work root txt unknown /proc/39750/task/39870/exe (readlink: Permission denied) 2024-04-26T12:33:19.069 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39870 msgr-work root NOFD /proc/39750/task/39870/fd (opendir: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39871 OpHistory root cwd unknown /proc/39750/task/39871/cwd (readlink: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39871 OpHistory root rtd unknown /proc/39750/task/39871/root (readlink: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39871 OpHistory root txt unknown /proc/39750/task/39871/exe (readlink: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39871 OpHistory root NOFD /proc/39750/task/39871/fd (opendir: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39872 fin root cwd unknown /proc/39750/task/39872/cwd (readlink: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39872 fin root rtd unknown /proc/39750/task/39872/root (readlink: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39872 fin root txt unknown /proc/39750/task/39872/exe (readlink: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39872 fin root NOFD /proc/39750/task/39872/fd (opendir: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39873 safe_time root cwd unknown /proc/39750/task/39873/cwd (readlink: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39873 safe_time root rtd unknown /proc/39750/task/39873/root (readlink: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39873 safe_time root txt unknown /proc/39750/task/39873/exe (readlink: Permission denied) 2024-04-26T12:33:19.070 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39873 safe_time root NOFD /proc/39750/task/39873/fd (opendir: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39874 cpu_tp root cwd unknown /proc/39750/task/39874/cwd (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39874 cpu_tp root rtd unknown /proc/39750/task/39874/root (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39874 cpu_tp root txt unknown /proc/39750/task/39874/exe (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39874 cpu_tp root NOFD /proc/39750/task/39874/fd (opendir: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39875 cpu_tp root cwd unknown /proc/39750/task/39875/cwd (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39875 cpu_tp root rtd unknown /proc/39750/task/39875/root (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39875 cpu_tp root txt unknown /proc/39750/task/39875/exe (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39875 cpu_tp root NOFD /proc/39750/task/39875/fd (opendir: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39876 cpu_tp root cwd unknown /proc/39750/task/39876/cwd (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39876 cpu_tp root rtd unknown /proc/39750/task/39876/root (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39876 cpu_tp root txt unknown /proc/39750/task/39876/exe (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39876 cpu_tp root NOFD /proc/39750/task/39876/fd (opendir: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39877 cpu_tp root cwd unknown /proc/39750/task/39877/cwd (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39877 cpu_tp root rtd unknown /proc/39750/task/39877/root (readlink: Permission denied) 2024-04-26T12:33:19.071 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39877 cpu_tp root txt unknown /proc/39750/task/39877/exe (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39877 cpu_tp root NOFD /proc/39750/task/39877/fd (opendir: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39878 ms_dispat root cwd unknown /proc/39750/task/39878/cwd (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39878 ms_dispat root rtd unknown /proc/39750/task/39878/root (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39878 ms_dispat root txt unknown /proc/39750/task/39878/exe (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39878 ms_dispat root NOFD /proc/39750/task/39878/fd (opendir: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39879 ms_local root cwd unknown /proc/39750/task/39879/cwd (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39879 ms_local root rtd unknown /proc/39750/task/39879/root (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39879 ms_local root txt unknown /proc/39750/task/39879/exe (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39879 ms_local root NOFD /proc/39750/task/39879/fd (opendir: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39880 safe_time root cwd unknown /proc/39750/task/39880/cwd (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39880 safe_time root rtd unknown /proc/39750/task/39880/root (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39880 safe_time root txt unknown /proc/39750/task/39880/exe (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39880 safe_time root NOFD /proc/39750/task/39880/fd (opendir: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39881 ms_dispat root cwd unknown /proc/39750/task/39881/cwd (readlink: Permission denied) 2024-04-26T12:33:19.072 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39881 ms_dispat root rtd unknown /proc/39750/task/39881/root (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39881 ms_dispat root txt unknown /proc/39750/task/39881/exe (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39881 ms_dispat root NOFD /proc/39750/task/39881/fd (opendir: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39882 ms_local root cwd unknown /proc/39750/task/39882/cwd (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39882 ms_local root rtd unknown /proc/39750/task/39882/root (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39882 ms_local root txt unknown /proc/39750/task/39882/exe (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mon 39750 39882 ms_local root NOFD /proc/39750/task/39882/fd (opendir: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 root cwd unknown /proc/39753/cwd (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 root rtd unknown /proc/39753/root (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 root txt unknown /proc/39753/exe (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 root NOFD /proc/39753/fd (opendir: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39809 log root cwd unknown /proc/39753/task/39809/cwd (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39809 log root rtd unknown /proc/39753/task/39809/root (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39809 log root txt unknown /proc/39753/task/39809/exe (readlink: Permission denied) 2024-04-26T12:33:19.073 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39809 log root NOFD /proc/39753/task/39809/fd (opendir: Permission denied) 2024-04-26T12:33:19.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39811 msgr-work root cwd unknown /proc/39753/task/39811/cwd (readlink: Permission denied) 2024-04-26T12:33:19.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39811 msgr-work root rtd unknown /proc/39753/task/39811/root (readlink: Permission denied) 2024-04-26T12:33:19.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39811 msgr-work root txt unknown /proc/39753/task/39811/exe (readlink: Permission denied) 2024-04-26T12:33:19.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39811 msgr-work root NOFD /proc/39753/task/39811/fd (opendir: Permission denied) 2024-04-26T12:33:19.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39812 msgr-work root cwd unknown /proc/39753/task/39812/cwd (readlink: Permission denied) 2024-04-26T12:33:19.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39812 msgr-work root rtd unknown /proc/39753/task/39812/root (readlink: Permission denied) 2024-04-26T12:33:19.074 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39812 msgr-work root txt unknown /proc/39753/task/39812/exe (readlink: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39812 msgr-work root NOFD /proc/39753/task/39812/fd (opendir: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39813 msgr-work root cwd unknown /proc/39753/task/39813/cwd (readlink: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39813 msgr-work root rtd unknown /proc/39753/task/39813/root (readlink: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39813 msgr-work root txt unknown /proc/39753/task/39813/exe (readlink: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39813 msgr-work root NOFD /proc/39753/task/39813/fd (opendir: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39915 service root cwd unknown /proc/39753/task/39915/cwd (readlink: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39915 service root rtd unknown /proc/39753/task/39915/root (readlink: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39915 service root txt unknown /proc/39753/task/39915/exe (readlink: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39915 service root NOFD /proc/39753/task/39915/fd (opendir: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39916 admin_soc root cwd unknown /proc/39753/task/39916/cwd (readlink: Permission denied) 2024-04-26T12:33:19.075 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39916 admin_soc root rtd unknown /proc/39753/task/39916/root (readlink: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39916 admin_soc root txt unknown /proc/39753/task/39916/exe (readlink: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39916 admin_soc root NOFD /proc/39753/task/39916/fd (opendir: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39917 ceph_time root cwd unknown /proc/39753/task/39917/cwd (readlink: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39917 ceph_time root rtd unknown /proc/39753/task/39917/root (readlink: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39917 ceph_time root txt unknown /proc/39753/task/39917/exe (readlink: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39917 ceph_time root NOFD /proc/39753/task/39917/fd (opendir: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39918 fn_anonym root cwd unknown /proc/39753/task/39918/cwd (readlink: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39918 fn_anonym root rtd unknown /proc/39753/task/39918/root (readlink: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39918 fn_anonym root txt unknown /proc/39753/task/39918/exe (readlink: Permission denied) 2024-04-26T12:33:19.076 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39918 fn_anonym root NOFD /proc/39753/task/39918/fd (opendir: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39919 signal_ha root cwd unknown /proc/39753/task/39919/cwd (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39919 signal_ha root rtd unknown /proc/39753/task/39919/root (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39919 signal_ha root txt unknown /proc/39753/task/39919/exe (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39919 signal_ha root NOFD /proc/39753/task/39919/fd (opendir: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39920 mgrsb-fin root cwd unknown /proc/39753/task/39920/cwd (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39920 mgrsb-fin root rtd unknown /proc/39753/task/39920/root (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39920 mgrsb-fin root txt unknown /proc/39753/task/39920/exe (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39920 mgrsb-fin root NOFD /proc/39753/task/39920/fd (opendir: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39921 ms_dispat root cwd unknown /proc/39753/task/39921/cwd (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39921 ms_dispat root rtd unknown /proc/39753/task/39921/root (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39921 ms_dispat root txt unknown /proc/39753/task/39921/exe (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39921 ms_dispat root NOFD /proc/39753/task/39921/fd (opendir: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39922 ms_local root cwd unknown /proc/39753/task/39922/cwd (readlink: Permission denied) 2024-04-26T12:33:19.077 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39922 ms_local root rtd unknown /proc/39753/task/39922/root (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39922 ms_local root txt unknown /proc/39753/task/39922/exe (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39922 ms_local root NOFD /proc/39753/task/39922/fd (opendir: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39923 io_contex root cwd unknown /proc/39753/task/39923/cwd (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39923 io_contex root rtd unknown /proc/39753/task/39923/root (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39923 io_contex root txt unknown /proc/39753/task/39923/exe (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39923 io_contex root NOFD /proc/39753/task/39923/fd (opendir: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39924 io_contex root cwd unknown /proc/39753/task/39924/cwd (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39924 io_contex root rtd unknown /proc/39753/task/39924/root (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39924 io_contex root txt unknown /proc/39753/task/39924/exe (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39924 io_contex root NOFD /proc/39753/task/39924/fd (opendir: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39925 safe_time root cwd unknown /proc/39753/task/39925/cwd (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39925 safe_time root rtd unknown /proc/39753/task/39925/root (readlink: Permission denied) 2024-04-26T12:33:19.078 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39925 safe_time root txt unknown /proc/39753/task/39925/exe (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39925 safe_time root NOFD /proc/39753/task/39925/fd (opendir: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39926 safe_time root cwd unknown /proc/39753/task/39926/cwd (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39926 safe_time root rtd unknown /proc/39753/task/39926/root (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39926 safe_time root txt unknown /proc/39753/task/39926/exe (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39926 safe_time root NOFD /proc/39753/task/39926/fd (opendir: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39927 safe_time root cwd unknown /proc/39753/task/39927/cwd (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39927 safe_time root rtd unknown /proc/39753/task/39927/root (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39927 safe_time root txt unknown /proc/39753/task/39927/exe (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39927 safe_time root NOFD /proc/39753/task/39927/fd (opendir: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39928 fn_anonym root cwd unknown /proc/39753/task/39928/cwd (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39928 fn_anonym root rtd unknown /proc/39753/task/39928/root (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39928 fn_anonym root txt unknown /proc/39753/task/39928/exe (readlink: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39928 fn_anonym root NOFD /proc/39753/task/39928/fd (opendir: Permission denied) 2024-04-26T12:33:19.079 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39929 flusher root cwd unknown /proc/39753/task/39929/cwd (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39929 flusher root rtd unknown /proc/39753/task/39929/root (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39929 flusher root txt unknown /proc/39753/task/39929/exe (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39929 flusher root NOFD /proc/39753/task/39929/fd (opendir: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39930 safe_time root cwd unknown /proc/39753/task/39930/cwd (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39930 safe_time root rtd unknown /proc/39753/task/39930/root (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39930 safe_time root txt unknown /proc/39753/task/39930/exe (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39753 39930 safe_time root NOFD /proc/39753/task/39930/fd (opendir: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 root cwd unknown /proc/39758/cwd (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 root rtd unknown /proc/39758/root (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 root txt unknown /proc/39758/exe (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 root NOFD /proc/39758/fd (opendir: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39801 log root cwd unknown /proc/39758/task/39801/cwd (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39801 log root rtd unknown /proc/39758/task/39801/root (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39801 log root txt unknown /proc/39758/task/39801/exe (readlink: Permission denied) 2024-04-26T12:33:19.080 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39801 log root NOFD /proc/39758/task/39801/fd (opendir: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39803 msgr-work root cwd unknown /proc/39758/task/39803/cwd (readlink: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39803 msgr-work root rtd unknown /proc/39758/task/39803/root (readlink: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39803 msgr-work root txt unknown /proc/39758/task/39803/exe (readlink: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39803 msgr-work root NOFD /proc/39758/task/39803/fd (opendir: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39804 msgr-work root cwd unknown /proc/39758/task/39804/cwd (readlink: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39804 msgr-work root rtd unknown /proc/39758/task/39804/root (readlink: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39804 msgr-work root txt unknown /proc/39758/task/39804/exe (readlink: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39804 msgr-work root NOFD /proc/39758/task/39804/fd (opendir: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39805 msgr-work root cwd unknown /proc/39758/task/39805/cwd (readlink: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39805 msgr-work root rtd unknown /proc/39758/task/39805/root (readlink: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39805 msgr-work root txt unknown /proc/39758/task/39805/exe (readlink: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39805 msgr-work root NOFD /proc/39758/task/39805/fd (opendir: Permission denied) 2024-04-26T12:33:19.081 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39894 service root cwd unknown /proc/39758/task/39894/cwd (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39894 service root rtd unknown /proc/39758/task/39894/root (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39894 service root txt unknown /proc/39758/task/39894/exe (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39894 service root NOFD /proc/39758/task/39894/fd (opendir: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39895 admin_soc root cwd unknown /proc/39758/task/39895/cwd (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39895 admin_soc root rtd unknown /proc/39758/task/39895/root (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39895 admin_soc root txt unknown /proc/39758/task/39895/exe (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39895 admin_soc root NOFD /proc/39758/task/39895/fd (opendir: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39896 ceph_time root cwd unknown /proc/39758/task/39896/cwd (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39896 ceph_time root rtd unknown /proc/39758/task/39896/root (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39896 ceph_time root txt unknown /proc/39758/task/39896/exe (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39896 ceph_time root NOFD /proc/39758/task/39896/fd (opendir: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39897 fn_anonym root cwd unknown /proc/39758/task/39897/cwd (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39897 fn_anonym root rtd unknown /proc/39758/task/39897/root (readlink: Permission denied) 2024-04-26T12:33:19.082 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39897 fn_anonym root txt unknown /proc/39758/task/39897/exe (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39897 fn_anonym root NOFD /proc/39758/task/39897/fd (opendir: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39898 signal_ha root cwd unknown /proc/39758/task/39898/cwd (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39898 signal_ha root rtd unknown /proc/39758/task/39898/root (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39898 signal_ha root txt unknown /proc/39758/task/39898/exe (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39898 signal_ha root NOFD /proc/39758/task/39898/fd (opendir: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39899 mgrsb-fin root cwd unknown /proc/39758/task/39899/cwd (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39899 mgrsb-fin root rtd unknown /proc/39758/task/39899/root (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39899 mgrsb-fin root txt unknown /proc/39758/task/39899/exe (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39899 mgrsb-fin root NOFD /proc/39758/task/39899/fd (opendir: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39900 ms_dispat root cwd unknown /proc/39758/task/39900/cwd (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39900 ms_dispat root rtd unknown /proc/39758/task/39900/root (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39900 ms_dispat root txt unknown /proc/39758/task/39900/exe (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39900 ms_dispat root NOFD /proc/39758/task/39900/fd (opendir: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39901 ms_local root cwd unknown /proc/39758/task/39901/cwd (readlink: Permission denied) 2024-04-26T12:33:19.083 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39901 ms_local root rtd unknown /proc/39758/task/39901/root (readlink: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39901 ms_local root txt unknown /proc/39758/task/39901/exe (readlink: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39901 ms_local root NOFD /proc/39758/task/39901/fd (opendir: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39902 io_contex root cwd unknown /proc/39758/task/39902/cwd (readlink: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39902 io_contex root rtd unknown /proc/39758/task/39902/root (readlink: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39902 io_contex root txt unknown /proc/39758/task/39902/exe (readlink: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39902 io_contex root NOFD /proc/39758/task/39902/fd (opendir: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39903 io_contex root cwd unknown /proc/39758/task/39903/cwd (readlink: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39903 io_contex root rtd unknown /proc/39758/task/39903/root (readlink: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39903 io_contex root txt unknown /proc/39758/task/39903/exe (readlink: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39903 io_contex root NOFD /proc/39758/task/39903/fd (opendir: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39904 safe_time root cwd unknown /proc/39758/task/39904/cwd (readlink: Permission denied) 2024-04-26T12:33:19.084 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39904 safe_time root rtd unknown /proc/39758/task/39904/root (readlink: Permission denied) 2024-04-26T12:33:19.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39904 safe_time root txt unknown /proc/39758/task/39904/exe (readlink: Permission denied) 2024-04-26T12:33:19.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39904 safe_time root NOFD /proc/39758/task/39904/fd (opendir: Permission denied) 2024-04-26T12:33:19.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39905 safe_time root cwd unknown /proc/39758/task/39905/cwd (readlink: Permission denied) 2024-04-26T12:33:19.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39905 safe_time root rtd unknown /proc/39758/task/39905/root (readlink: Permission denied) 2024-04-26T12:33:19.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39905 safe_time root txt unknown /proc/39758/task/39905/exe (readlink: Permission denied) 2024-04-26T12:33:19.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39905 safe_time root NOFD /proc/39758/task/39905/fd (opendir: Permission denied) 2024-04-26T12:33:19.085 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39906 safe_time root cwd unknown /proc/39758/task/39906/cwd (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39906 safe_time root rtd unknown /proc/39758/task/39906/root (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39906 safe_time root txt unknown /proc/39758/task/39906/exe (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39906 safe_time root NOFD /proc/39758/task/39906/fd (opendir: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39907 fn_anonym root cwd unknown /proc/39758/task/39907/cwd (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39907 fn_anonym root rtd unknown /proc/39758/task/39907/root (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39907 fn_anonym root txt unknown /proc/39758/task/39907/exe (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39907 fn_anonym root NOFD /proc/39758/task/39907/fd (opendir: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39908 flusher root cwd unknown /proc/39758/task/39908/cwd (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39908 flusher root rtd unknown /proc/39758/task/39908/root (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39908 flusher root txt unknown /proc/39758/task/39908/exe (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39908 flusher root NOFD /proc/39758/task/39908/fd (opendir: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39909 safe_time root cwd unknown /proc/39758/task/39909/cwd (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39909 safe_time root rtd unknown /proc/39758/task/39909/root (readlink: Permission denied) 2024-04-26T12:33:19.086 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39909 safe_time root txt unknown /proc/39758/task/39909/exe (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 39909 safe_time root NOFD /proc/39758/task/39909/fd (opendir: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40156 mgr-fin root cwd unknown /proc/39758/task/40156/cwd (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40156 mgr-fin root rtd unknown /proc/39758/task/40156/root (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40156 mgr-fin root txt unknown /proc/39758/task/40156/exe (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40156 mgr-fin root NOFD /proc/39758/task/40156/fd (opendir: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40157 ms_dispat root cwd unknown /proc/39758/task/40157/cwd (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40157 ms_dispat root rtd unknown /proc/39758/task/40157/root (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40157 ms_dispat root txt unknown /proc/39758/task/40157/exe (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40157 ms_dispat root NOFD /proc/39758/task/40157/fd (opendir: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40158 ms_local root cwd unknown /proc/39758/task/40158/cwd (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40158 ms_local root rtd unknown /proc/39758/task/40158/root (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40158 ms_local root txt unknown /proc/39758/task/40158/exe (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40158 ms_local root NOFD /proc/39758/task/40158/fd (opendir: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40159 safe_time root cwd unknown /proc/39758/task/40159/cwd (readlink: Permission denied) 2024-04-26T12:33:19.087 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40159 safe_time root rtd unknown /proc/39758/task/40159/root (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40159 safe_time root txt unknown /proc/39758/task/40159/exe (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40159 safe_time root NOFD /proc/39758/task/40159/fd (opendir: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40160 cmdfin root cwd unknown /proc/39758/task/40160/cwd (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40160 cmdfin root rtd unknown /proc/39758/task/40160/root (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40160 cmdfin root txt unknown /proc/39758/task/40160/exe (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40160 cmdfin root NOFD /proc/39758/task/40160/fd (opendir: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40164 io_contex root cwd unknown /proc/39758/task/40164/cwd (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40164 io_contex root rtd unknown /proc/39758/task/40164/root (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40164 io_contex root txt unknown /proc/39758/task/40164/exe (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40164 io_contex root NOFD /proc/39758/task/40164/fd (opendir: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40165 io_contex root cwd unknown /proc/39758/task/40165/cwd (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40165 io_contex root rtd unknown /proc/39758/task/40165/root (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40165 io_contex root txt unknown /proc/39758/task/40165/exe (readlink: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40165 io_contex root NOFD /proc/39758/task/40165/fd (opendir: Permission denied) 2024-04-26T12:33:19.088 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40166 ceph_time root cwd unknown /proc/39758/task/40166/cwd (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40166 ceph_time root rtd unknown /proc/39758/task/40166/root (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40166 ceph_time root txt unknown /proc/39758/task/40166/exe (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40166 ceph_time root NOFD /proc/39758/task/40166/fd (opendir: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40167 ms_dispat root cwd unknown /proc/39758/task/40167/cwd (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40167 ms_dispat root rtd unknown /proc/39758/task/40167/root (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40167 ms_dispat root txt unknown /proc/39758/task/40167/exe (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40167 ms_dispat root NOFD /proc/39758/task/40167/fd (opendir: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40168 ms_local root cwd unknown /proc/39758/task/40168/cwd (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40168 ms_local root rtd unknown /proc/39758/task/40168/root (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40168 ms_local root txt unknown /proc/39758/task/40168/exe (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40168 ms_local root NOFD /proc/39758/task/40168/fd (opendir: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40169 safe_time root cwd unknown /proc/39758/task/40169/cwd (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40169 safe_time root rtd unknown /proc/39758/task/40169/root (readlink: Permission denied) 2024-04-26T12:33:19.089 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40169 safe_time root txt unknown /proc/39758/task/40169/exe (readlink: Permission denied) 2024-04-26T12:33:19.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40169 safe_time root NOFD /proc/39758/task/40169/fd (opendir: Permission denied) 2024-04-26T12:33:19.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40170 safe_time root cwd unknown /proc/39758/task/40170/cwd (readlink: Permission denied) 2024-04-26T12:33:19.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40170 safe_time root rtd unknown /proc/39758/task/40170/root (readlink: Permission denied) 2024-04-26T12:33:19.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40170 safe_time root txt unknown /proc/39758/task/40170/exe (readlink: Permission denied) 2024-04-26T12:33:19.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40170 safe_time root NOFD /proc/39758/task/40170/fd (opendir: Permission denied) 2024-04-26T12:33:19.090 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40171 balancer root cwd unknown /proc/39758/task/40171/cwd (readlink: Permission denied) 2024-04-26T12:33:19.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40171 balancer root rtd unknown /proc/39758/task/40171/root (readlink: Permission denied) 2024-04-26T12:33:19.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40171 balancer root txt unknown /proc/39758/task/40171/exe (readlink: Permission denied) 2024-04-26T12:33:19.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40171 balancer root NOFD /proc/39758/task/40171/fd (opendir: Permission denied) 2024-04-26T12:33:19.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40172 m-fin-bal root cwd unknown /proc/39758/task/40172/cwd (readlink: Permission denied) 2024-04-26T12:33:19.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40172 m-fin-bal root rtd unknown /proc/39758/task/40172/root (readlink: Permission denied) 2024-04-26T12:33:19.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40172 m-fin-bal root txt unknown /proc/39758/task/40172/exe (readlink: Permission denied) 2024-04-26T12:33:19.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40172 m-fin-bal root NOFD /proc/39758/task/40172/fd (opendir: Permission denied) 2024-04-26T12:33:19.091 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40173 crash root cwd unknown /proc/39758/task/40173/cwd (readlink: Permission denied) 2024-04-26T12:33:19.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40173 crash root rtd unknown /proc/39758/task/40173/root (readlink: Permission denied) 2024-04-26T12:33:19.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40173 crash root txt unknown /proc/39758/task/40173/exe (readlink: Permission denied) 2024-04-26T12:33:19.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40173 crash root NOFD /proc/39758/task/40173/fd (opendir: Permission denied) 2024-04-26T12:33:19.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40174 m-fin-cra root cwd unknown /proc/39758/task/40174/cwd (readlink: Permission denied) 2024-04-26T12:33:19.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40174 m-fin-cra root rtd unknown /proc/39758/task/40174/root (readlink: Permission denied) 2024-04-26T12:33:19.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40174 m-fin-cra root txt unknown /proc/39758/task/40174/exe (readlink: Permission denied) 2024-04-26T12:33:19.092 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40174 m-fin-cra root NOFD /proc/39758/task/40174/fd (opendir: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40175 devicehea root cwd unknown /proc/39758/task/40175/cwd (readlink: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40175 devicehea root rtd unknown /proc/39758/task/40175/root (readlink: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40175 devicehea root txt unknown /proc/39758/task/40175/exe (readlink: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40175 devicehea root NOFD /proc/39758/task/40175/fd (opendir: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40176 m-fin-dev root cwd unknown /proc/39758/task/40176/cwd (readlink: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40176 m-fin-dev root rtd unknown /proc/39758/task/40176/root (readlink: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40176 m-fin-dev root txt unknown /proc/39758/task/40176/exe (readlink: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40176 m-fin-dev root NOFD /proc/39758/task/40176/fd (opendir: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40178 m-fin-ios root cwd unknown /proc/39758/task/40178/cwd (readlink: Permission denied) 2024-04-26T12:33:19.093 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40178 m-fin-ios root rtd unknown /proc/39758/task/40178/root (readlink: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40178 m-fin-ios root txt unknown /proc/39758/task/40178/exe (readlink: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40178 m-fin-ios root NOFD /proc/39758/task/40178/fd (opendir: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40180 m-fin-nfs root cwd unknown /proc/39758/task/40180/cwd (readlink: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40180 m-fin-nfs root rtd unknown /proc/39758/task/40180/root (readlink: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40180 m-fin-nfs root txt unknown /proc/39758/task/40180/exe (readlink: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40180 m-fin-nfs root NOFD /proc/39758/task/40180/fd (opendir: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40182 m-fin-orc root cwd unknown /proc/39758/task/40182/cwd (readlink: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40182 m-fin-orc root rtd unknown /proc/39758/task/40182/root (readlink: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40182 m-fin-orc root txt unknown /proc/39758/task/40182/exe (readlink: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40182 m-fin-orc root NOFD /proc/39758/task/40182/fd (opendir: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40183 pg_autosc root cwd unknown /proc/39758/task/40183/cwd (readlink: Permission denied) 2024-04-26T12:33:19.094 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40183 pg_autosc root rtd unknown /proc/39758/task/40183/root (readlink: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40183 pg_autosc root txt unknown /proc/39758/task/40183/exe (readlink: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40183 pg_autosc root NOFD /proc/39758/task/40183/fd (opendir: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40184 m-fin-pg_ root cwd unknown /proc/39758/task/40184/cwd (readlink: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40184 m-fin-pg_ root rtd unknown /proc/39758/task/40184/root (readlink: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40184 m-fin-pg_ root txt unknown /proc/39758/task/40184/exe (readlink: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40184 m-fin-pg_ root NOFD /proc/39758/task/40184/fd (opendir: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40185 progress root cwd unknown /proc/39758/task/40185/cwd (readlink: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40185 progress root rtd unknown /proc/39758/task/40185/root (readlink: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40185 progress root txt unknown /proc/39758/task/40185/exe (readlink: Permission denied) 2024-04-26T12:33:19.095 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40185 progress root NOFD /proc/39758/task/40185/fd (opendir: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40186 m-fin-pro root cwd unknown /proc/39758/task/40186/cwd (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40186 m-fin-pro root rtd unknown /proc/39758/task/40186/root (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40186 m-fin-pro root txt unknown /proc/39758/task/40186/exe (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40186 m-fin-pro root NOFD /proc/39758/task/40186/fd (opendir: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40190 io_contex root cwd unknown /proc/39758/task/40190/cwd (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40190 io_contex root rtd unknown /proc/39758/task/40190/root (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40190 io_contex root txt unknown /proc/39758/task/40190/exe (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40190 io_contex root NOFD /proc/39758/task/40190/fd (opendir: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40191 io_contex root cwd unknown /proc/39758/task/40191/cwd (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40191 io_contex root rtd unknown /proc/39758/task/40191/root (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40191 io_contex root txt unknown /proc/39758/task/40191/exe (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40191 io_contex root NOFD /proc/39758/task/40191/fd (opendir: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40192 ceph_time root cwd unknown /proc/39758/task/40192/cwd (readlink: Permission denied) 2024-04-26T12:33:19.096 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40192 ceph_time root rtd unknown /proc/39758/task/40192/root (readlink: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40192 ceph_time root txt unknown /proc/39758/task/40192/exe (readlink: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40192 ceph_time root NOFD /proc/39758/task/40192/fd (opendir: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40193 ms_dispat root cwd unknown /proc/39758/task/40193/cwd (readlink: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40193 ms_dispat root rtd unknown /proc/39758/task/40193/root (readlink: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40193 ms_dispat root txt unknown /proc/39758/task/40193/exe (readlink: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40193 ms_dispat root NOFD /proc/39758/task/40193/fd (opendir: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40194 ms_local root cwd unknown /proc/39758/task/40194/cwd (readlink: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40194 ms_local root rtd unknown /proc/39758/task/40194/root (readlink: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40194 ms_local root txt unknown /proc/39758/task/40194/exe (readlink: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40194 ms_local root NOFD /proc/39758/task/40194/fd (opendir: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40195 safe_time root cwd unknown /proc/39758/task/40195/cwd (readlink: Permission denied) 2024-04-26T12:33:19.097 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40195 safe_time root rtd unknown /proc/39758/task/40195/root (readlink: Permission denied) 2024-04-26T12:33:19.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40195 safe_time root txt unknown /proc/39758/task/40195/exe (readlink: Permission denied) 2024-04-26T12:33:19.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40195 safe_time root NOFD /proc/39758/task/40195/fd (opendir: Permission denied) 2024-04-26T12:33:19.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40196 safe_time root cwd unknown /proc/39758/task/40196/cwd (readlink: Permission denied) 2024-04-26T12:33:19.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40196 safe_time root rtd unknown /proc/39758/task/40196/root (readlink: Permission denied) 2024-04-26T12:33:19.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40196 safe_time root txt unknown /proc/39758/task/40196/exe (readlink: Permission denied) 2024-04-26T12:33:19.098 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40196 safe_time root NOFD /proc/39758/task/40196/fd (opendir: Permission denied) 2024-04-26T12:33:19.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40197 mgr-fin root cwd unknown /proc/39758/task/40197/cwd (readlink: Permission denied) 2024-04-26T12:33:19.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40197 mgr-fin root rtd unknown /proc/39758/task/40197/root (readlink: Permission denied) 2024-04-26T12:33:19.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40197 mgr-fin root txt unknown /proc/39758/task/40197/exe (readlink: Permission denied) 2024-04-26T12:33:19.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40197 mgr-fin root NOFD /proc/39758/task/40197/fd (opendir: Permission denied) 2024-04-26T12:33:19.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40199 m-fin-rbd root cwd unknown /proc/39758/task/40199/cwd (readlink: Permission denied) 2024-04-26T12:33:19.099 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40199 m-fin-rbd root rtd unknown /proc/39758/task/40199/root (readlink: Permission denied) 2024-04-26T12:33:19.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40199 m-fin-rbd root txt unknown /proc/39758/task/40199/exe (readlink: Permission denied) 2024-04-26T12:33:19.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40199 m-fin-rbd root NOFD /proc/39758/task/40199/fd (opendir: Permission denied) 2024-04-26T12:33:19.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40200 restful root cwd unknown /proc/39758/task/40200/cwd (readlink: Permission denied) 2024-04-26T12:33:19.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40200 restful root rtd unknown /proc/39758/task/40200/root (readlink: Permission denied) 2024-04-26T12:33:19.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40200 restful root txt unknown /proc/39758/task/40200/exe (readlink: Permission denied) 2024-04-26T12:33:19.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40200 restful root NOFD /proc/39758/task/40200/fd (opendir: Permission denied) 2024-04-26T12:33:19.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40201 m-fin-res root cwd unknown /proc/39758/task/40201/cwd (readlink: Permission denied) 2024-04-26T12:33:19.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40201 m-fin-res root rtd unknown /proc/39758/task/40201/root (readlink: Permission denied) 2024-04-26T12:33:19.100 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40201 m-fin-res root txt unknown /proc/39758/task/40201/exe (readlink: Permission denied) 2024-04-26T12:33:19.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40201 m-fin-res root NOFD /proc/39758/task/40201/fd (opendir: Permission denied) 2024-04-26T12:33:19.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40203 m-fin-sta root cwd unknown /proc/39758/task/40203/cwd (readlink: Permission denied) 2024-04-26T12:33:19.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40203 m-fin-sta root rtd unknown /proc/39758/task/40203/root (readlink: Permission denied) 2024-04-26T12:33:19.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40203 m-fin-sta root txt unknown /proc/39758/task/40203/exe (readlink: Permission denied) 2024-04-26T12:33:19.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40203 m-fin-sta root NOFD /proc/39758/task/40203/fd (opendir: Permission denied) 2024-04-26T12:33:19.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40204 telemetry root cwd unknown /proc/39758/task/40204/cwd (readlink: Permission denied) 2024-04-26T12:33:19.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40204 telemetry root rtd unknown /proc/39758/task/40204/root (readlink: Permission denied) 2024-04-26T12:33:19.101 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40204 telemetry root txt unknown /proc/39758/task/40204/exe (readlink: Permission denied) 2024-04-26T12:33:19.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40204 telemetry root NOFD /proc/39758/task/40204/fd (opendir: Permission denied) 2024-04-26T12:33:19.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40205 m-fin-tel root cwd unknown /proc/39758/task/40205/cwd (readlink: Permission denied) 2024-04-26T12:33:19.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40205 m-fin-tel root rtd unknown /proc/39758/task/40205/root (readlink: Permission denied) 2024-04-26T12:33:19.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40205 m-fin-tel root txt unknown /proc/39758/task/40205/exe (readlink: Permission denied) 2024-04-26T12:33:19.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40205 m-fin-tel root NOFD /proc/39758/task/40205/fd (opendir: Permission denied) 2024-04-26T12:33:19.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40206 mgr-fin root cwd unknown /proc/39758/task/40206/cwd (readlink: Permission denied) 2024-04-26T12:33:19.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40206 mgr-fin root rtd unknown /proc/39758/task/40206/root (readlink: Permission denied) 2024-04-26T12:33:19.102 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40206 mgr-fin root txt unknown /proc/39758/task/40206/exe (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40206 mgr-fin root NOFD /proc/39758/task/40206/fd (opendir: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40207 mgr-fin root cwd unknown /proc/39758/task/40207/cwd (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40207 mgr-fin root rtd unknown /proc/39758/task/40207/root (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40207 mgr-fin root txt unknown /proc/39758/task/40207/exe (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40207 mgr-fin root NOFD /proc/39758/task/40207/fd (opendir: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40208 mgr-fin root cwd unknown /proc/39758/task/40208/cwd (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40208 mgr-fin root rtd unknown /proc/39758/task/40208/root (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40208 mgr-fin root txt unknown /proc/39758/task/40208/exe (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40208 mgr-fin root NOFD /proc/39758/task/40208/fd (opendir: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40209 mgr-fin root cwd unknown /proc/39758/task/40209/cwd (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40209 mgr-fin root rtd unknown /proc/39758/task/40209/root (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40209 mgr-fin root txt unknown /proc/39758/task/40209/exe (readlink: Permission denied) 2024-04-26T12:33:19.103 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40209 mgr-fin root NOFD /proc/39758/task/40209/fd (opendir: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40213 io_contex root cwd unknown /proc/39758/task/40213/cwd (readlink: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40213 io_contex root rtd unknown /proc/39758/task/40213/root (readlink: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40213 io_contex root txt unknown /proc/39758/task/40213/exe (readlink: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40213 io_contex root NOFD /proc/39758/task/40213/fd (opendir: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40214 io_contex root cwd unknown /proc/39758/task/40214/cwd (readlink: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40214 io_contex root rtd unknown /proc/39758/task/40214/root (readlink: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40214 io_contex root txt unknown /proc/39758/task/40214/exe (readlink: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40214 io_contex root NOFD /proc/39758/task/40214/fd (opendir: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40215 ceph_time root cwd unknown /proc/39758/task/40215/cwd (readlink: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40215 ceph_time root rtd unknown /proc/39758/task/40215/root (readlink: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40215 ceph_time root txt unknown /proc/39758/task/40215/exe (readlink: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40215 ceph_time root NOFD /proc/39758/task/40215/fd (opendir: Permission denied) 2024-04-26T12:33:19.104 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40216 ms_dispat root cwd unknown /proc/39758/task/40216/cwd (readlink: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40216 ms_dispat root rtd unknown /proc/39758/task/40216/root (readlink: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40216 ms_dispat root txt unknown /proc/39758/task/40216/exe (readlink: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40216 ms_dispat root NOFD /proc/39758/task/40216/fd (opendir: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40217 ms_local root cwd unknown /proc/39758/task/40217/cwd (readlink: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40217 ms_local root rtd unknown /proc/39758/task/40217/root (readlink: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40217 ms_local root txt unknown /proc/39758/task/40217/exe (readlink: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40217 ms_local root NOFD /proc/39758/task/40217/fd (opendir: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40218 safe_time root cwd unknown /proc/39758/task/40218/cwd (readlink: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40218 safe_time root rtd unknown /proc/39758/task/40218/root (readlink: Permission denied) 2024-04-26T12:33:19.105 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40218 safe_time root txt unknown /proc/39758/task/40218/exe (readlink: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40218 safe_time root NOFD /proc/39758/task/40218/fd (opendir: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40219 safe_time root cwd unknown /proc/39758/task/40219/cwd (readlink: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40219 safe_time root rtd unknown /proc/39758/task/40219/root (readlink: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40219 safe_time root txt unknown /proc/39758/task/40219/exe (readlink: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40219 safe_time root NOFD /proc/39758/task/40219/fd (opendir: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40220 mgr-fin root cwd unknown /proc/39758/task/40220/cwd (readlink: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40220 mgr-fin root rtd unknown /proc/39758/task/40220/root (readlink: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40220 mgr-fin root txt unknown /proc/39758/task/40220/exe (readlink: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40220 mgr-fin root NOFD /proc/39758/task/40220/fd (opendir: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40221 mgr-fin root cwd unknown /proc/39758/task/40221/cwd (readlink: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40221 mgr-fin root rtd unknown /proc/39758/task/40221/root (readlink: Permission denied) 2024-04-26T12:33:19.106 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40221 mgr-fin root txt unknown /proc/39758/task/40221/exe (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40221 mgr-fin root NOFD /proc/39758/task/40221/fd (opendir: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40222 mgr-fin root cwd unknown /proc/39758/task/40222/cwd (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40222 mgr-fin root rtd unknown /proc/39758/task/40222/root (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40222 mgr-fin root txt unknown /proc/39758/task/40222/exe (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40222 mgr-fin root NOFD /proc/39758/task/40222/fd (opendir: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40223 mgr-fin root cwd unknown /proc/39758/task/40223/cwd (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40223 mgr-fin root rtd unknown /proc/39758/task/40223/root (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40223 mgr-fin root txt unknown /proc/39758/task/40223/exe (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40223 mgr-fin root NOFD /proc/39758/task/40223/fd (opendir: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40224 mgr-fin root cwd unknown /proc/39758/task/40224/cwd (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40224 mgr-fin root rtd unknown /proc/39758/task/40224/root (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40224 mgr-fin root txt unknown /proc/39758/task/40224/exe (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40224 mgr-fin root NOFD /proc/39758/task/40224/fd (opendir: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40225 mgr-fin root cwd unknown /proc/39758/task/40225/cwd (readlink: Permission denied) 2024-04-26T12:33:19.107 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40225 mgr-fin root rtd unknown /proc/39758/task/40225/root (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40225 mgr-fin root txt unknown /proc/39758/task/40225/exe (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40225 mgr-fin root NOFD /proc/39758/task/40225/fd (opendir: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40226 mgr-fin root cwd unknown /proc/39758/task/40226/cwd (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40226 mgr-fin root rtd unknown /proc/39758/task/40226/root (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40226 mgr-fin root txt unknown /proc/39758/task/40226/exe (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40226 mgr-fin root NOFD /proc/39758/task/40226/fd (opendir: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40227 mgr-fin root cwd unknown /proc/39758/task/40227/cwd (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40227 mgr-fin root rtd unknown /proc/39758/task/40227/root (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40227 mgr-fin root txt unknown /proc/39758/task/40227/exe (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40227 mgr-fin root NOFD /proc/39758/task/40227/fd (opendir: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40228 mgr-fin root cwd unknown /proc/39758/task/40228/cwd (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40228 mgr-fin root rtd unknown /proc/39758/task/40228/root (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40228 mgr-fin root txt unknown /proc/39758/task/40228/exe (readlink: Permission denied) 2024-04-26T12:33:19.108 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40228 mgr-fin root NOFD /proc/39758/task/40228/fd (opendir: Permission denied) 2024-04-26T12:33:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40229 mgr-fin root cwd unknown /proc/39758/task/40229/cwd (readlink: Permission denied) 2024-04-26T12:33:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40229 mgr-fin root rtd unknown /proc/39758/task/40229/root (readlink: Permission denied) 2024-04-26T12:33:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40229 mgr-fin root txt unknown /proc/39758/task/40229/exe (readlink: Permission denied) 2024-04-26T12:33:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40229 mgr-fin root NOFD /proc/39758/task/40229/fd (opendir: Permission denied) 2024-04-26T12:33:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40230 mgr-fin root cwd unknown /proc/39758/task/40230/cwd (readlink: Permission denied) 2024-04-26T12:33:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40230 mgr-fin root rtd unknown /proc/39758/task/40230/root (readlink: Permission denied) 2024-04-26T12:33:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40230 mgr-fin root txt unknown /proc/39758/task/40230/exe (readlink: Permission denied) 2024-04-26T12:33:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40230 mgr-fin root NOFD /proc/39758/task/40230/fd (opendir: Permission denied) 2024-04-26T12:33:19.109 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40231 mgr-fin root cwd unknown /proc/39758/task/40231/cwd (readlink: Permission denied) 2024-04-26T12:33:19.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40231 mgr-fin root rtd unknown /proc/39758/task/40231/root (readlink: Permission denied) 2024-04-26T12:33:19.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40231 mgr-fin root txt unknown /proc/39758/task/40231/exe (readlink: Permission denied) 2024-04-26T12:33:19.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40231 mgr-fin root NOFD /proc/39758/task/40231/fd (opendir: Permission denied) 2024-04-26T12:33:19.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40233 m-fin-vol root cwd unknown /proc/39758/task/40233/cwd (readlink: Permission denied) 2024-04-26T12:33:19.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40233 m-fin-vol root rtd unknown /proc/39758/task/40233/root (readlink: Permission denied) 2024-04-26T12:33:19.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40233 m-fin-vol root txt unknown /proc/39758/task/40233/exe (readlink: Permission denied) 2024-04-26T12:33:19.110 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40233 m-fin-vol root NOFD /proc/39758/task/40233/fd (opendir: Permission denied) 2024-04-26T12:33:19.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40234 mgr-fin root cwd unknown /proc/39758/task/40234/cwd (readlink: Permission denied) 2024-04-26T12:33:19.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40234 mgr-fin root rtd unknown /proc/39758/task/40234/root (readlink: Permission denied) 2024-04-26T12:33:19.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40234 mgr-fin root txt unknown /proc/39758/task/40234/exe (readlink: Permission denied) 2024-04-26T12:33:19.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40234 mgr-fin root NOFD /proc/39758/task/40234/fd (opendir: Permission denied) 2024-04-26T12:33:19.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40371 devicehea root cwd unknown /proc/39758/task/40371/cwd (readlink: Permission denied) 2024-04-26T12:33:19.111 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40371 devicehea root rtd unknown /proc/39758/task/40371/root (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40371 devicehea root txt unknown /proc/39758/task/40371/exe (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40371 devicehea root NOFD /proc/39758/task/40371/fd (opendir: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40439 io_contex root cwd unknown /proc/39758/task/40439/cwd (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40439 io_contex root rtd unknown /proc/39758/task/40439/root (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40439 io_contex root txt unknown /proc/39758/task/40439/exe (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40439 io_contex root NOFD /proc/39758/task/40439/fd (opendir: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40440 io_contex root cwd unknown /proc/39758/task/40440/cwd (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40440 io_contex root rtd unknown /proc/39758/task/40440/root (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40440 io_contex root txt unknown /proc/39758/task/40440/exe (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40440 io_contex root NOFD /proc/39758/task/40440/fd (opendir: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40441 ceph_time root cwd unknown /proc/39758/task/40441/cwd (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40441 ceph_time root rtd unknown /proc/39758/task/40441/root (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40441 ceph_time root txt unknown /proc/39758/task/40441/exe (readlink: Permission denied) 2024-04-26T12:33:19.112 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40441 ceph_time root NOFD /proc/39758/task/40441/fd (opendir: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40442 ms_dispat root cwd unknown /proc/39758/task/40442/cwd (readlink: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40442 ms_dispat root rtd unknown /proc/39758/task/40442/root (readlink: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40442 ms_dispat root txt unknown /proc/39758/task/40442/exe (readlink: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40442 ms_dispat root NOFD /proc/39758/task/40442/fd (opendir: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40443 ms_local root cwd unknown /proc/39758/task/40443/cwd (readlink: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40443 ms_local root rtd unknown /proc/39758/task/40443/root (readlink: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40443 ms_local root txt unknown /proc/39758/task/40443/exe (readlink: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40443 ms_local root NOFD /proc/39758/task/40443/fd (opendir: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40444 safe_time root cwd unknown /proc/39758/task/40444/cwd (readlink: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40444 safe_time root rtd unknown /proc/39758/task/40444/root (readlink: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40444 safe_time root txt unknown /proc/39758/task/40444/exe (readlink: Permission denied) 2024-04-26T12:33:19.113 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40444 safe_time root NOFD /proc/39758/task/40444/fd (opendir: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40445 safe_time root cwd unknown /proc/39758/task/40445/cwd (readlink: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40445 safe_time root rtd unknown /proc/39758/task/40445/root (readlink: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40445 safe_time root txt unknown /proc/39758/task/40445/exe (readlink: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mgr 39758 40445 safe_time root NOFD /proc/39758/task/40445/fd (opendir: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 40372 root cwd unknown /proc/40372/cwd (readlink: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 40372 root rtd unknown /proc/40372/root (readlink: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 40372 root txt unknown /proc/40372/exe (readlink: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 40372 root NOFD /proc/40372/fd (opendir: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 40412 root cwd unknown /proc/40412/cwd (readlink: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 40412 root rtd unknown /proc/40412/root (readlink: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 40412 root txt unknown /proc/40412/exe (readlink: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 40412 root NOFD /proc/40412/fd (opendir: Permission denied) 2024-04-26T12:33:19.114 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 root cwd unknown /proc/40417/cwd (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 root rtd unknown /proc/40417/root (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 root txt unknown /proc/40417/exe (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 root NOFD /proc/40417/fd (opendir: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40418 log root cwd unknown /proc/40417/task/40418/cwd (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40418 log root rtd unknown /proc/40417/task/40418/root (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40418 log root txt unknown /proc/40417/task/40418/exe (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40418 log root NOFD /proc/40417/task/40418/fd (opendir: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40420 msgr-work root cwd unknown /proc/40417/task/40420/cwd (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40420 msgr-work root rtd unknown /proc/40417/task/40420/root (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40420 msgr-work root txt unknown /proc/40417/task/40420/exe (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40420 msgr-work root NOFD /proc/40417/task/40420/fd (opendir: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40421 msgr-work root cwd unknown /proc/40417/task/40421/cwd (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40421 msgr-work root rtd unknown /proc/40417/task/40421/root (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40421 msgr-work root txt unknown /proc/40417/task/40421/exe (readlink: Permission denied) 2024-04-26T12:33:19.115 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40421 msgr-work root NOFD /proc/40417/task/40421/fd (opendir: Permission denied) 2024-04-26T12:33:19.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40422 msgr-work root cwd unknown /proc/40417/task/40422/cwd (readlink: Permission denied) 2024-04-26T12:33:19.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40422 msgr-work root rtd unknown /proc/40417/task/40422/root (readlink: Permission denied) 2024-04-26T12:33:19.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40422 msgr-work root txt unknown /proc/40417/task/40422/exe (readlink: Permission denied) 2024-04-26T12:33:19.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40422 msgr-work root NOFD /proc/40417/task/40422/fd (opendir: Permission denied) 2024-04-26T12:33:19.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40426 service root cwd unknown /proc/40417/task/40426/cwd (readlink: Permission denied) 2024-04-26T12:33:19.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40426 service root rtd unknown /proc/40417/task/40426/root (readlink: Permission denied) 2024-04-26T12:33:19.116 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40426 service root txt unknown /proc/40417/task/40426/exe (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40426 service root NOFD /proc/40417/task/40426/fd (opendir: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40427 admin_soc root cwd unknown /proc/40417/task/40427/cwd (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40427 admin_soc root rtd unknown /proc/40417/task/40427/root (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40427 admin_soc root txt unknown /proc/40417/task/40427/exe (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40427 admin_soc root NOFD /proc/40417/task/40427/fd (opendir: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40428 signal_ha root cwd unknown /proc/40417/task/40428/cwd (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40428 signal_ha root rtd unknown /proc/40417/task/40428/root (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40428 signal_ha root txt unknown /proc/40417/task/40428/exe (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40428 signal_ha root NOFD /proc/40417/task/40428/fd (opendir: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40429 io_contex root cwd unknown /proc/40417/task/40429/cwd (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40429 io_contex root rtd unknown /proc/40417/task/40429/root (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40429 io_contex root txt unknown /proc/40417/task/40429/exe (readlink: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40429 io_contex root NOFD /proc/40417/task/40429/fd (opendir: Permission denied) 2024-04-26T12:33:19.117 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40430 io_contex root cwd unknown /proc/40417/task/40430/cwd (readlink: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40430 io_contex root rtd unknown /proc/40417/task/40430/root (readlink: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40430 io_contex root txt unknown /proc/40417/task/40430/exe (readlink: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40430 io_contex root NOFD /proc/40417/task/40430/fd (opendir: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40431 ms_dispat root cwd unknown /proc/40417/task/40431/cwd (readlink: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40431 ms_dispat root rtd unknown /proc/40417/task/40431/root (readlink: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40431 ms_dispat root txt unknown /proc/40417/task/40431/exe (readlink: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40431 ms_dispat root NOFD /proc/40417/task/40431/fd (opendir: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40432 ms_local root cwd unknown /proc/40417/task/40432/cwd (readlink: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40432 ms_local root rtd unknown /proc/40417/task/40432/root (readlink: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40432 ms_local root txt unknown /proc/40417/task/40432/exe (readlink: Permission denied) 2024-04-26T12:33:19.118 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40432 ms_local root NOFD /proc/40417/task/40432/fd (opendir: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40433 safe_time root cwd unknown /proc/40417/task/40433/cwd (readlink: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40433 safe_time root rtd unknown /proc/40417/task/40433/root (readlink: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40433 safe_time root txt unknown /proc/40417/task/40433/exe (readlink: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40433 safe_time root NOFD /proc/40417/task/40433/fd (opendir: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40434 safe_time root cwd unknown /proc/40417/task/40434/cwd (readlink: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40434 safe_time root rtd unknown /proc/40417/task/40434/root (readlink: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40434 safe_time root txt unknown /proc/40417/task/40434/exe (readlink: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40434 safe_time root NOFD /proc/40417/task/40434/fd (opendir: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40435 ceph-mds root cwd unknown /proc/40417/task/40435/cwd (readlink: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40435 ceph-mds root rtd unknown /proc/40417/task/40435/root (readlink: Permission denied) 2024-04-26T12:33:19.119 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40435 ceph-mds root txt unknown /proc/40417/task/40435/exe (readlink: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40435 ceph-mds root NOFD /proc/40417/task/40435/fd (opendir: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40446 safe_time root cwd unknown /proc/40417/task/40446/cwd (readlink: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40446 safe_time root rtd unknown /proc/40417/task/40446/root (readlink: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40446 safe_time root txt unknown /proc/40417/task/40446/exe (readlink: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40446 safe_time root NOFD /proc/40417/task/40446/fd (opendir: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40957 ceph_time root cwd unknown /proc/40417/task/40957/cwd (readlink: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40957 ceph_time root rtd unknown /proc/40417/task/40957/root (readlink: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40957 ceph_time root txt unknown /proc/40417/task/40957/exe (readlink: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40957 ceph_time root NOFD /proc/40417/task/40957/fd (opendir: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40958 OpHistory root cwd unknown /proc/40417/task/40958/cwd (readlink: Permission denied) 2024-04-26T12:33:19.120 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40958 OpHistory root rtd unknown /proc/40417/task/40958/root (readlink: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40958 OpHistory root txt unknown /proc/40417/task/40958/exe (readlink: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40958 OpHistory root NOFD /proc/40417/task/40958/fd (opendir: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40959 ms_dispat root cwd unknown /proc/40417/task/40959/cwd (readlink: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40959 ms_dispat root rtd unknown /proc/40417/task/40959/root (readlink: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40959 ms_dispat root txt unknown /proc/40417/task/40959/exe (readlink: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40959 ms_dispat root NOFD /proc/40417/task/40959/fd (opendir: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40960 mds_rank_ root cwd unknown /proc/40417/task/40960/cwd (readlink: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40960 mds_rank_ root rtd unknown /proc/40417/task/40960/root (readlink: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40960 mds_rank_ root txt unknown /proc/40417/task/40960/exe (readlink: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40960 mds_rank_ root NOFD /proc/40417/task/40960/fd (opendir: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40961 PQ_Finish root cwd unknown /proc/40417/task/40961/cwd (readlink: Permission denied) 2024-04-26T12:33:19.121 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40961 PQ_Finish root rtd unknown /proc/40417/task/40961/root (readlink: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40961 PQ_Finish root txt unknown /proc/40417/task/40961/exe (readlink: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40961 PQ_Finish root NOFD /proc/40417/task/40961/fd (opendir: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40962 safe_time root cwd unknown /proc/40417/task/40962/cwd (readlink: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40962 safe_time root rtd unknown /proc/40417/task/40962/root (readlink: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40962 safe_time root txt unknown /proc/40417/task/40962/exe (readlink: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40962 safe_time root NOFD /proc/40417/task/40962/fd (opendir: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40963 MR_Finish root cwd unknown /proc/40417/task/40963/cwd (readlink: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40963 MR_Finish root rtd unknown /proc/40417/task/40963/root (readlink: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40963 MR_Finish root txt unknown /proc/40417/task/40963/exe (readlink: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40963 MR_Finish root NOFD /proc/40417/task/40963/fd (opendir: Permission denied) 2024-04-26T12:33:19.122 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40964 md_submit root cwd unknown /proc/40417/task/40964/cwd (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40964 md_submit root rtd unknown /proc/40417/task/40964/root (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40964 md_submit root txt unknown /proc/40417/task/40964/exe (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 40964 md_submit root NOFD /proc/40417/task/40964/fd (opendir: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 41102 ms_dispat root cwd unknown /proc/40417/task/41102/cwd (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 41102 ms_dispat root rtd unknown /proc/40417/task/41102/root (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 41102 ms_dispat root txt unknown /proc/40417/task/41102/exe (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 41102 ms_dispat root NOFD /proc/40417/task/41102/fd (opendir: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 41103 ms_dispat root cwd unknown /proc/40417/task/41103/cwd (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 41103 ms_dispat root rtd unknown /proc/40417/task/41103/root (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 41103 ms_dispat root txt unknown /proc/40417/task/41103/exe (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-mds 40417 41103 ms_dispat root NOFD /proc/40417/task/41103/fd (opendir: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 42759 root cwd unknown /proc/42759/cwd (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 42759 root rtd unknown /proc/42759/root (readlink: Permission denied) 2024-04-26T12:33:19.123 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 42759 root txt unknown /proc/42759/exe (readlink: Permission denied) 2024-04-26T12:33:19.124 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/u 42759 root NOFD /proc/42759/fd (opendir: Permission denied) 2024-04-26T12:33:19.124 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 43472 root cwd unknown /proc/43472/cwd (readlink: Permission denied) 2024-04-26T12:33:19.124 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 43472 root rtd unknown /proc/43472/root (readlink: Permission denied) 2024-04-26T12:33:19.124 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 43472 root txt unknown /proc/43472/exe (readlink: Permission denied) 2024-04-26T12:33:19.124 INFO:tasks.workunit.client.0.smithi038.stdout:kworker/1 43472 root NOFD /proc/43472/fd (opendir: Permission denied) 2024-04-26T12:33:19.124 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu cwd DIR 8,1 4096 73163 /home/ubuntu 2024-04-26T12:33:19.124 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu rtd DIR 8,1 4096 2 / 2024-04-26T12:33:19.124 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu txt REG 8,1 1150584 5206 /usr/bin/bash 2024-04-26T12:33:19.124 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 2586930 18369 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 187552 4894 /usr/lib64/libtinfo.so.6.1 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 54 18374 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 3316 18324 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 286 18408 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 57 18372 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 34 18389 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 77 18373 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 167 18405 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 59 18409 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 23 18407 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-26T12:33:19.125 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu mem REG 8,1 368 18406 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu 0r FIFO 0,13 0t0 253062 pipe 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu 1w FIFO 0,13 0t0 253063 pipe 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:bash 43838 ubuntu 2w FIFO 0,13 0t0 253064 pipe 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 43875 root cwd unknown /proc/43875/cwd (readlink: Permission denied) 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 43875 root rtd unknown /proc/43875/root (readlink: Permission denied) 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 43875 root txt unknown /proc/43875/exe (readlink: Permission denied) 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 43875 root NOFD /proc/43875/fd (opendir: Permission denied) 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 43879 root cwd unknown /proc/43879/cwd (readlink: Permission denied) 2024-04-26T12:33:19.126 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 43879 root rtd unknown /proc/43879/root (readlink: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 43879 root txt unknown /proc/43879/exe (readlink: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 43879 root NOFD /proc/43879/fd (opendir: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 43882 root cwd unknown /proc/43882/cwd (readlink: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 43882 root rtd unknown /proc/43882/root (readlink: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 43882 root txt unknown /proc/43882/exe (readlink: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:daemon-he 43882 root NOFD /proc/43882/fd (opendir: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 root cwd unknown /proc/43891/cwd (readlink: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 root rtd unknown /proc/43891/root (readlink: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 root txt unknown /proc/43891/exe (readlink: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 root NOFD /proc/43891/fd (opendir: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43905 log root cwd unknown /proc/43891/task/43905/cwd (readlink: Permission denied) 2024-04-26T12:33:19.127 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43905 log root rtd unknown /proc/43891/task/43905/root (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43905 log root txt unknown /proc/43891/task/43905/exe (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43905 log root NOFD /proc/43891/task/43905/fd (opendir: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43907 msgr-work root cwd unknown /proc/43891/task/43907/cwd (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43907 msgr-work root rtd unknown /proc/43891/task/43907/root (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43907 msgr-work root txt unknown /proc/43891/task/43907/exe (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43907 msgr-work root NOFD /proc/43891/task/43907/fd (opendir: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43908 msgr-work root cwd unknown /proc/43891/task/43908/cwd (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43908 msgr-work root rtd unknown /proc/43891/task/43908/root (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43908 msgr-work root txt unknown /proc/43891/task/43908/exe (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43908 msgr-work root NOFD /proc/43891/task/43908/fd (opendir: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43909 msgr-work root cwd unknown /proc/43891/task/43909/cwd (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43909 msgr-work root rtd unknown /proc/43891/task/43909/root (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43909 msgr-work root txt unknown /proc/43891/task/43909/exe (readlink: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43909 msgr-work root NOFD /proc/43891/task/43909/fd (opendir: Permission denied) 2024-04-26T12:33:19.128 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43914 service root cwd unknown /proc/43891/task/43914/cwd (readlink: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43914 service root rtd unknown /proc/43891/task/43914/root (readlink: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43914 service root txt unknown /proc/43891/task/43914/exe (readlink: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43914 service root NOFD /proc/43891/task/43914/fd (opendir: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43915 admin_soc root cwd unknown /proc/43891/task/43915/cwd (readlink: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43915 admin_soc root rtd unknown /proc/43891/task/43915/root (readlink: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43915 admin_soc root txt unknown /proc/43891/task/43915/exe (readlink: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43915 admin_soc root NOFD /proc/43891/task/43915/fd (opendir: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43916 signal_ha root cwd unknown /proc/43891/task/43916/cwd (readlink: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43916 signal_ha root rtd unknown /proc/43891/task/43916/root (readlink: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43916 signal_ha root txt unknown /proc/43891/task/43916/exe (readlink: Permission denied) 2024-04-26T12:33:19.129 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43916 signal_ha root NOFD /proc/43891/task/43916/fd (opendir: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43917 io_contex root cwd unknown /proc/43891/task/43917/cwd (readlink: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43917 io_contex root rtd unknown /proc/43891/task/43917/root (readlink: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43917 io_contex root txt unknown /proc/43891/task/43917/exe (readlink: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43917 io_contex root NOFD /proc/43891/task/43917/fd (opendir: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43918 io_contex root cwd unknown /proc/43891/task/43918/cwd (readlink: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43918 io_contex root rtd unknown /proc/43891/task/43918/root (readlink: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43918 io_contex root txt unknown /proc/43891/task/43918/exe (readlink: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43918 io_contex root NOFD /proc/43891/task/43918/fd (opendir: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43919 ceph_time root cwd unknown /proc/43891/task/43919/cwd (readlink: Permission denied) 2024-04-26T12:33:19.130 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43919 ceph_time root rtd unknown /proc/43891/task/43919/root (readlink: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43919 ceph_time root txt unknown /proc/43891/task/43919/exe (readlink: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43919 ceph_time root NOFD /proc/43891/task/43919/fd (opendir: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43920 fn_anonym root cwd unknown /proc/43891/task/43920/cwd (readlink: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43920 fn_anonym root rtd unknown /proc/43891/task/43920/root (readlink: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43920 fn_anonym root txt unknown /proc/43891/task/43920/exe (readlink: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43920 fn_anonym root NOFD /proc/43891/task/43920/fd (opendir: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43921 fn_anonym root cwd unknown /proc/43891/task/43921/cwd (readlink: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43921 fn_anonym root rtd unknown /proc/43891/task/43921/root (readlink: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43921 fn_anonym root txt unknown /proc/43891/task/43921/exe (readlink: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43921 fn_anonym root NOFD /proc/43891/task/43921/fd (opendir: Permission denied) 2024-04-26T12:33:19.131 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43922 fn_anonym root cwd unknown /proc/43891/task/43922/cwd (readlink: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43922 fn_anonym root rtd unknown /proc/43891/task/43922/root (readlink: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43922 fn_anonym root txt unknown /proc/43891/task/43922/exe (readlink: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43922 fn_anonym root NOFD /proc/43891/task/43922/fd (opendir: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43923 fn_anonym root cwd unknown /proc/43891/task/43923/cwd (readlink: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43923 fn_anonym root rtd unknown /proc/43891/task/43923/root (readlink: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43923 fn_anonym root txt unknown /proc/43891/task/43923/exe (readlink: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43923 fn_anonym root NOFD /proc/43891/task/43923/fd (opendir: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43924 fn_anonym root cwd unknown /proc/43891/task/43924/cwd (readlink: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43924 fn_anonym root rtd unknown /proc/43891/task/43924/root (readlink: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43924 fn_anonym root txt unknown /proc/43891/task/43924/exe (readlink: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43924 fn_anonym root NOFD /proc/43891/task/43924/fd (opendir: Permission denied) 2024-04-26T12:33:19.132 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43925 safe_time root cwd unknown /proc/43891/task/43925/cwd (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43925 safe_time root rtd unknown /proc/43891/task/43925/root (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43925 safe_time root txt unknown /proc/43891/task/43925/exe (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43925 safe_time root NOFD /proc/43891/task/43925/fd (opendir: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43926 fn_anonym root cwd unknown /proc/43891/task/43926/cwd (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43926 fn_anonym root rtd unknown /proc/43891/task/43926/root (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43926 fn_anonym root txt unknown /proc/43891/task/43926/exe (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43926 fn_anonym root NOFD /proc/43891/task/43926/fd (opendir: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43927 flusher root cwd unknown /proc/43891/task/43927/cwd (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43927 flusher root rtd unknown /proc/43891/task/43927/root (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43927 flusher root txt unknown /proc/43891/task/43927/exe (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43927 flusher root NOFD /proc/43891/task/43927/fd (opendir: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43928 ms_dispat root cwd unknown /proc/43891/task/43928/cwd (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43928 ms_dispat root rtd unknown /proc/43891/task/43928/root (readlink: Permission denied) 2024-04-26T12:33:19.133 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43928 ms_dispat root txt unknown /proc/43891/task/43928/exe (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43928 ms_dispat root NOFD /proc/43891/task/43928/fd (opendir: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43929 ms_local root cwd unknown /proc/43891/task/43929/cwd (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43929 ms_local root rtd unknown /proc/43891/task/43929/root (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43929 ms_local root txt unknown /proc/43891/task/43929/exe (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43929 ms_local root NOFD /proc/43891/task/43929/fd (opendir: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43930 safe_time root cwd unknown /proc/43891/task/43930/cwd (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43930 safe_time root rtd unknown /proc/43891/task/43930/root (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43930 safe_time root txt unknown /proc/43891/task/43930/exe (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43930 safe_time root NOFD /proc/43891/task/43930/fd (opendir: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43931 ceph-fuse root cwd unknown /proc/43891/task/43931/cwd (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43931 ceph-fuse root rtd unknown /proc/43891/task/43931/root (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43931 ceph-fuse root txt unknown /proc/43891/task/43931/exe (readlink: Permission denied) 2024-04-26T12:33:19.134 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43931 ceph-fuse root NOFD /proc/43891/task/43931/fd (opendir: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43933 ceph-fuse root cwd unknown /proc/43891/task/43933/cwd (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43933 ceph-fuse root rtd unknown /proc/43891/task/43933/root (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43933 ceph-fuse root txt unknown /proc/43891/task/43933/exe (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43933 ceph-fuse root NOFD /proc/43891/task/43933/fd (opendir: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43936 ceph-fuse root cwd unknown /proc/43891/task/43936/cwd (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43936 ceph-fuse root rtd unknown /proc/43891/task/43936/root (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43936 ceph-fuse root txt unknown /proc/43891/task/43936/exe (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 43936 ceph-fuse root NOFD /proc/43891/task/43936/fd (opendir: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 48009 ceph-fuse root cwd unknown /proc/43891/task/48009/cwd (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 48009 ceph-fuse root rtd unknown /proc/43891/task/48009/root (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 48009 ceph-fuse root txt unknown /proc/43891/task/48009/exe (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 48009 ceph-fuse root NOFD /proc/43891/task/48009/fd (opendir: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 48360 ceph-fuse root cwd unknown /proc/43891/task/48360/cwd (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 48360 ceph-fuse root rtd unknown /proc/43891/task/48360/root (readlink: Permission denied) 2024-04-26T12:33:19.135 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 48360 ceph-fuse root txt unknown /proc/43891/task/48360/exe (readlink: Permission denied) 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:ceph-fuse 43891 48360 ceph-fuse root NOFD /proc/43891/task/48360/fd (opendir: Permission denied) 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu cwd DIR 0,47 194249488 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu rtd DIR 8,1 4096 2 / 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu txt REG 8,1 42840 7406 /usr/bin/timeout 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 2586930 18369 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 42744 5185 /usr/lib64/librt-2.28.so 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 54 18374 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-26T12:33:19.136 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 3316 18324 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 286 18408 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 57 18372 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 34 18389 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 77 18373 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 167 18405 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 59 18409 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 23 18407 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu mem REG 8,1 368 18406 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-26T12:33:19.137 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu 0r FIFO 0,13 0t0 271425 pipe 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu 1w FIFO 0,13 0t0 271426 pipe 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 47986 ubuntu 2w FIFO 0,13 0t0 271427 pipe 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu cwd DIR 0,47 194249488 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu rtd DIR 8,1 4096 2 / 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu txt REG 8,1 1150584 5206 /usr/bin/bash 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 2586930 18369 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 187552 4894 /usr/lib64/libtinfo.so.6.1 2024-04-26T12:33:19.138 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 54 18374 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 3316 18324 /usr/lib/locale/en_US.utf8/LC_TIME 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 286 18408 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 57 18372 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 34 18389 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 77 18373 /usr/lib/locale/en_US.utf8/LC_NAME 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 167 18405 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 59 18409 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 23 18407 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-04-26T12:33:19.139 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu mem REG 8,1 368 18406 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu 0r FIFO 0,13 0t0 271425 pipe 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu 1w FIFO 0,13 0t0 271426 pipe 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu 2w FIFO 0,13 0t0 271427 pipe 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:fsync-tes 48007 ubuntu 255r REG 8,1 209 919367 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:sleep 48412 root cwd unknown /proc/48412/cwd (readlink: Permission denied) 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:sleep 48412 root rtd unknown /proc/48412/root (readlink: Permission denied) 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:sleep 48412 root txt unknown /proc/48412/exe (readlink: Permission denied) 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:sleep 48412 root NOFD /proc/48412/fd (opendir: Permission denied) 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 50643 root cwd unknown /proc/50643/cwd (readlink: Permission denied) 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 50643 root rtd unknown /proc/50643/root (readlink: Permission denied) 2024-04-26T12:33:19.140 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 50643 root txt unknown /proc/50643/exe (readlink: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:sudo 50643 root NOFD /proc/50643/fd (opendir: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 50674 root cwd unknown /proc/50674/cwd (readlink: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 50674 root rtd unknown /proc/50674/root (readlink: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 50674 root txt unknown /proc/50674/exe (readlink: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:timeout 50674 root NOFD /proc/50674/fd (opendir: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 root cwd unknown /proc/50686/cwd (readlink: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 root rtd unknown /proc/50686/root (readlink: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 root txt unknown /proc/50686/exe (readlink: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 root NOFD /proc/50686/fd (opendir: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50696 log root cwd unknown /proc/50686/task/50696/cwd (readlink: Permission denied) 2024-04-26T12:33:19.141 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50696 log root rtd unknown /proc/50686/task/50696/root (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50696 log root txt unknown /proc/50686/task/50696/exe (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50696 log root NOFD /proc/50686/task/50696/fd (opendir: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50697 msgr-work root cwd unknown /proc/50686/task/50697/cwd (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50697 msgr-work root rtd unknown /proc/50686/task/50697/root (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50697 msgr-work root txt unknown /proc/50686/task/50697/exe (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50697 msgr-work root NOFD /proc/50686/task/50697/fd (opendir: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50698 msgr-work root cwd unknown /proc/50686/task/50698/cwd (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50698 msgr-work root rtd unknown /proc/50686/task/50698/root (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50698 msgr-work root txt unknown /proc/50686/task/50698/exe (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50698 msgr-work root NOFD /proc/50686/task/50698/fd (opendir: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50699 msgr-work root cwd unknown /proc/50686/task/50699/cwd (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50699 msgr-work root rtd unknown /proc/50686/task/50699/root (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50699 msgr-work root txt unknown /proc/50686/task/50699/exe (readlink: Permission denied) 2024-04-26T12:33:19.142 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50699 msgr-work root NOFD /proc/50686/task/50699/fd (opendir: Permission denied) 2024-04-26T12:33:19.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50703 service root cwd unknown /proc/50686/task/50703/cwd (readlink: Permission denied) 2024-04-26T12:33:19.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50703 service root rtd unknown /proc/50686/task/50703/root (readlink: Permission denied) 2024-04-26T12:33:19.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50703 service root txt unknown /proc/50686/task/50703/exe (readlink: Permission denied) 2024-04-26T12:33:19.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50703 service root NOFD /proc/50686/task/50703/fd (opendir: Permission denied) 2024-04-26T12:33:19.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50704 io_contex root cwd unknown /proc/50686/task/50704/cwd (readlink: Permission denied) 2024-04-26T12:33:19.143 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50704 io_contex root rtd unknown /proc/50686/task/50704/root (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50704 io_contex root txt unknown /proc/50686/task/50704/exe (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50704 io_contex root NOFD /proc/50686/task/50704/fd (opendir: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50705 io_contex root cwd unknown /proc/50686/task/50705/cwd (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50705 io_contex root rtd unknown /proc/50686/task/50705/root (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50705 io_contex root txt unknown /proc/50686/task/50705/exe (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50705 io_contex root NOFD /proc/50686/task/50705/fd (opendir: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50706 admin_soc root cwd unknown /proc/50686/task/50706/cwd (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50706 admin_soc root rtd unknown /proc/50686/task/50706/root (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50706 admin_soc root txt unknown /proc/50686/task/50706/exe (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50706 admin_soc root NOFD /proc/50686/task/50706/fd (opendir: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50707 ceph_time root cwd unknown /proc/50686/task/50707/cwd (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50707 ceph_time root rtd unknown /proc/50686/task/50707/root (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50707 ceph_time root txt unknown /proc/50686/task/50707/exe (readlink: Permission denied) 2024-04-26T12:33:19.144 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50707 ceph_time root NOFD /proc/50686/task/50707/fd (opendir: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50708 ms_dispat root cwd unknown /proc/50686/task/50708/cwd (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50708 ms_dispat root rtd unknown /proc/50686/task/50708/root (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50708 ms_dispat root txt unknown /proc/50686/task/50708/exe (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50708 ms_dispat root NOFD /proc/50686/task/50708/fd (opendir: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50709 ms_local root cwd unknown /proc/50686/task/50709/cwd (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50709 ms_local root rtd unknown /proc/50686/task/50709/root (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50709 ms_local root txt unknown /proc/50686/task/50709/exe (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50709 ms_local root NOFD /proc/50686/task/50709/fd (opendir: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50710 safe_time root cwd unknown /proc/50686/task/50710/cwd (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50710 safe_time root rtd unknown /proc/50686/task/50710/root (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50710 safe_time root txt unknown /proc/50686/task/50710/exe (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50710 safe_time root NOFD /proc/50686/task/50710/fd (opendir: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50711 safe_time root cwd unknown /proc/50686/task/50711/cwd (readlink: Permission denied) 2024-04-26T12:33:19.145 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50711 safe_time root rtd unknown /proc/50686/task/50711/root (readlink: Permission denied) 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50711 safe_time root txt unknown /proc/50686/task/50711/exe (readlink: Permission denied) 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50711 safe_time root NOFD /proc/50686/task/50711/fd (opendir: Permission denied) 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50713 ceph root cwd unknown /proc/50686/task/50713/cwd (readlink: Permission denied) 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50713 ceph root rtd unknown /proc/50686/task/50713/root (readlink: Permission denied) 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50713 ceph root txt unknown /proc/50686/task/50713/exe (readlink: Permission denied) 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:ceph 50686 50713 ceph root NOFD /proc/50686/task/50713/fd (opendir: Permission denied) 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu cwd DIR 0,47 194249488 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu rtd DIR 8,1 4096 2 / 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu txt REG 8,1 179672 11587 /usr/bin/lsof 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 99600 5318 /usr/lib64/libz.so.1.2.11 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 88824 5183 /usr/lib64/libresolv-2.28.so 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 3087848 2279 /usr/lib64/libcrypto.so.1.1.1k 2024-04-26T12:33:19.146 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 16192 5609 /usr/lib64/libkeyutils.so.1.6 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 71464 7213 /usr/lib64/libkrb5support.so.0.1 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 16792 5320 /usr/lib64/libcom_err.so.2.1 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 96272 7207 /usr/lib64/libk5crypto.so.3.1 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 975608 7212 /usr/lib64/libkrb5.so.3.3 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 355960 7204 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 543160 4872 /usr/lib64/libpcre2-8.so.0.7.1 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-26T12:33:19.147 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 213592 7222 /usr/lib64/libtirpc.so.3.0.0 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 168536 4876 /usr/lib64/libselinux.so.1 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu 0r FIFO 0,13 0t0 271425 pipe 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu 1w FIFO 0,13 0t0 271426 pipe 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu 2w FIFO 0,13 0t0 271427 pipe 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu 3r DIR 0,5 0 1 /proc 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu 4r DIR 0,5 0 282149 /proc/50715/fd 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu 5w FIFO 0,13 0t0 282154 pipe 2024-04-26T12:33:19.148 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50715 ubuntu 6r FIFO 0,13 0t0 282155 pipe 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu cwd DIR 0,47 194249488 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu rtd DIR 8,1 4096 2 / 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu txt REG 8,1 179672 11587 /usr/bin/lsof 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 99600 5318 /usr/lib64/libz.so.1.2.11 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 88824 5183 /usr/lib64/libresolv-2.28.so 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 3087848 2279 /usr/lib64/libcrypto.so.1.1.1k 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 16192 5609 /usr/lib64/libkeyutils.so.1.6 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 71464 7213 /usr/lib64/libkrb5support.so.0.1 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 149976 5181 /usr/lib64/libpthread-2.28.so 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 16792 5320 /usr/lib64/libcom_err.so.2.1 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 96272 7207 /usr/lib64/libk5crypto.so.3.1 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 975608 7212 /usr/lib64/libkrb5.so.3.3 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 355960 7204 /usr/lib64/libgssapi_krb5.so.2.2 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 19584 5169 /usr/lib64/libdl-2.28.so 2024-04-26T12:33:19.149 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 543160 4872 /usr/lib64/libpcre2-8.so.0.7.1 2024-04-26T12:33:19.150 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 2088960 5167 /usr/lib64/libc-2.28.so 2024-04-26T12:33:19.150 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 213592 7222 /usr/lib64/libtirpc.so.3.0.0 2024-04-26T12:33:19.150 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 168536 4876 /usr/lib64/libselinux.so.1 2024-04-26T12:33:19.150 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 1105744 5160 /usr/lib64/ld-2.28.so 2024-04-26T12:33:19.150 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 337024 18370 /usr/lib/locale/en_US.utf8/LC_CTYPE 2024-04-26T12:33:19.150 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu mem REG 8,1 26998 5205 /usr/lib64/gconv/gconv-modules.cache 2024-04-26T12:33:19.150 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu 4r FIFO 0,13 0t0 282154 pipe 2024-04-26T12:33:19.150 INFO:tasks.workunit.client.0.smithi038.stdout:lsof 50716 ubuntu 7w FIFO 0,13 0t0 282155 pipe 2024-04-26T12:33:19.151 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T12:33:19.151 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T12:33:19.153 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:19.152+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:19.154 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:19.154 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:19.154 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:19.185 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is set 2024-04-26T12:33:19.218 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-04-26T12:33:19.219 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T12:33:19.254 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:19.253+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:19.285 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:19.286 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:19.296 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:19.354 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:19.353+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:19.423 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:19.423 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:19.434 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:19.475 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:19.474+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:19.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~42s 2024-04-26T12:33:19.556 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:19.556+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:19.592 DEBUG:teuthology.parallel:result is None 2024-04-26T12:33:19.592 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T12:33:19.601 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:19.602 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:19.611 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:19.627 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T12:33:19.628 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T12:33:19.640 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T12:33:19.641 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:33:19.641 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T12:33:19.658 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:19.657+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:19.689 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:33:19.689 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T12:33:19.748 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:19.748 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:19.754 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:33:19.759 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:19.758+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:19.760 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:19.860 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:19.859+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:19.888 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:19.888 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:19.898 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:19.982 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:19.981+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:20.063 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:20.063+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:20.067 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:20.067 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:20.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:20.164 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:20.164+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:20.179 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:33:20.180 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":79,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:33:19.140972+0000","last_up_change":"2024-04-26T12:32:36.110243+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.6326751708984375,"average_primary_affinity":0.62999999523162842,"average_primary_affinity_weighted":0.62999999523162842}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.6326751708984375,"average_primary_affinity":0.62999999523162842,"average_primary_affinity_weighted":0.62999999523162842}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.059999942779541,"score_stable":2.059999942779541,"optimal_score":0.67000001668930054,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":0.6326751708984375,"average_primary_affinity":0.62999999523162842,"average_primary_affinity_weighted":0.62999999523162842}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":0.6326751708984375,"average_primary_affinity":0.62999999523162842,"average_primary_affinity_weighted":0.62999999523162842}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":0.0599517822265625,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":0.83807373046875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":63},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.18","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:33:20.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:30:25.029168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:30:25.763407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:30:30.379996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:30:31.544710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}] 2024-04-26T12:33:20.197 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:33:20.208 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:20.208 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:20.218 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:20.302 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:20.301+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:20.367 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:20.366+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:20.386 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:20.386 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:20.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:20.470 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:20.467+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:20.564 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:20.565 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:20.565 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-04-26T12:33:20.568 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:20.568+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:20.574 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:20.581 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:33:20.587 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:33:20.670 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:20.669+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:20.705 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:20.705 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:20.715 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:20.770 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:20.770+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:20.795 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:20.815 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:20.816 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:20.819 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:20.819 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:20.844 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:33:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:33:20.844 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:33:20.844 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:20.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:20.871 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:20.871+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:20.957 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2024-04-26T12:33:20.972 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:20.972+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:20.973 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.862494920000003, 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:20.983 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:20.984 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:20.985 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.986 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:20.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:33:20.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:33:20.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.987 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.987 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:20.987 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:33:20.987 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:33:20.987 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:20.988 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.862366707, 2024-04-26T12:33:20.989 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:33:20.989 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:20.989 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:20.989 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:20.989 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:20.990 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:20.991 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:20.992 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:33:20.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:33:20.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.993 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:20.993 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:33:20.993 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:33:20.993 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.993 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:20.994 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.862254823000001, 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:20.995 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.996 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:33:20.997 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:33:20.998 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:20.999 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.862237469, 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.000 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.001 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:33:21.002 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.003 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.004 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.005 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:21.005 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.862190509999998, 2024-04-26T12:33:21.005 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:33:21.005 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.005 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.005 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:33:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.006 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.007 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:33:21.008 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:33:21.009 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:21.010 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.862170524, 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.011 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.012 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:33:21.013 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:33:21.014 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:33:21.014 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.014 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.014 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.014 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:33:21.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:33:21.015 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.015 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.015 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.015 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:33:21.015 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:33:21.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.015 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.015 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.862116184999998, 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.016 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.017 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.018 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.019 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.020 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:21.021 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.859245727000001, 2024-04-26T12:33:21.021 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:33:21.021 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.021 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.021 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.021 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.022 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.023 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.024 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.025 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:33:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:33:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:33:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:33:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.027 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.858234719000002, 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.028 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:33:21.029 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.031 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.032 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.033 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.034 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.034 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:21.034 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.858134415000002, 2024-04-26T12:33:21.034 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:33:21.034 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.034 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.035 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.035 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.035 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.035 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:33:21.035 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.035 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.035 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.036 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:21.037 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.037 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.037 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.037 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.037 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:33:21.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:33:21.038 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.038 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.038 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.038 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:33:21.038 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:33:21.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.039 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.039 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:33:21.039 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:33:21.039 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.039 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.040 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.040 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:33:21.040 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:33:21.040 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.040 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:33:21.041 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:33:21.041 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.041 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.041 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.041 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:21.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:33:21.042 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.042 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.042 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.042 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:33:21.042 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.043 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.857999667999998, 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.044 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.045 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:33:21.046 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:33:21.047 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:33:21.047 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.047 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.047 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.047 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:33:21.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:33:21.048 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.048 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.048 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.048 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:33:21.048 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:33:21.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.049 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.049 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:33:21.049 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:33:21.049 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.050 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.050 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.050 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:33:21.050 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:33:21.050 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:33:21.051 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:33:21.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.052 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.052 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.052 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:33:21.052 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:33:21.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.052 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.052 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.052 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.053 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.053 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.053 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:21.053 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.857678669999999, 2024-04-26T12:33:21.053 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:33:21.053 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.053 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.053 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.054 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.055 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.056 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:33:21.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:33:21.057 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.057 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.057 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.057 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:33:21.057 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:33:21.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.058 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:33:21.058 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:33:21.058 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.058 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.058 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.059 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.857186405, 2024-04-26T12:33:21.060 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.061 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.062 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:33:21.063 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.064 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:33:21.065 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.066 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.067 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.067 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.067 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.067 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:21.067 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.857093513000002, 2024-04-26T12:33:21.067 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:33:21.067 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.067 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.067 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.068 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.069 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:33:21.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.071 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.072 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.073 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.856985072000001, 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.074 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.075 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.076 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.077 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:33:21.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:33:21.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.078 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.078 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:33:21.078 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:33:21.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:33:21.079 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.856801943000001, 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.080 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.081 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.082 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.083 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.084 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.085 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.856783135000001, 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.086 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.087 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.088 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.089 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.090 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.091 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.855124279000002, 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.092 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:21.093 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.094 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:33:21.095 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.096 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.097 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.846811774000003, 2024-04-26T12:33:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:33:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.098 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.100 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.101 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.102 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:33:21.103 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.104 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 44.843822021000001, 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.105 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.106 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.107 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:33:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:33:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:33:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:33:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.108 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:33:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:33:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:33:21.109 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:33:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:33:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:33:21.110 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:33:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:33:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.111 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:33:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:33:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:33:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:33:21.112 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.113 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.113 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:21.115 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:21.116 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:21.114+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:21.203 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:33:21.216 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:21.215+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:21.251 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:21.251 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:21.251 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:33:21.251 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:21.261 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:21.345 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:21.344+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:21.348 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-04-26T12:33:21.366 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:33:21.418 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:21.417+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:21.428 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:33:21.428 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:33:21.428 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:21.438 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:21.518 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:21.518+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:21.609 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:21.609 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:33:21.609 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:33:21.609 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.532796329999996, 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.610 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:21.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:33:21.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.613 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.614 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.525722180999999, 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:33:21.616 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:33:21.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:33:21.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.619 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.619 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:33:21.619 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:33:21.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:33:21.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:33:21.621 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.622 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.623 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.518560700999998, 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.624 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:21.625 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.626 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.627 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.628 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:33:21.629 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.518172098000001, 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.631 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.632 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.633 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:33:21.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.636 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.517842393000002, 2024-04-26T12:33:21.637 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:33:21.638 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.638 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.638 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.638 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.638 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.638 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:33:21.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.638 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.639 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:33:21.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:33:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:33:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:33:21.641 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:33:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:33:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:33:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.642 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:33:21.644 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.515999827000002, 2024-04-26T12:33:21.645 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.648 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:33:21.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:33:21.650 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.651 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.511647121999999, 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:33:21.653 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.654 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:33:21.655 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.656 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.657 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487961491, 2024-04-26T12:33:21.658 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.659 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:33:21.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.661 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.662 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.663 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.664 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:21.665 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487813766000002, 2024-04-26T12:33:21.665 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:33:21.665 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.665 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.665 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.665 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.665 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.665 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:33:21.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.666 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.668 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:33:21.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.670 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487756681999997, 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.671 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:21.672 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.673 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.674 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:33:21.675 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487729405000003, 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.677 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:33:21.678 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:33:21.679 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.680 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487687708999999, 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.683 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:21.684 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.685 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487641474, 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:33:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:33:21.692 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.693 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.694 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487608190000003, 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.695 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:21.697 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.697 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.697 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.697 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.697 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:21.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.698 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.698 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.698 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.698 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:33:21.698 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.699 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.699 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.699 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.699 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:33:21.699 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.700 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:33:21.701 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:21.703 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487578116000002, 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:21.704 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.705 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.706 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:33:21.708 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487541852, 2024-04-26T12:33:21.709 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:33:21.710 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.710 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.710 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.710 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.710 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.710 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:33:21.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.710 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.711 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.712 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.713 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:33:21.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487487381000001, 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.718 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.719 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.720 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.721 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487461973000002, 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.722 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.723 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.724 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.725 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:33:21.726 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.487438144000002, 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:33:21.729 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.730 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:33:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:21.733 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 45.483289824000003, 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:21.734 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:21.735 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.736 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:33:21.738 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:21.739 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:21.741 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2024-04-26T12:33:21.741 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:21.739+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:21.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:21.746 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T12:33:21.842 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:21.841+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:21.943 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:21.942+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:21.944 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_repop(mds.0.3:207 3.15 e79/52 3:aa448500:::500.00000000:head v 79'5, mlcod=14'3)", 2024-04-26T12:33:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:33:21.943886+0000", 2024-04-26T12:33:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 0.00035062400000000001, 2024-04-26T12:33:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00038089999999999999, 2024-04-26T12:33:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:21.944 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "started", 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:21.943886+0000", 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:21.943886+0000", 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:21.943885+0000", 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.945 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:21.943893+0000", 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.9510000000000006e-06 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:21.943902+0000", 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.7509999999999997e-06 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:21.943908+0000", 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0469999999999999e-06 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.946 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:21.943949+0000", 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1489999999999997e-05 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:33:21.943974+0000", 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5080999999999999e-05 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout: "num_ops": 1 2024-04-26T12:33:21.947 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:21.955 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:22.044 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:22.043+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:22.123 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:22.123 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [], 2024-04-26T12:33:22.123 INFO:teuthology.orchestra.run.smithi116.stdout: "complaint_time": 30, 2024-04-26T12:33:22.123 INFO:teuthology.orchestra.run.smithi116.stdout: "num_blocked_ops": 0 2024-04-26T12:33:22.123 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:22.133 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:22.140 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2024-04-26T12:33:22.144 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:22.144+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:22.153 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2024-04-26T12:33:22.154 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T12:33:22.173 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:33:22.216 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is set 2024-04-26T12:33:22.246 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:22.245+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:22.303 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-04-26T12:33:22.303 INFO:teuthology.orchestra.run.smithi116.stdout: "size": 20, 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 600, 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "ops": [ 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36926 4.23 4:c6f90462:::100000001f8.00000037:head [write 1282048~4096,write 1527808~4096,write 1687552~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.182920027999998, 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0334254350000001, 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36926 2024-04-26T12:33:22.304 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118635+0000", 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.305 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118634+0000", 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118655+0000", 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0766000000000001e-05 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118662+0000", 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9349999999999997e-06 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.306 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118668+0000", 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7490000000000004e-06 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118787+0000", 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000119237 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118794+0000", 2024-04-26T12:33:22.307 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5229999999999998e-06 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151877+0000", 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0330824380000001 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152060+0000", 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000183227 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.308 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36930 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3571712~4096,write 3854336~4096,write 3944448~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.182791815000002, 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039427034, 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36930 2024-04-26T12:33:22.309 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118763+0000", 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.310 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118762+0000", 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118790+0000", 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7625999999999999e-05 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118798+0000", 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7610000000000007e-06 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.311 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118803+0000", 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2610000000000001e-06 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122968+0000", 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041651830000000003 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122975+0000", 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9430000000000003e-06 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.312 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154747+0000", 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.031771905 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158190+0000", 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0034427640000000001 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36946 4.23 4:c6f90462:::100000001f8.00000037:head [write 1183744~4096,write 1236992~4096,write 1810432~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.313 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.182679931000003, 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332740760000001, 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36946 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:22.314 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118875+0000", 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.315 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118881+0000", 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.6069999999999996e-06 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118884+0000", 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2310000000000001e-06 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118887+0000", 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7949999999999999e-06 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.316 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118913+0000", 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5401e-05 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118917+0000", 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152084+0000", 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0331668839999999 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.317 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152149+0000", 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4740999999999996e-05 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36947 4.23 4:c6f90462:::100000001f8.00000037:head [write 3682304~4096,write 3756032~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.182662577000002, 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.033344469, 2024-04-26T12:33:22.318 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36947 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.319 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118892+0000", 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118925+0000", 2024-04-26T12:33:22.320 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3531000000000001e-05 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118930+0000", 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.5179999999999998e-06 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118933+0000", 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118952+0000", 2024-04-26T12:33:22.321 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.9292000000000001e-05 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3060000000000002e-06 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152171+0000", 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332151860000001 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.322 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152237+0000", 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.5664e-05 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36951 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3497984~4096,write 3989504~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.182615618, 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0391981189999999, 2024-04-26T12:33:22.323 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36951 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.324 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118939+0000", 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118947+0000", 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3979999999999999e-06 2024-04-26T12:33:22.325 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118953+0000", 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7039999999999999e-06 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118956+0000", 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5499999999999999e-06 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123064+0000", 2024-04-26T12:33:22.326 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0041072230000000001 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123068+0000", 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158089+0000", 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0350215030000001 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.327 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158137+0000", 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8052e-05 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36952 4.23 4:c6f90462:::100000001f8.00000037:head [write 3170304~4096,write 3391488~4096,write 3571712~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.182595632000002, 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0333548290000001, 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.328 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36952 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.329 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.8479e-05 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118981+0000", 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.330 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.118984+0000", 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.8459999999999999e-06 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119002+0000", 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7745999999999999e-05 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119005+0000", 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.162e-06 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.331 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152267+0000", 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0332620770000001 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.152314+0000", 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6730000000000002e-05 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:36956 4.36 4:6da220e6:::100000001f8.0000003f:head [write 184320~4096,write 200704~4096,write 249856~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.182541293, 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.039198764, 2024-04-26T12:33:22.332 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 36956 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.333 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119013+0000", 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119021+0000", 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.909e-06 2024-04-26T12:33:22.334 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119024+0000", 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.4079999999999998e-06 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.119027+0000", 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123089+0000", 2024-04-26T12:33:22.335 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0040622779999999999 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123096+0000", 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7209999999999997e-06 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158153+0000", 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.035057114 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158212+0000", 2024-04-26T12:33:22.336 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8859e-05 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37023 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3567616~4096,write 3596288~4096,write 3723264~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.179670835000003, 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.037842009, 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.337 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37023 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121884+0000", 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.338 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121883+0000", 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121897+0000", 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3522e-05 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121905+0000", 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0499999999999992e-06 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.339 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121915+0000", 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0079e-05 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121946+0000", 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.0935000000000001e-05 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.121952+0000", 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4060000000000002e-06 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.340 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140571+0000", 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0186183609999999 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.140682+0000", 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0001109 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159599+0000", 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018916967 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.341 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159651+0000", 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2805e-05 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159726+0000", 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4493999999999995e-05 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37034 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2764800~4096,write 2883584~4096,write 3088384~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.342 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.178659826999997, 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.049541423, 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37034 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.343 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122895+0000", 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122894+0000", 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122912+0000", 2024-04-26T12:33:22.344 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.7501999999999999e-05 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122937+0000", 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.5096000000000002e-05 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122944+0000", 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7109999999999998e-06 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.345 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122979+0000", 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5539e-05 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122986+0000", 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2300000000000002e-06 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.153853+0000", 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0308670209999999 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.346 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.154038+0000", 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.000185093 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172317+0000", 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.018278848 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172366+0000", 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.8344000000000003e-05 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172436+0000", 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0654000000000005e-05 2024-04-26T12:33:22.347 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37037 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3379200~4096,write 3440640~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.178559522999997, 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.036857387, 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.348 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37037 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.349 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.122995+0000", 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123007+0000", 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.2456999999999999e-05 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123014+0000", 2024-04-26T12:33:22.350 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.9550000000000003e-06 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123020+0000", 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7649999999999999e-06 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123092+0000", 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2000000000000002e-05 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123100+0000", 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0790000000000001e-06 2024-04-26T12:33:22.351 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234974429999999 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146675+0000", 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7397000000000005e-05 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159735+0000", 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.013060405000000001 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.352 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159782+0000", 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6706999999999999e-05 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159853+0000", 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0706999999999999e-05 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37048 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 20480~4096,write 126976~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.353 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.178424776, 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0329689660000001, 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37048 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.354 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123130+0000", 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123129+0000", 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.355 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123140+0000", 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0176e-05 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123146+0000", 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.7909999999999999e-06 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123317+0000", 2024-04-26T12:33:22.356 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00017016700000000001 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123348+0000", 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.1936000000000001e-05 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123355+0000", 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.4790000000000001e-06 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.357 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144508+0000", 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021152619 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144586+0000", 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.8697999999999998e-05 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.358 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156022+0000", 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.011435796 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156055+0000", 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.2982999999999999e-05 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156099+0000", 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3835000000000003e-05 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.359 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37071 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1957888~4096,write 1966080~4096,write 1986560~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.178103778000001, 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.032821177, 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37071 2024-04-26T12:33:22.360 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123451+0000", 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.361 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123450+0000", 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123462+0000", 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1755e-05 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123470+0000", 2024-04-26T12:33:22.362 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5360000000000004e-06 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123475+0000", 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123517+0000", 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.1423e-05 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.363 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123523+0000", 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.0820000000000004e-06 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146503+0000", 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0229805199999999 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.146597+0000", 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.3393999999999994e-05 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.364 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156112+0000", 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0095152559999999997 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156189+0000", 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.6885000000000007e-05 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.156272+0000", 2024-04-26T12:33:22.365 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37088 4.15 4:aada5e43:::100000001f8.00000028:head [write 2859008~4096,write 2965504~4096,write 2994176~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.177611513000002, 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0401068609999999, 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.366 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37088 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.367 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123943+0000", 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123954+0000", 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.077e-05 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.368 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123960+0000", 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2650000000000002e-06 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.123965+0000", 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3460000000000001e-06 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124012+0000", 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6808999999999999e-05 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.369 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124019+0000", 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.3100000000000003e-06 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.143920+0000", 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.019900874 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.144051+0000", 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00013049000000000001 2024-04-26T12:33:22.370 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163937+0000", 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.019886796000000002 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.163976+0000", 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.8544999999999998e-05 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.164050+0000", 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.4111999999999998e-05 2024-04-26T12:33:22.371 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37099 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 217088~4096,write 356352~4096,write 548864~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.177518620999997, 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341489740000001, 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37099 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124036+0000", 2024-04-26T12:33:22.373 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124056+0000", 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0241000000000002e-05 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124063+0000", 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.153e-06 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124068+0000", 2024-04-26T12:33:22.374 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.2240000000000003e-06 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124098+0000", 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9924999999999999e-05 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124104+0000", 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.1619999999999996e-06 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.375 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145794+0000", 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.021689941 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.145941+0000", 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00014699400000000001 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158078+0000", 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.012136358 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.376 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158128+0000", 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.158185+0000", 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.7512000000000001e-05 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.377 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37106 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1552384~4096,write 1716224~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.177410180000003, 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0381243280000001, 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37106 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.378 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124145+0000", 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124144+0000", 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.379 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124158+0000", 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.3654e-05 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124165+0000", 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.0849999999999999e-06 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124170+0000", 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.502e-06 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.380 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124197+0000", 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.6948999999999999e-05 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124203+0000", 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5520000000000004e-06 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147672+0000", 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0234691869999999 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.381 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147754+0000", 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.1966999999999996e-05 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162135+0000", 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.014381088 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162188+0000", 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.3183999999999998e-05 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.382 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.162269+0000", 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0569999999999996e-05 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37124 4.28 4:153ae410:::100000001f8.0000003b:head [write 1527808~4096,write 2187264~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.177227051000003, 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0357937049999999, 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.383 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37124 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124328+0000", 2024-04-26T12:33:22.384 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124327+0000", 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124335+0000", 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.5800000000000003e-06 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124339+0000", 2024-04-26T12:33:22.385 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.5240000000000001e-06 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124341+0000", 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.9340000000000002e-06 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124363+0000", 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.1364000000000001e-05 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.386 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124366+0000", 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.422e-06 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149674+0000", 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0253074579999999 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149787+0000", 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011309799999999999 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.387 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159860+0000", 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.010073451000000001 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.159905+0000", 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.4591e-05 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160121+0000", 2024-04-26T12:33:22.388 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00021650599999999999 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37125 4.28 4:15eeb89b:::100000001f8.00000032:head [write 1462272~4096,write 1474560~4096,write 1519616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.177208243000003, 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0359088789999999, 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.389 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37125 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.390 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124346+0000", 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967296 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124355+0000", 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.5189999999999992e-06 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124358+0000", 2024-04-26T12:33:22.391 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.3790000000000002e-06 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124361+0000", 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.869e-06 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124381+0000", 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.0149e-05 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.392 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.124385+0000", 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.9729999999999999e-06 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151228+0000", 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0268431140000001 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.151287+0000", 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.8751e-05 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.393 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160131+0000", 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.0088442989999999999 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160178+0000", 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.6489999999999997e-05 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.160255+0000", 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.7563000000000003e-05 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.394 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37142 4.19 4:997b7129:::100000001f8.00000000:head [write 3756032~4096,write 3768320~4096,write 3923968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.175549386999997, 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.041835488, 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37142 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.395 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126005+0000", 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.396 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126019+0000", 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.4579000000000001e-05 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126025+0000", 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6720000000000001e-06 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126029+0000", 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126054+0000", 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.4695e-05 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.126058+0000", 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.442e-06 2024-04-26T12:33:22.398 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149634+0000", 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.02357553 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.149752+0000", 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.00011833900000000001 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167699+0000", 2024-04-26T12:33:22.399 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017947177000000002 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167756+0000", 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.6759999999999999e-05 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.167841+0000", 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.4584000000000002e-05 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.400 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37165 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 2564096~4096,write 2629632~4096,write 2674688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.167236881999997, 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0341789450000001, 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37165 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.401 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134318+0000", 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.402 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134317+0000", 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134329+0000", 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.1589e-05 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134336+0000", 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.1799999999999999e-06 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134341+0000", 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3939999999999998e-06 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134377+0000", 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.6664e-05 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.134387+0000", 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 9.2720000000000003e-06 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.404 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147211+0000", 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0128248120000001 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.147300+0000", 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.8943000000000005e-05 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168381+0000", 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.021080728999999999 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.405 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168425+0000", 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4.3526000000000003e-05 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.168497+0000", 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2249000000000006e-05 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.406 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "description": "osd_op(client.4532.0:37172 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1482752~4096,write 1753088~4096,write 1925120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "initiated_at": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "age": 46.164247129000003, 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0352671870000001, 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "type_data": { 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "client_info": { 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "client": "client.4532", 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "tid": 37172 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "events": [ 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "initiated", 2024-04-26T12:33:22.407 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "throttled", 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137308+0000", 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "header_read", 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137307+0000", 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 4294967295.999999 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "all_read", 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137317+0000", 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.0227999999999999e-05 2024-04-26T12:33:22.408 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "dispatched", 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137325+0000", 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.0800000000000006e-06 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137329+0000", 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 3.7799999999999998e-06 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137357+0000", 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 2.7662e-05 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.409 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:36.137363+0000", 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 6.2469999999999997e-06 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "reached_pg", 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155300+0000", 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 1.017937074 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "started", 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.155387+0000", 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 8.6711000000000004e-05 2024-04-26T12:33:22.410 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "op_commit", 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172447+0000", 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 0.017060259000000001 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "commit_sent", 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172502+0000", 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 5.5427000000000003e-05 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: "event": "done", 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: "time": "2024-04-26T12:32:37.172575+0000", 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: "duration": 7.2458000000000003e-05 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.411 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.412 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.412 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-04-26T12:33:22.412 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-04-26T12:33:22.412 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-04-26T12:33:22.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:22.414 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:22.412+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:22.514 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:22.513+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:22.544 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:22.544 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:22.544 INFO:teuthology.orchestra.run.smithi133.stdout: "num_ops": 0 2024-04-26T12:33:22.544 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:22.554 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:22.579 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:33:22.579 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":80,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:33:22.171838+0000","last_up_change":"2024-04-26T12:32:36.110243+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.6326751708984375,"average_primary_affinity":0.62999999523162842,"average_primary_affinity_weighted":0.62999999523162842}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.6326751708984375,"average_primary_affinity":0.62999999523162842,"average_primary_affinity_weighted":0.62999999523162842}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.059999942779541,"score_stable":2.059999942779541,"optimal_score":0.67000001668930054,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":0.6326751708984375,"average_primary_affinity":0.62999999523162842,"average_primary_affinity_weighted":0.62999999523162842}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":0.6326751708984375,"average_primary_affinity":0.62999999523162842,"average_primary_affinity_weighted":0.62999999523162842}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":52,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":40381},{"type":"v1","addr":"172.21.15.98:6801","nonce":40381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":40381},{"type":"v1","addr":"172.21.15.98:6803","nonce":40381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":40381},{"type":"v1","addr":"172.21.15.98:6807","nonce":40381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":40381},{"type":"v1","addr":"172.21.15.98:6805","nonce":40381}]},"public_addr":"172.21.15.98:6801/40381","cluster_addr":"172.21.15.98:6803/40381","heartbeat_back_addr":"172.21.15.98:6807/40381","heartbeat_front_addr":"172.21.15.98:6805/40381","state":["exists"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":0.0599517822265625,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":0.83807373046875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":63},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.18","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:33:22.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:30:25.029168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:30:25.763407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:30:30.379996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:30:31.544710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 0.6326751708984375, 'average_primary_affinity': 0.6299999952316284, 'average_primary_affinity_weighted': 0.6299999952316284}}] 2024-04-26T12:33:22.595 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:33:22.615 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:22.614+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:22.682 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:22.682 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [], 2024-04-26T12:33:22.682 INFO:teuthology.orchestra.run.smithi133.stdout: "complaint_time": 30, 2024-04-26T12:33:22.682 INFO:teuthology.orchestra.run.smithi133.stdout: "num_blocked_ops": 0 2024-04-26T12:33:22.682 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:22.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:22.716 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:22.716+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:22.818 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:22.818+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:22.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:33:22.863 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-04-26T12:33:22.863 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 20, 2024-04-26T12:33:22.863 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 600, 2024-04-26T12:33:22.863 INFO:teuthology.orchestra.run.smithi133.stdout: "ops": [ 2024-04-26T12:33:22.863 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.863 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37032 4.2c 4:36128e15:::100000001f8.00000008:head [write 610304~4096,write 745472~4096,write 815104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.786727974000001, 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.079778267, 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37032 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.864 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074124+0000", 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074123+0000", 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.865 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074134+0000", 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1141999999999999e-05 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074149+0000", 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4659e-05 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074154+0000", 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5489999999999997e-06 2024-04-26T12:33:22.866 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074199+0000", 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.4271999999999999e-05 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074289+0000", 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0227000000000002e-05 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.074452+0000", 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000162891 2024-04-26T12:33:22.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.075897+0000", 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001445406 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121497+0000", 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.045600099999999998 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121507+0000", 2024-04-26T12:33:22.868 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4919999999999999e-06 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153846+0000", 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.032338924 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153902+0000", 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6440000000000002e-05 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37049 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3276800~4096,write 3289088~4096,write 3313664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.779653824999997, 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.07107766, 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37049 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081198+0000", 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081197+0000", 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:22.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081211+0000", 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3492000000000001e-05 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081220+0000", 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1400000000000006e-06 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081225+0000", 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1749999999999996e-06 2024-04-26T12:33:22.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081268+0000", 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3442999999999997e-05 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081329+0000", 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1014999999999998e-05 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.081428+0000", 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.8105999999999999e-05 2024-04-26T12:33:22.873 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.082802+0000", 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001374779 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124282+0000", 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.04148015 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124290+0000", 2024-04-26T12:33:22.874 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4460000000000004e-06 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152202+0000", 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027911751 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152276+0000", 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3957999999999999e-05 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.875 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37065 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1146880~4096,write 1212416~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.772492345000003, 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0542804569999999, 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37065 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.876 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088359+0000", 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088372+0000", 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3740000000000001e-05 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088383+0000", 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0359e-05 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088388+0000", 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2580000000000003e-06 2024-04-26T12:33:22.878 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088434+0000", 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5816000000000003e-05 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088494+0000", 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0032999999999999e-05 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:22.879 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088584+0000", 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0048000000000002e-05 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091632+0000", 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.003048069 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123319+0000", 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.031686824000000002 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.880 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123327+0000", 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0469999999999994e-06 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142564+0000", 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0192371609999999 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142640+0000", 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5851000000000003e-05 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.881 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37066 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2596864~4096,write 2822144~4096,write 2899968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.772103741999999, 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053879963, 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37066 2024-04-26T12:33:22.882 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088748+0000", 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.883 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088747+0000", 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088760+0000", 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2726e-05 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.884 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088771+0000", 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0838e-05 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088779+0000", 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.9459999999999998e-06 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088809+0000", 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0233999999999999e-05 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.885 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088869+0000", 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0371999999999997e-05 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.088969+0000", 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.9701e-05 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090639+0000", 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00166954 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.886 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121627+0000", 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.030988112000000002 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121636+0000", 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.3940000000000002e-06 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142560+0000", 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.020924103 2024-04-26T12:33:22.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.142628+0000", 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7847000000000003e-05 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37067 4.2c 4:36128e15:::100000001f8.00000008:head [write 1236992~4096,write 1495040~4096,write 1564672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.771774037, 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.064946248, 2024-04-26T12:33:22.888 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37067 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.889 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089078+0000", 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089077+0000", 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089093+0000", 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089105+0000", 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1851999999999999e-05 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089113+0000", 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3509999999999996e-06 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.891 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089139+0000", 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.6035000000000001e-05 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089193+0000", 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4131000000000001e-05 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.089284+0000", 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1755999999999994e-05 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.892 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.094351+0000", 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0050669649999999997 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121542+0000", 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.027190908999999999 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121551+0000", 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.2009999999999999e-06 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.893 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.153956+0000", 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324057710000001 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154024+0000", 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-05 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37072 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2523136~4096,write 2588672~4096,write 2596864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:22.894 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.769931471, 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.063205808, 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37072 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:22.895 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090920+0000", 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.896 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090971+0000", 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1711e-05 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090986+0000", 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.484e-05 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.090998+0000", 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2156e-05 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.897 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091047+0000", 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9088000000000002e-05 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091139+0000", 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.1576999999999994e-05 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.091315+0000", 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00017654300000000001 2024-04-26T12:33:22.898 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.097829+0000", 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0065132870000000004 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121582+0000", 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023753730000000001 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121590+0000", 2024-04-26T12:33:22.899 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.0190000000000006e-06 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154054+0000", 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0324639659999999 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154126+0000", 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1680000000000005e-05 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.900 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37082 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3665920~4096,write 3792896~4096,write 3932160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.765578765999997, 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0571003139999999, 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "reached pg", 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.901 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37082 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095273+0000", 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.902 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095272+0000", 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095286+0000", 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3994e-05 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095294+0000", 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2239999999999998e-06 2024-04-26T12:33:22.903 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095300+0000", 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0939999999999996e-06 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095331+0000", 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.1100999999999999e-05 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095386+0000", 2024-04-26T12:33:22.904 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5727999999999999e-05 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for subops from 0", 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.095494+0000", 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000107959 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.098293+0000", 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.002798835 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.905 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124322+0000", 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.026028665999999999 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.124326+0000", 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1509999999999997e-06 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152310+0000", 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.027983995 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.906 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.152373+0000", 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3251999999999997e-05 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:36989 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3649536~4096,write 3661824~4096,write 3809280~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741893134999998, 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.052697445, 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.907 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 36989 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118959+0000", 2024-04-26T12:33:22.908 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118958+0000", 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118971+0000", 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.2471e-05 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118977+0000", 2024-04-26T12:33:22.909 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6599999999999998e-06 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.118983+0000", 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.6829999999999996e-06 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119225+0000", 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00024189099999999999 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.910 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119231+0000", 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1260000000000003e-06 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150819+0000", 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0315881769999999 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.150896+0000", 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.6601999999999996e-05 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.911 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171534+0000", 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.020638080999999999 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171581+0000", 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7088e-05 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.171656+0000", 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5079000000000004e-05 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.912 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37031 4.11 4:893be98d:::100000001f8.00000001:head [write 1159168~4096,write 1228800~4096,write 1318912~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.74174541, 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.058592768, 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37031 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.913 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119106+0000", 2024-04-26T12:33:22.914 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119117+0000", 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1011e-05 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119123+0000", 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2269999999999998e-06 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119129+0000", 2024-04-26T12:33:22.915 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8969999999999996e-06 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120564+0000", 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0014350019999999999 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120570+0000", 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2620000000000004e-06 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.916 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158960+0000", 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0383895670000001 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.159074+0000", 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000114611 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177570+0000", 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018495614 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.917 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177622+0000", 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.1551000000000002e-05 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177699+0000", 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7477000000000004e-05 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.918 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37038 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 98304~4096,write 184320~4096,write 208896~8192] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741688326000002, 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0768943310000001, 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37038 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.919 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119163+0000", 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.920 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119175+0000", 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1804000000000001e-05 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119181+0000", 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0560000000000001e-06 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119186+0000", 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0289999999999996e-06 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120742+0000", 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0015558519999999999 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120748+0000", 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4359999999999999e-06 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146312+0000", 2024-04-26T12:33:22.922 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02556381 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.146456+0000", 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000143714 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.195986+0000", 2024-04-26T12:33:22.923 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.049530284000000001 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196016+0000", 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.0236e-05 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196058+0000", 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.1570999999999999e-05 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.924 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37041 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 372736~4096,write 704512~4096,write 794624~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741661049000001, 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.076933986, 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37041 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.925 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119191+0000", 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.926 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119190+0000", 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119202+0000", 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1491999999999999e-05 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119208+0000", 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6420000000000001e-06 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.927 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119222+0000", 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.3915e-05 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120769+0000", 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001546909 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120775+0000", 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.928 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148729+0000", 2024-04-26T12:33:22.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.02795393 2024-04-26T12:33:22.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.929 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.929 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.148806+0000", 2024-04-26T12:33:22.929 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7004999999999999e-05 2024-04-26T12:33:22.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196064+0000", 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.047258045999999998 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196090+0000", 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.5605999999999998e-05 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.196125+0000", 2024-04-26T12:33:22.930 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.5045000000000001e-05 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37042 4.11 4:893be98d:::100000001f8.00000001:head [write 2564096~4096,write 2584576~4096,write 2707456~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741619352999997, 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0586060909999999, 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.931 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37042 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119232+0000", 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119251+0000", 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.9038e-05 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119261+0000", 2024-04-26T12:33:22.933 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0073e-05 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119271+0000", 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0179e-05 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120592+0000", 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013205210000000001 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.934 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120600+0000", 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.7390000000000005e-06 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160616+0000", 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.040015965 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.160691+0000", 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4661999999999998e-05 2024-04-26T12:33:22.935 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177709+0000", 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.017017632000000001 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177748+0000", 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9681000000000002e-05 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177839+0000", 2024-04-26T12:33:22.936 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.0299999999999999e-05 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37045 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3776512~8192,write 3801088~4096,write 3891200~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741573117999998, 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.062350661, 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.937 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37045 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119279+0000", 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119278+0000", 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119292+0000", 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.4138000000000001e-05 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119299+0000", 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8109999999999997e-06 2024-04-26T12:33:22.939 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119305+0000", 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120624+0000", 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0013194120000000001 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120632+0000", 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.4429999999999997e-06 2024-04-26T12:33:22.940 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163006+0000", 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.042374047 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.163140+0000", 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00013416400000000001 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181530+0000", 2024-04-26T12:33:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.018389434 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181569+0000", 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.9223e-05 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181629+0000", 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.0548999999999999e-05 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.942 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37057 4.11 4:8be3ecac:::100000001f8.00000005:head [write 2441216~4096,write 2498560~4096,write 2527232~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741539834000001, 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.06245166, 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37057 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.943 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119312+0000", 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119311+0000", 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.944 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119325+0000", 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.314e-05 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119331+0000", 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.6549999999999998e-06 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119336+0000", 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9540000000000003e-06 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.945 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120656+0000", 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.001319588 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.120663+0000", 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1559999999999998e-06 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167008+0000", 2024-04-26T12:33:22.946 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0463450729999999 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.167112+0000", 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000104283 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181648+0000", 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014535698999999999 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181691+0000", 2024-04-26T12:33:22.947 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.3278000000000001e-05 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.181764+0000", 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2324999999999996e-05 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37061 4.11 4:893be98d:::100000001f8.00000001:head [write 3452928~4096,write 3645440~4096,write 3850240~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.74150976, 2024-04-26T12:33:22.948 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0703021749999999, 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37061 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.949 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119342+0000", 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119353+0000", 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1060000000000001e-05 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119368+0000", 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.5019e-05 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119374+0000", 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.891e-06 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121753+0000", 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023798019999999999 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.951 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121762+0000", 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.3149999999999992e-06 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169740+0000", 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0479787869999999 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.169804+0000", 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3329000000000003e-05 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.952 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189530+0000", 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019726181999999998 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189580+0000", 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189644+0000", 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.953 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37062 4.11 4:893be98d:::100000001f8.00000001:head [write 1871872~4096,write 2351104~4096,write 2523136~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741473495999998, 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.070389568, 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.954 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37062 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.955 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119378+0000", 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119389+0000", 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.1575e-05 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119396+0000", 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.1489999999999999e-06 2024-04-26T12:33:22.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119402+0000", 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.3409999999999999e-06 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121800+0000", 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023980889999999999 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121805+0000", 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:33:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173417+0000", 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0516119180000001 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.173498+0000", 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.1217999999999994e-05 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189655+0000", 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.016156685 2024-04-26T12:33:22.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189702+0000", 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7528000000000003e-05 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189768+0000", 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.5390999999999998e-05 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37070 4.11 4:8b544b63:::100000001f8.0000002c:head [write 1605632~4096,write 1761280~4096,write 1847296~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741419024999999, 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0704488480000001, 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37070 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119433+0000", 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119432+0000", 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119443+0000", 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0248000000000001e-05 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119449+0000", 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7680000000000003e-06 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.962 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119454+0000", 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.9089999999999999e-06 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121830+0000", 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023760249999999999 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121838+0000", 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.963 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175687+0000", 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.053848978 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.175762+0000", 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.5514999999999998e-05 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189776+0000", 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.014013977 2024-04-26T12:33:22.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189814+0000", 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 3.8377000000000002e-05 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.189882+0000", 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7173000000000002e-05 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37083 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 3489792~4096,write 3502080~4096,write 3514368~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741393617, 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.05477607, 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37083 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119458+0000", 2024-04-26T12:33:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119467+0000", 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.4020000000000008e-06 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119473+0000", 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.4870000000000002e-06 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.968 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119478+0000", 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.5040000000000002e-06 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119546+0000", 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.7424999999999999e-05 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119552+0000", 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.144e-06 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.969 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158076+0000", 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0385239049999999 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.158193+0000", 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000117563 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174107+0000", 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.015913915000000001 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174156+0000", 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.8365999999999997e-05 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.174234+0000", 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8727999999999996e-05 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37084 4.11 4:8be3ecac:::100000001f8.00000005:head [write 3047424~4096,write 3244032~4096,write 3375104~4096] snapc 1=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.741369788, 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0779763710000001, 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37084 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.972 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119482+0000", 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.9999995 2024-04-26T12:33:22.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119491+0000", 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 9.7410000000000004e-06 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119497+0000", 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2360000000000004e-06 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.974 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.119501+0000", 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.5220000000000001e-06 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121859+0000", 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.0023581779999999998 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.121866+0000", 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.975 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177873+0000", 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.056007828 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177942+0000", 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 6.8409000000000002e-05 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197329+0000", 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.019387692000000002 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.976 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197380+0000", 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.0489999999999999e-05 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.197458+0000", 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.8381999999999996e-05 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: "description": "osd_op(client.4532.0:37136 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 2314240~8192,write 2654208~4096,write 3399680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: "initiated_at": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: "age": 46.737221468000001, 2024-04-26T12:33:22.977 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0539463229999999, 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "type_data": { 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "client_info": { 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "client": "client.4532", 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "client_addr": "192.168.0.1:0/2928252043", 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "tid": 37136 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "events": [ 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "initiated", 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "throttled", 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "header_read", 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123630+0000", 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4294967295.999999 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "all_read", 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123659+0000", 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 2.9405999999999999e-05 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "dispatched", 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123896+0000", 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.00023657300000000001 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "queued_for_pg", 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123904+0000", 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 8.8019999999999998e-06 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123978+0000", 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.3497000000000005e-05 2024-04-26T12:33:22.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "waiting for peered", 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:36.123986+0000", 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.7559999999999999e-06 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "reached_pg", 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154155+0000", 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 1.0301692929999999 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "started", 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.154273+0000", 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.000118022 2024-04-26T12:33:22.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "op_commit", 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177458+0000", 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 0.023184930999999999 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "commit_sent", 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177505+0000", 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 4.7042000000000001e-05 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: "event": "done", 2024-04-26T12:33:22.982 INFO:teuthology.orchestra.run.smithi133.stdout: "time": "2024-04-26T12:32:37.177577+0000", 2024-04-26T12:33:22.983 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 7.1761999999999995e-05 2024-04-26T12:33:22.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.983 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-04-26T12:33:22.983 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-04-26T12:33:22.983 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-04-26T12:33:22.985 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2024-04-26T12:33:22.985 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:22.984+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:22.985 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:33:22.986 INFO:teuthology.orchestra.run.smithi038.stdout:osd.1: {} 2024-04-26T12:33:22.986 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:23.007 INFO:teuthology.orchestra.run.smithi038.stdout:osd.2: {} 2024-04-26T12:33:23.007 INFO:teuthology.orchestra.run.smithi038.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T12:33:23.007 INFO:teuthology.orchestra.run.smithi038.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:33:23.008 INFO:teuthology.orchestra.run.smithi038.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:33:23.011 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:33:23.011 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:33:23.085 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:23.084+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:23.117 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:23.117 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:23.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:23.186 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:23.185+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:23.287 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:23.286+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:23.295 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:23.295 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:23.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:23.357 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2024-04-26T12:33:23.372 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:33:23.388 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:23.387+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:23.433 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:23.433 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:23.443 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:23.489 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:23.488+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:23.586 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:23.586 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:23.590 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:23.589+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:23.597 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:23.691 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:23.690+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:23.734 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2024-04-26T12:33:23.750 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:33:23.767 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:23.767 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:23.777 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:23.792 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:23.791+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:23.893 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:23.892+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:23.948 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:23.948 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:23.959 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:24.000 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:23.999+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:24.090 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:24.090 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:24.095 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:24.095+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:24.100 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:24.118 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2024-04-26T12:33:24.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T12:33:24.196 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:24.196+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:24.226 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:24.226 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:24.231 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:33:24.236 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:24.297 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:24.297+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:24.364 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:24.364 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:24.374 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:24.398 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:24.397+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:24.498 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:24.498+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:24.517 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:24.517 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:24.528 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:24.528 INFO:teuthology.orchestra.run.smithi038.stderr:listed 0 entries 2024-04-26T12:33:24.546 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi038.front.sepia.ceph.com... 2024-04-26T12:33:24.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:33:24.546 DEBUG:teuthology.orchestra.run.smithi038:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T12:33:24.585 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:24.586 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi038.stderr:ceph-fuse[43891]: fuse finished with error 0 and tester_r 0 2024-04-26T12:33:24.618 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:24.617+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:24.680 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2024-04-26T12:33:24.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:33:24.680 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T12:33:24.701 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:24.700+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:24.722 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:24.722 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:24.732 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:24.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:33:24.761 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2024-04-26T12:33:24.802 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-04-26T12:33:24.801+0000 7f19f9e82700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 40364) UID: 0 2024-04-26T12:33:24.824 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T12:33:24.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:33:24.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T12:33:24.902 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:24.902 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:24.903 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-04-26T12:33:24.902+0000 7fbd81066700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 40552) UID: 0 2024-04-26T12:33:24.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:33:24.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:33:24.916 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2024-04-26T12:33:24.992 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T12:33:25.002 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T12:33:25.056 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:25.056 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:25.067 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:33:25.195 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:25.195 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:25.205 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:33:25.253 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:33:25.335 INFO:teuthology.orchestra.run.smithi116.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:25.336 INFO:teuthology.orchestra.run.smithi116.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:25.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:33:25.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~48s 2024-04-26T12:33:25.488 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:25.488 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:25.499 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:33:25.626 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:25.626 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:25.637 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:33:25.765 INFO:teuthology.orchestra.run.smithi133.stdout:ERROR: (22) Invalid argument 2024-04-26T12:33:25.765 INFO:teuthology.orchestra.run.smithi133.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:33:27.269 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:33:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:noscrub is unset 2024-04-26T12:33:28.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:33:29.281 INFO:teuthology.orchestra.run.smithi038.stderr:nodeep-scrub is unset 2024-04-26T12:33:31.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~54s 2024-04-26T12:33:36.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2024-04-26T12:33:42.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~66s 2024-04-26T12:33:48.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~72s 2024-04-26T12:33:54.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~77s 2024-04-26T12:34:00.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~83s 2024-04-26T12:34:06.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~89s 2024-04-26T12:34:11.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~95s 2024-04-26T12:34:17.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~101s 2024-04-26T12:34:23.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2024-04-26T12:34:29.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~112s 2024-04-26T12:34:35.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~118s 2024-04-26T12:34:40.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~124s 2024-04-26T12:34:46.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~130s 2024-04-26T12:34:49.550 DEBUG:teuthology.orchestra.console.smithi098:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D2 6B GUID: 00000000 0000 0000 0000 0CC47AD8D9B8 DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.98 MA 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.98 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d2:6b)... Configuring (net0 0c:c4:7a:8f:d2:6b).... Configuring (net0 0c:c4:7a:8f:d2:6b)..... Configuring (net0 0c:c4:7a:8f:d2:6b)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)  Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6>                The selected entry will be started automatically in 5s.             Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6*  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 4.18.0-513.9.1.el8_9.x86_64 (mockbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-20) (GCC)) #1 SMP Thu Nov 16 10:29:04 EST 2023 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.757 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34850000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29108 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228742 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1755080K/33438000K available (14341K kernel code, 5952K rwdata, 8520K rodata, 2608K init, 26336K bss, 949688K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 40939 entries in 160 pages [ 0.000000] ftrace: allocated 160 pages with 2 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001004] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013030] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014480] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32726b93550, max_idle_ns: 440795300787 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.51 BogoMIPS (lpj=3499757) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025021] LSM support for eBPF active [ 0.030389] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033652] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034076] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035070] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036209] CPU0: Thermal monitoring enabled (TM1) [ 0.037055] process: using mwait in idle threads [ 0.038002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050450] Freeing SMP alternatives memory: 36K [ 0.051195] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.154212] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.156105] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.157001] ... version: 3 [ 0.158000] ... bit width: 48 [ 0.159000] ... generic registers: 4 [ 0.160000] ... value mask: 0000ffffffffffff [ 0.161000] ... max period: 00007fffffffffff [ 0.162000] ... fixed-purpose events: 3 [ 0.163000] ... event mask: 000000070000000f [ 0.164030] rcu: Hierarchical SRCU implementation. [ 0.166054] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.167016] smp: Bringing up secondary CPUs ... [ 0.168071] x86: Booting SMP configuration: [ 0.169001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.172108] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.174000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.175001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.176093] #5 #6 #7 [ 0.177553] smp: Brought up 1 node, 8 CPUs [ 0.179001] smpboot: Max logical packages: 1 [ 0.180001] smpboot: Total of 8 processors activated (55996.11 BogoMIPS) [ 0.216427] node 0 deferred pages initialised in 35ms [ 0.223058] devtmpfs: initialized [ 0.224040] x86/mm: Memory block size: 128MB [ 0.227448] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.236082] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.245008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.252057] pinctrl core: initialized pinctrl subsystem [ 0.258118] NET: Registered protocol family 16 [ 0.262080] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.270012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.277009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.285019] audit: initializing netlink subsys (disabled) [ 0.291009] audit: type=2000 audit(1714134862.291:1): state=initialized audit_enabled=0 res=1 [ 0.299002] cpuidle: using governor menu [ 0.303030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.311001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.317051] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.327001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.333015] PCI: Using configuration type 1 for base access [ 0.340011] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.347002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.354025] cryptd: max_cpu_qlen set to 1000 [ 0.358049] ACPI: Added _OSI(Module Device) [ 0.362001] ACPI: Added _OSI(Processor Device) [ 0.367000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.372001] ACPI: Added _OSI(Processor Aggregator Device) [ 0.377002] ACPI: Added _OSI(Linux-Dell-Video) [ 0.381002] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.387001] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.421441] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.430518] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.439075] ACPI: Dynamic OEM Table Load: [ 0.458507] ACPI: Interpreter enabled [ 0.462011] ACPI: PM: (supports S0 S4 S5) [ 0.466000] ACPI: Using IOAPIC for interrupt routing [ 0.471021] HEST: Enabling Firmware First mode for corrected errors. [ 0.478074] HEST: Table parsing has been initialized. [ 0.483001] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.493628] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.524819] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.531003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.541630] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.550150] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.558000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.566031] PCI host bridge to bus 0000:ff [ 0.570003] pci_bus 0000:ff: root bus resource [bus ff] [ 0.575015] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.581031] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.587033] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.593031] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.599033] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.605030] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.611032] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.617035] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.623033] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.630030] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.636031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.642031] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.648031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.654031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.660032] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.666032] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.672031] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.678030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.684028] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.690024] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.696037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.702058] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.708042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.714043] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.720043] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.726032] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.732039] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.738037] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.744035] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.750044] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.756045] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.762042] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.768041] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.775024] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.781034] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.787032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.793035] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.799036] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.805044] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.811043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.817044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.823037] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.829034] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.835022] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.841039] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.847032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.853033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.859032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.865035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.871032] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.877031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.883033] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.889024] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.895034] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.901033] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.909833] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.916002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.926153] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.934284] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.942001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.950552] PCI host bridge to bus 0000:00 [ 0.954001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.961001] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.968000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.975000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.983000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.990000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.998000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.003021] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.009097] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.016043] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.022090] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.028043] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.034084] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.040041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.046059] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.052008] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.059080] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.065007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.072077] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.078008] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.085083] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.091007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.098078] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.104007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.110078] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.117007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.123079] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.129007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.136079] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.142007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.149064] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.155065] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.161082] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.167058] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.173005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.180077] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.186078] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.192011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.197006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.203006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.209006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.214006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.220006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.226035] pci 0000:00:11.4: PME# supported from D3hot [ 1.231070] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.237013] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.244051] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.250089] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.256014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.263030] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.269060] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.275014] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.282051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.288070] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.294014] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.300044] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.306075] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.313067] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.319076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.325067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.331079] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.337067] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.343082] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.349013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.356074] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.362076] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.368132] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.374010] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.380005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.385005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.391005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.396005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.402005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.408024] pci 0000:00:1f.2: PME# supported from D3hot [ 1.413061] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.419013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.426016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.432168] acpiphp: Slot [1] registered [ 1.436014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.441091] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.447009] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.454016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.460003] pci 0000:02:00.0: enabling Extended Tags [ 1.465099] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.470003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.477079] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.483010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.491004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.496010] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.503004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.510037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.516016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.524000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.534009] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.541000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.551081] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.557010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.565004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.570009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.578004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.584039] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.590013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.598000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.608008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.615001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.626057] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.631002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.637001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.643002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.651027] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.656063] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.662065] pci 0000:05:00.0: enabling Extended Tags [ 1.667069] pci 0000:05:00.0: supports D1 D2 [ 1.672000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.678091] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.683003] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.690002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.696040] pci_bus 0000:06: extended config space not accessible [ 1.702030] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.708022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.715012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.721012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.727096] pci 0000:06:00.0: supports D1 D2 [ 1.731000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.738083] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.743007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.749003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.756068] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.762018] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.768017] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.773009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.780052] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.786035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.793001] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.803021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.811000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.821165] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.827018] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.833018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.839009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.845073] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.851034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.859000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.869021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.876001] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.886084] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.892002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.898002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.904003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.912032] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.918036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.924034] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.930034] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.936034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.942000] ACPI: PCI: Interrupt link LNKE disabled [ 1.947033] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.953000] ACPI: PCI: Interrupt link LNKF disabled [ 1.957033] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.963000] ACPI: PCI: Interrupt link LNKG disabled [ 1.968034] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.974001] ACPI: PCI: Interrupt link LNKH disabled [ 1.979172] iommu: Default domain type: Passthrough [ 1.984069] SCSI subsystem initialized [ 1.988015] ACPI: bus type USB registered [ 1.992011] usbcore: registered new interface driver usbfs [ 1.998005] usbcore: registered new interface driver hub [ 2.003005] usbcore: registered new device driver usb [ 2.008022] pps_core: LinuxPPS API ver. 1 registered [ 2.013000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.022003] PTP clock support registered [ 2.026014] EDAC MC: Ver: 3.0.0 [ 2.029111] PCI: Using ACPI for IRQ routing [ 2.038929] NetLabel: Initializing [ 2.042000] NetLabel: domain hash size = 128 [ 2.047000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.052011] NetLabel: unlabeled traffic allowed by default [ 2.058021] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.059000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.072001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.078000] vgaarb: loaded [ 2.081044] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.087001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.095021] clocksource: Switched to clocksource tsc-early [ 2.110523] VFS: Disk quotas dquot_6.6.0 [ 2.114455] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.121379] pnp: PnP ACPI init [ 2.124797] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.130716] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.136625] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.142538] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.148448] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.154358] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.160272] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.166874] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.173479] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.180084] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.186687] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.193300] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.199909] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.206701] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.212613] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.218523] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.224437] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.230347] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.237003] pnp: PnP ACPI: found 5 devices [ 2.246585] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.255491] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.266967] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.274783] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.279744] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.284699] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.291482] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.299044] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.306948] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.314594] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.322585] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.330142] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.338046] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.345691] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.353684] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.361239] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.369147] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.376789] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.384781] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.392340] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.400245] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.407887] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.415881] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.420837] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.426924] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.433701] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.441434] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.446395] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.451356] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.457444] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.464235] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.469453] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.475539] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.482320] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.490061] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.497886] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.505625] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.513452] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.518415] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.524502] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.531280] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.539012] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.548049] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.554221] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.560392] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.567256] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.574119] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.580985] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.587849] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.594108] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.599672] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.605930] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.613140] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.618704] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.624963] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.630529] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.636785] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.642351] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.648607] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.655933] NET: Registered protocol family 2 [ 2.660487] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.669755] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.678616] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.687031] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.694610] TCP: Hash tables configured (established 262144 bind 65536) [ 2.701329] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.709076] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.716098] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.723568] NET: Registered protocol family 1 [ 2.727928] NET: Registered protocol family 44 [ 2.732453] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.756136] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16080 usecs [ 2.780132] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 16192 usecs [ 2.787540] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.793993] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.802369] Unpacking initramfs... [ 3.091341] Freeing initrd memory: 28480K [ 3.095427] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.101862] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.109774] ACPI: bus type thunderbolt registered [ 3.116089] Initialise system trusted keyrings [ 3.120537] Key type blacklist registered [ 3.124566] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.132453] zbud: loaded [ 3.135301] pstore: using deflate compression [ 3.139854] Platform Keyring initialized [ 3.182291] NET: Registered protocol family 38 [ 3.186735] Key type asymmetric registered [ 3.190831] Asymmetric key parser 'x509' registered [ 3.195700] Running certificate verification selftests [ 3.226348] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.237244] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.244662] io scheduler mq-deadline registered [ 3.249190] io scheduler kyber registered [ 3.253229] io scheduler bfq registered [ 3.257132] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.264343] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.270251] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.276149] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.282026] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.287901] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.293769] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.299653] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.306939] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.315300] ACPI: Power Button [PWRB] [ 3.318986] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.326395] ACPI: Power Button [PWRF] [ 3.331203] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.338710] pstore: Registered erst as persistent store backend [ 3.344778] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 3.352274] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.379125] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.407055] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.414768] Non-volatile memory driver v1.3 [ 3.419303] rdac: device handler registered [ 3.423520] hp_sw: device handler registered [ 3.427791] emc: device handler registered [ 3.431956] alua: device handler registered [ 3.436202] libphy: Fixed MDIO Bus: probed [ 3.440542] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.445828] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.453222] ehci-pci 0000:00:1d.0: debug port 2 [ 3.461667] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.474057] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.479831] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.488089] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.495301] usb usb1: Product: EHCI Host Controller [ 3.500170] usb usb1: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.507381] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.512102] hub 1-0:1.0: USB hub found [ 3.515895] hub 1-0:1.0: 2 ports detected [ 3.520060] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.525336] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.533776] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.543048] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.543070] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.548329] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 3.553540] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 3.560885] ehci-pci 0000:00:1a.0: debug port 2 [ 3.568259] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.576693] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.579069] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.591009] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.592938] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.605894] usb usb2: Product: xHCI Host Controller [ 3.610767] usb usb2: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.617979] usb usb2: SerialNumber: 0000:00:14.0 [ 3.622749] hub 2-0:1.0: USB hub found [ 3.626516] hub 2-0:1.0: 15 ports detected [ 3.633286] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.641547] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.648765] usb usb4: Product: xHCI Host Controller [ 3.653636] usb usb4: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.660848] usb usb4: SerialNumber: 0000:00:14.0 [ 3.665591] hub 4-0:1.0: USB hub found [ 3.669393] hub 4-0:1.0: 6 ports detected [ 3.674864] usbcore: registered new interface driver usbserial_generic [ 3.674876] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.681396] usbserial: USB Serial support registered for generic [ 3.689649] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.695675] i8042: PNP: No PS/2 controller found. [ 3.702858] usb usb3: Product: EHCI Host Controller [ 3.707614] mousedev: PS/2 mouse device common for all mice [ 3.712426] usb usb3: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.712427] usb usb3: SerialNumber: 0000:00:1a.0 [ 3.712536] hub 3-0:1.0: USB hub found [ 3.718101] rtc_cmos 00:00: RTC can wake from S4 [ 3.725225] hub 3-0:1.0: 2 ports detected [ 3.730065] rtc_cmos 00:00: registered as rtc0 [ 3.746648] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.754452] intel_pstate: Intel P-state driver initializing [ 3.761006] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 761110] hid: raw HID events driver (C) Jiri Kosina [ 3.772708] usbcore: registered new interface driver usbhid [ 3.778273] usbhid: USB HID core driver [ 3.782232] drop_monitor: Initializing network drop monitor service [ 3.788539] Initializing XFRM netlink socket [ 3.792881] NET: Registered protocol family 10 [ 3.797538] Segment Routing with IPv6 [ 3.801211] NET: Registered protocol family 17 [ 3.805721] mpls_gso: MPLS GSO support [ 3.809883] microcode: Microcode Update Driver: v2.2. [ 3.809935] resctrl: L3 allocation detected [ 3.819156] resctrl: L3 monitoring detected [ 3.823343] AVX2 version of gcm_enc/dec engaged. [ 3.827955] AES CTR mode by8 optimization enabled [ 3.842706] sched_clock: Marking stable (3842701736, 0)->(5638220495, -1795518759) [ 3.850391] registered taskstats version 1 [ 3.854644] Loading compiled-in X.509 certificates [ 3.859708] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 3b1bc9a9bf3bdfe93ac380c73845d894639c5bcf' [ 3.870578] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.882411] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.893024] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.895073] zswap: loaded using pool lzo/zbud [ .904092] page_owner is disabled [ 3.907762] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.910845] Key type big_key registered [ 3.915930] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.926997] hub 1-1:1.0: USB hub found [ 3.928597] Key type encrypted registered [ 3.934756] ima: No TPM chip found, activating TPM-bypass! [ 3.935059] hub 1-1:1.0: 8 ports detected [ 3.940238] ima: Allocated hash algorithm: sha256 [ 3.948943] ima: No architecture policies found [ 3.953475] evm: Initialising EVM extended attributes: [ 3.958606] evm: security.selinux [ 3.961915] evm: security.ima [ 3.964882] evm: security.capability [ 3.968454] evm: HMAC attrs: 0x1 [ 3.971047] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 3.971951] rtc_cmos 00:00: setting system clock to 2024-04-26 12:34:27 UTC (1714134867) [ 3.987572] Freeing unused decrypted memory: 2036K [ 3.992688] Freeing unused kernel image (initmem) memory: 2608K [ 4.005089] Write protecting the kernel read-only data: 26624k [ 4.011298] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 4.018174] Freeing unused kernel image (rodata/data gap) memory: 1720K [ 4.025199] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.033452] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.034016] hub 2-12:1.0: USB hub found [ 4.044579] hub 2-12:1.0: 4 ports detected [ 4.050843] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.085102] systemd[1]: Detected architecture x86-64. [ 4.090155] systemd[1]: Running in initial RAM disk. [ 4.106419] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.114586] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.121935] hub 3-1:1.0: USB hub found Welcome to [0[ 4.125784] hub 3-1:1.0: 6 ports detected [ 4.129035] tsc: Refined TSC clocksource calibration: 3499.992 MHz ;31mRed Hat Ente[ 4.137323] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327349661d8, max_idle_ns: 440795222604 ns rprise Linux 8.6[ 4.148762] clocksource: Switched to clocksource tsc (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 4.162062] systemd[1]: Set hostname to . [ 4.198403] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.210296] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.222351] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.236094] systemd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... [ 4.255114] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kerne[ 4.267125] s File Systems. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... Starting Apply Kernel Variables... [ OK ] Reached target Swap. [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Timers. Starting Setup Virtual Console... [ OK ] Reached target Slices. [ OK ] Started Create list of required sta…vice nodes for the cur[ 4.347028] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd rent kernel[0;32m OK s and DirectorieOK ] Started Journal Service. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Starting dracut cmdline hook... [ OK ] Started dracut cmdli[ 4.458449] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.466885] usb 2-12.1: New USB device strings: Mfr=0, Product=0, Seber=0 [ 4.471822] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... [ 4.537168] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 Mountin[ 4.549682] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 g Kernel Configu[ 4.562098] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 ration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Reached targ[ 4.656810] dca service started, version 1.12.1 et System Initialization. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Started Forward Password Re[ 4.677113] nvme nvme0: pci function 0000:02:00.0 quests to Plymou[ 4.682810] igb: Intel(R) Gigabit Ethernet Network Driver th Directory Wat[ 4.689381] igb: Copyright (c) 2007-2014 Intel Corporation. ch. [ [ 4.696749] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver OK ] Reache[ 4.703823] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.704727] nvme nvme0: 8/0/0 default/read/poll queues d target Basic S[ 4.716596] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.717033] nvme0n1: detected capacity change from 0 to 400088457216 ystem. [ 4.725547] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.741531] ACPI: bus type drm_connector registered [ 4.749252] scsi host0: ahci [ 4.752427] scsi host1: ahci [ 4.755476] scsi host2: ahci [ 4.755583] scsi host3: ahci [ 4.755648] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 [ 4.755655] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 [ 4.755661] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 [ 4.755666] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 [ 4.756209] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.756213] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.761650] igb 0000:07:00.0: added PHC on eth0 [ 4.774455] scsi host4: ahci [ 4.779142] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.786673] scsi host5: ahci [ 4.793927] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:d9:b8 [ 4.802230] scsi host6: ahci [ 4.809772] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.814348] scsi host7: ahci [ 4.817114] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.824111] scsi host8: ahci [ 4.824154] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.824157] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.824174] ast 0000:06:00.0: [drm] Using analog VGA [ 4.824183] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.824401] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.882445] igb 0000:07:00.1: added PHC on eth1 [ 4.885796] scsi host9: ahci [ 4.890199] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.890201] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:d9:b9 [ 4.890277] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.893124] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.899954] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.907097] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.920704] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.927170] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.946895] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.946897] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.946899] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.969162] fbcon: astdrmfb (fb0) is primary device [ 5.004341] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.018534] Console: switching to colour frame buffer device 128x48 [ 5.060717] ata1: SATA link down (SStatus 0 SControl 300) [ 5.063776] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.070385] ata3: SATA link down (SStatus 0 SControl 300) [ 5.087399] ata4: SATA link down (SStatus 0 SControl 300) [ 5.087415] ata2: SATA link down (SStatus 0 SControl 300) [ 5.252884] ata9: SATA link down (SStatus 0 SControl 300) [ 5.258300] ata10: SATA link down (SStatus 0 SControl 300) [ 5.263794] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.269979] ata7: SATA link down (SStatus 0 SControl 300) [ 5.275406] ata8: SATA link down (SStatus 0 SControl 300) [ 5.280831] ata6: SATA link down (SStatus 0 SControl 300) [ 5.286973] ata5.00: NCQ Send/Recv Log not supported [ 5.291939] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.298194] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.306631] ata5.00: NCQ Send/Recv Log not supported [ 5.311596] ata5.00: configured for UDMA/133 [ 5.316027] scsi 4:0:0:0: Direct-Access ATA ST1000SN06 PQ: 0 ANSI:[ 5.329706] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.338730] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.346394] sd 4:0:0:0: [sda] Write Protect is off [ 5.351197] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.366652] sda: sda1 [ 5.369254] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.844340] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.854613] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.863117] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.869296] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d2:6a [ 5.877046] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.883672] libphy: ixgbe-mdio: probed [ 6.044261] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.054538] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.063041] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.070078] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d2:6b [ 6.077795] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.084377] libphy: ixgbe-mdio: probed [ 6.088978] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.100284] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…588-86c5-4fa7-ad82-5a8bfe76a5e8... [ OK ] Started File System Check on /dev/d…0b588-86c5-4fa7-ad82-5a8bfe76a5e8. Mounting /sysroot... [ 6.272039] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Plymouth switch root service... Starting Setup Virtual Console... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Slices. [ OK ] Stopped target Timers. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.602071] printk: systemd: 12 output lines suppressed due to ratelimiting [ 7.215381] SELinux: policy capability network_peer_controls=1 [ 7.221302] SELinux: policy capability open_perms=1 [ 7.226264] SELinux: policy capability extended_socket_class=1 [ 7.232174] SELinux: policy capability always_check_network=0 [ 7.237997] SELinux: policy capability cgroup_seclabel=1 [ 7.243388] SELinux: policy capability nnp_nosuid_transition=1 [ 7.271078] audit: type=1403 audit(1714134870.798:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.272698] systemd[1]: Successfully loaded SELinux policy in 221.632ms. [ 7.329327] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.589ms. [ 7.344741] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.379172] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 7.393423] systemd[1]: Set hostname to . [ 8.444191] systemd[1]: systemd-journald.service: Succeeded. [ 8.450516] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.456688] systemd[1]: Stopped Switch Root. [ OK [[ 8.461458] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.472946] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.483207] systemd[1]: Stopped Journal Service. [ OK [[ 8.489802] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... Mounting Huge Pages File System... [ OK ] Listening on Process Core Dump Socket. Mounting Kernel Debug File System... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Created slice system-getty.slice. Starting Remount Root and Kernel File Systems... [ OK ] Stopped target Switch Root. [ OK ] Created slice system-sshd\x2dkey[ 8.538890] EXT4-fs (sda1): re-mounted. Opts: (null) gen.slice. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... Mounting POSIX Message Queue File System... [ OK ] Listening on udev Kernel Socket. [ OK ] Stopped target Initrd Root File System. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Reached target Swap. Starting Load Kernel Modules... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped Plymouth switch root service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Read and set NIS d[ 8.725211] fuse: init (API version 7.34) omainname from /[ 8.748759] device-mapper: uevent: version 1.0.3 etc/sysconfig/ne[ 8.754406] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com twork. Starting Load/Save Random Seed... [ OK ] Started Journal Service. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Load/Save Random Seed. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load Kernel Modules. [ OK ] Started udev Coldplug all Devices. Starting Apply Kernel Variables... Mounting FUSE Control File System... [ OK ] Mounted FUSE Control File System. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Restore /run/initramfs on shutdown... Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... Starting udev Kernel Device Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Mounting RPC Pipe File System... Starting Security Auditing Service... [ 9.410786] IPMI message handler: version 39.2 [ 9.418450] ipmi device interface [ 9.424565] power_meter ACPI000D:00: Found ACPI power meter. [ 9.430277] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.437090] ipmi_si: IPMI System Interface driver [ 9.441880] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.448240] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.455467] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.461309] RPC: Registered named UNIX socket transport module. [ 9.461365] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.467228] RPC: Registered udp transport module. [ 9.473249] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.477857] RPC: Registered tcp transport module. [ 9.477859] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 9.496877] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Started RPC Bind. [[ 9.514221] igb 0000:07:00.0: DCA enabled OK ] Moun[ 9.519542] igb 0000:07:00.1: DCA enabled ted RPC Pipe Fil[ 9.525194] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt e System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event[ 9.545056] input: PC Speaker as /devices/platform/pcspkr/input/input4 activation on d[ 9.552752] mei_me 0000:00:16.0: Device doesn't have valid ME Interface evice 259:0... [ 9.552894] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.570615] ipmi_si: Adding ACPI-specified kcs state machine [ 9.576455] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.622548] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.630493] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.636156] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.660017] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.690938] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.694939] iTCO_vendor_support: vendor-support=0 [ 9.710496] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 9.710620] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 9.710995] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. [ 9.860292] ipmi_si IPI0001:00: IPMI kcs interface initialized Mounting /var/lib/ceph... [ 9.871222] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Listening on D-Bus System Message Bus Socket. [[0;3[ 9.954436] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 9.965713] EDAC sbridge: Ver: 1.1.2 2m OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Updates mlocate database every day. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Reached target Timers. [ OK ] Started CUPS Scheduler. [ OK ] Reached target Paths. [ OK ] Listening on CUPS Scheduler. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting VDO volume services... Starting Kernel Samepage Merging... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting System Security Services Daemon... [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started irqbalance daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Authorization Manager... [ 10.079336] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 10.087659] XFS (dm-4): Mounting V5 Filesystem [ 10.096073] XFS (dm-4): Ending clean mount Starting NTP client/server... [ OK ] Started Machine Check Exception Logging Daemon. Starting Avahi mDNS/DNS-SD Stack... Starting Resets System Activity Logs... [ OK ] Mounted /var/lib/ceph. [ OK ] Started Kernel Samepage Merging. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ 10.267854] intel_rapl_common: Found RAPL domain package [ 10.273180] intel_rapl_common: Found RAPL domain dram [ 10.278231] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting Enable periodic update of entitlement certificates.... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Enable periodic update of entitlement certificates.. [ OK ] Started Hostname Service. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started OpenSSH server daemon. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 12.155562] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.214008] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ OK ] Started Auth[ 12.221942] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready orization Manager. [ 12.271806] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.289698] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.333028] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.447936] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.455887] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.498645] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 12.607858] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.723520] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 12.927086] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 12.934954] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started VDO volume services. [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting CUPS Scheduler... Starting Permit User Sessions... Starting Login Service... [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ OK ] Started Login Service. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... [ OK ] Started Nagios Remote Plugin Executor. Starting System Logging Service... Starting /etc/rc.d/rc.local Compatibility... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started System Logging Service. + myips=172.21.15.98 + attempts=1 + sleep 1 + '[' 172.21.15.98 '!=' '' ']' + set -e + '[' -n 172.21.15.98 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.98 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.98 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi098.front.sepia.ceph.com + '[' -n smithi098.front.sepia.ceph.com ']' + hostname smithi098.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi098 + echo smithi098 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.98 smithi098.front.sepia.ceph.com smithi098\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:34:49.551 DEBUG:teuthology.orchestra.console.smithi098:expect after: smithi098 login: 2024-04-26T12:34:49.605 DEBUG:teuthology.orchestra.console.smithi098:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D2 6B GUID: 00000000 0000 0000 0000 0CC47AD8D9B8 DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.98 MA 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.98 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d2:6b)... Configuring (net0 0c:c4:7a:8f:d2:6b).... Configuring (net0 0c:c4:7a:8f:d2:6b)..... Configuring (net0 0c:c4:7a:8f:d2:6b)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)  Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6>                The selected entry will be started automatically in 5s.             Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   Red Hat Enterprise Linux (4.18.0-513.9.1.el8_9.x86_64) 8.9 (Ootpa)   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-963f8b6c99184de696879b3f7da9ecce) 8.6*  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 4.18.0-513.9.1.el8_9.x86_64 (mockbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-20) (GCC)) #1 SMP Thu Nov 16 10:29:04 EST 2023 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.757 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34850000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29108 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228742 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-513.9.1.el8_9.x86_64 root=UUID=8860b588-86c5-4fa7-ad82-5a8bfe76a5e8 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1755080K/33438000K available (14341K kernel code, 5952K rwdata, 8520K rodata, 2608K init, 26336K bss, 949688K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 40939 entries in 160 pages [ 0.000000] ftrace: allocated 160 pages with 2 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001004] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013030] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014480] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32726b93550, max_idle_ns: 440795300787 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.51 BogoMIPS (lpj=3499757) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025021] LSM support for eBPF active [ 0.030389] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033652] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034076] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035070] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036209] CPU0: Thermal monitoring enabled (TM1) [ 0.037055] process: using mwait in idle threads [ 0.038002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050450] Freeing SMP alternatives memory: 36K [ 0.051195] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.154212] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.156105] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.157001] ... version: 3 [ 0.158000] ... bit width: 48 [ 0.159000] ... generic registers: 4 [ 0.160000] ... value mask: 0000ffffffffffff [ 0.161000] ... max period: 00007fffffffffff [ 0.162000] ... fixed-purpose events: 3 [ 0.163000] ... event mask: 000000070000000f [ 0.164030] rcu: Hierarchical SRCU implementation. [ 0.166054] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.167016] smp: Bringing up secondary CPUs ... [ 0.168071] x86: Booting SMP configuration: [ 0.169001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.172108] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.174000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.175001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.176093] #5 #6 #7 [ 0.177553] smp: Brought up 1 node, 8 CPUs [ 0.179001] smpboot: Max logical packages: 1 [ 0.180001] smpboot: Total of 8 processors activated (55996.11 BogoMIPS) [ 0.216427] node 0 deferred pages initialised in 35ms [ 0.223058] devtmpfs: initialized [ 0.224040] x86/mm: Memory block size: 128MB [ 0.227448] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.236082] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.245008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.252057] pinctrl core: initialized pinctrl subsystem [ 0.258118] NET: Registered protocol family 16 [ 0.262080] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.270012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.277009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.285019] audit: initializing netlink subsys (disabled) [ 0.291009] audit: type=2000 audit(1714134862.291:1): state=initialized audit_enabled=0 res=1 [ 0.299002] cpuidle: using governor menu [ 0.303030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.311001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.317051] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.327001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.333015] PCI: Using configuration type 1 for base access [ 0.340011] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.347002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.354025] cryptd: max_cpu_qlen set to 1000 [ 0.358049] ACPI: Added _OSI(Module Device) [ 0.362001] ACPI: Added _OSI(Processor Device) [ 0.367000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.372001] ACPI: Added _OSI(Processor Aggregator Device) [ 0.377002] ACPI: Added _OSI(Linux-Dell-Video) [ 0.381002] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.387001] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.421441] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.430518] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.439075] ACPI: Dynamic OEM Table Load: [ 0.458507] ACPI: Interpreter enabled [ 0.462011] ACPI: PM: (supports S0 S4 S5) [ 0.466000] ACPI: Using IOAPIC for interrupt routing [ 0.471021] HEST: Enabling Firmware First mode for corrected errors. [ 0.478074] HEST: Table parsing has been initialized. [ 0.483001] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.493628] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.524819] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.531003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.541630] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.550150] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.558000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.566031] PCI host bridge to bus 0000:ff [ 0.570003] pci_bus 0000:ff: root bus resource [bus ff] [ 0.575015] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.581031] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.587033] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.593031] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.599033] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.605030] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.611032] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.617035] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.623033] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.630030] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.636031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.642031] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.648031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.654031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.660032] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.666032] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.672031] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.678030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.684028] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.690024] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.696037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.702058] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.708042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.714043] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.720043] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.726032] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.732039] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.738037] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.744035] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.750044] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.756045] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.762042] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.768041] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.775024] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.781034] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.787032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.793035] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.799036] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.805044] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.811043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.817044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.823037] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.829034] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.835022] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.841039] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.847032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.853033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.859032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.865035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.871032] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.877031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.883033] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.889024] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.895034] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.901033] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.909833] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.916002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.926153] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.934284] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.942001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.950552] PCI host bridge to bus 0000:00 [ 0.954001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.961001] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.968000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.975000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.983000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.990000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.998000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.003021] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.009097] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.016043] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.022090] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.028043] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.034084] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.040041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.046059] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.052008] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.059080] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.065007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.072077] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.078008] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.085083] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.091007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.098078] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.104007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.110078] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.117007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.123079] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.129007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.136079] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.142007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.149064] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.155065] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.161082] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.167058] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.173005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.180077] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.186078] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.192011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.197006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.203006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.209006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.214006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.220006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.226035] pci 0000:00:11.4: PME# supported from D3hot [ 1.231070] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.237013] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.244051] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.250089] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.256014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.263030] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.269060] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.275014] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.282051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.288070] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.294014] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.300044] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.306075] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.313067] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.319076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.325067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.331079] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.337067] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.343082] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.349013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.356074] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.362076] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.368132] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.374010] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.380005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.385005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.391005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.396005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.402005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.408024] pci 0000:00:1f.2: PME# supported from D3hot [ 1.413061] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.419013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.426016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.432168] acpiphp: Slot [1] registered [ 1.436014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.441091] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.447009] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.454016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.460003] pci 0000:02:00.0: enabling Extended Tags [ 1.465099] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.470003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.477079] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.483010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.491004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.496010] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.503004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.510037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.516016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.524000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.534009] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.541000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.551081] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.557010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.565004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.570009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.578004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.584039] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.590013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.598000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.608008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.615001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.626057] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.631002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.637001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.643002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.651027] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.656063] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.662065] pci 0000:05:00.0: enabling Extended Tags [ 1.667069] pci 0000:05:00.0: supports D1 D2 [ 1.672000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.678091] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.683003] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.690002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.696040] pci_bus 0000:06: extended config space not accessible [ 1.702030] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.708022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.715012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.721012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.727096] pci 0000:06:00.0: supports D1 D2 [ 1.731000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.738083] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.743007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.749003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.756068] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.762018] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.768017] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.773009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.780052] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.786035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.793001] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.803021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.811000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.821165] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.827018] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.833018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.839009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.845073] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.851034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.859000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.869021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.876001] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.886084] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.892002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.898002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.904003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.912032] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.918036] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.924034] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.930034] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.936034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.942000] ACPI: PCI: Interrupt link LNKE disabled [ 1.947033] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.953000] ACPI: PCI: Interrupt link LNKF disabled [ 1.957033] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.963000] ACPI: PCI: Interrupt link LNKG disabled [ 1.968034] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.974001] ACPI: PCI: Interrupt link LNKH disabled [ 1.979172] iommu: Default domain type: Passthrough [ 1.984069] SCSI subsystem initialized [ 1.988015] ACPI: bus type USB registered [ 1.992011] usbcore: registered new interface driver usbfs [ 1.998005] usbcore: registered new interface driver hub [ 2.003005] usbcore: registered new device driver usb [ 2.008022] pps_core: LinuxPPS API ver. 1 registered [ 2.013000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.022003] PTP clock support registered [ 2.026014] EDAC MC: Ver: 3.0.0 [ 2.029111] PCI: Using ACPI for IRQ routing [ 2.038929] NetLabel: Initializing [ 2.042000] NetLabel: domain hash size = 128 [ 2.047000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.052011] NetLabel: unlabeled traffic allowed by default [ 2.058021] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.059000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.072001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.078000] vgaarb: loaded [ 2.081044] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.087001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.095021] clocksource: Switched to clocksource tsc-early [ 2.110523] VFS: Disk quotas dquot_6.6.0 [ 2.114455] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.121379] pnp: PnP ACPI init [ 2.124797] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.130716] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.136625] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.142538] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.148448] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.154358] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.160272] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.166874] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.173479] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.180084] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.186687] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.193300] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.199909] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.206701] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.212613] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.218523] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.224437] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.230347] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.237003] pnp: PnP ACPI: found 5 devices [ 2.246585] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.255491] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.266967] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.274783] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.279744] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.284699] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.291482] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.299044] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.306948] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.314594] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.322585] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.330142] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.338046] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.345691] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.353684] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.361239] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.369147] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.376789] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.384781] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.392340] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.400245] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.407887] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.415881] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.420837] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.426924] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.433701] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.441434] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.446395] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.451356] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.457444] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.464235] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.469453] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.475539] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.482320] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.490061] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.497886] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.505625] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.513452] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.518415] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.524502] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.531280] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.539012] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.548049] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.554221] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.560392] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.567256] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.574119] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.580985] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.587849] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.594108] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.599672] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.605930] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.613140] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.618704] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.624963] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.630529] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.636785] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.642351] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.648607] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.655933] NET: Registered protocol family 2 [ 2.660487] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.669755] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.678616] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.687031] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.694610] TCP: Hash tables configured (established 262144 bind 65536) [ 2.701329] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.709076] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.716098] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.723568] NET: Registered protocol family 1 [ 2.727928] NET: Registered protocol family 44 [ 2.732453] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.756136] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16080 usecs [ 2.780132] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 16192 usecs [ 2.787540] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.793993] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.802369] Unpacking initramfs... [ 3.091341] Freeing initrd memory: 28480K [ 3.095427] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.101862] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.109774] ACPI: bus type thunderbolt registered [ 3.116089] Initialise system trusted keyrings [ 3.120537] Key type blacklist registered [ 3.124566] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.132453] zbud: loaded [ 3.135301] pstore: using deflate compression [ 3.139854] Platform Keyring initialized [ 3.182291] NET: Registered protocol family 38 [ 3.186735] Key type asymmetric registered [ 3.190831] Asymmetric key parser 'x509' registered [ 3.195700] Running certificate verification selftests [ 3.226348] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.237244] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.244662] io scheduler mq-deadline registered [ 3.249190] io scheduler kyber registered [ 3.253229] io scheduler bfq registered [ 3.257132] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.264343] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.270251] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.276149] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.282026] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.287901] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.293769] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.299653] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.306939] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.315300] ACPI: Power Button [PWRB] [ 3.318986] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.326395] ACPI: Power Button [PWRF] [ 3.331203] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.338710] pstore: Registered erst as persistent store backend [ 3.344778] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 3.352274] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.379125] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.407055] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.414768] Non-volatile memory driver v1.3 [ 3.419303] rdac: device handler registered [ 3.423520] hp_sw: device handler registered [ 3.427791] emc: device handler registered [ 3.431956] alua: device handler registered [ 3.436202] libphy: Fixed MDIO Bus: probed [ 3.440542] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.445828] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.453222] ehci-pci 0000:00:1d.0: debug port 2 [ 3.461667] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.474057] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.479831] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.488089] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.495301] usb usb1: Product: EHCI Host Controller [ 3.500170] usb usb1: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.507381] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.512102] hub 1-0:1.0: USB hub found [ 3.515895] hub 1-0:1.0: 2 ports detected [ 3.520060] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.525336] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.533776] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.543048] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.543070] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.548329] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 3.553540] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 3.560885] ehci-pci 0000:00:1a.0: debug port 2 [ 3.568259] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.576693] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.579069] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.591009] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.592938] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.605894] usb usb2: Product: xHCI Host Controller [ 3.610767] usb usb2: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.617979] usb usb2: SerialNumber: 0000:00:14.0 [ 3.622749] hub 2-0:1.0: USB hub found [ 3.626516] hub 2-0:1.0: 15 ports detected [ 3.633286] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.641547] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.648765] usb usb4: Product: xHCI Host Controller [ 3.653636] usb usb4: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 xhci-hcd [ 3.660848] usb usb4: SerialNumber: 0000:00:14.0 [ 3.665591] hub 4-0:1.0: USB hub found [ 3.669393] hub 4-0:1.0: 6 ports detected [ 3.674864] usbcore: registered new interface driver usbserial_generic [ 3.674876] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.681396] usbserial: USB Serial support registered for generic [ 3.689649] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.695675] i8042: PNP: No PS/2 controller found. [ 3.702858] usb usb3: Product: EHCI Host Controller [ 3.707614] mousedev: PS/2 mouse device common for all mice [ 3.712426] usb usb3: Manufacturer: Linux 4.18.0-513.9.1.el8_9.x86_64 ehci_hcd [ 3.712427] usb usb3: SerialNumber: 0000:00:1a.0 [ 3.712536] hub 3-0:1.0: USB hub found [ 3.718101] rtc_cmos 00:00: RTC can wake from S4 [ 3.725225] hub 3-0:1.0: 2 ports detected [ 3.730065] rtc_cmos 00:00: registered as rtc0 [ 3.746648] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.754452] intel_pstate: Intel P-state driver initializing [ 3.761006] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 761110] hid: raw HID events driver (C) Jiri Kosina [ 3.772708] usbcore: registered new interface driver usbhid [ 3.778273] usbhid: USB HID core driver [ 3.782232] drop_monitor: Initializing network drop monitor service [ 3.788539] Initializing XFRM netlink socket [ 3.792881] NET: Registered protocol family 10 [ 3.797538] Segment Routing with IPv6 [ 3.801211] NET: Registered protocol family 17 [ 3.805721] mpls_gso: MPLS GSO support [ 3.809883] microcode: Microcode Update Driver: v2.2. [ 3.809935] resctrl: L3 allocation detected [ 3.819156] resctrl: L3 monitoring detected [ 3.823343] AVX2 version of gcm_enc/dec engaged. [ 3.827955] AES CTR mode by8 optimization enabled [ 3.842706] sched_clock: Marking stable (3842701736, 0)->(5638220495, -1795518759) [ 3.850391] registered taskstats version 1 [ 3.854644] Loading compiled-in X.509 certificates [ 3.859708] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 3b1bc9a9bf3bdfe93ac380c73845d894639c5bcf' [ 3.870578] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.882411] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.893024] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.895073] zswap: loaded using pool lzo/zbud [ .904092] page_owner is disabled [ 3.907762] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.910845] Key type big_key registered [ 3.915930] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.926997] hub 1-1:1.0: USB hub found [ 3.928597] Key type encrypted registered [ 3.934756] ima: No TPM chip found, activating TPM-bypass! [ 3.935059] hub 1-1:1.0: 8 ports detected [ 3.940238] ima: Allocated hash algorithm: sha256 [ 3.948943] ima: No architecture policies found [ 3.953475] evm: Initialising EVM extended attributes: [ 3.958606] evm: security.selinux [ 3.961915] evm: security.ima [ 3.964882] evm: security.capability [ 3.968454] evm: HMAC attrs: 0x1 [ 3.971047] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 3.971951] rtc_cmos 00:00: setting system clock to 2024-04-26 12:34:27 UTC (1714134867) [ 3.987572] Freeing unused decrypted memory: 2036K [ 3.992688] Freeing unused kernel image (initmem) memory: 2608K [ 4.005089] Write protecting the kernel read-only data: 26624k [ 4.011298] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 4.018174] Freeing unused kernel image (rodata/data gap) memory: 1720K [ 4.025199] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.033452] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.034016] hub 2-12:1.0: USB hub found [ 4.044579] hub 2-12:1.0: 4 ports detected [ 4.050843] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.085102] systemd[1]: Detected architecture x86-64. [ 4.090155] systemd[1]: Running in initial RAM disk. [ 4.106419] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.114586] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.121935] hub 3-1:1.0: USB hub found Welcome to [0[ 4.125784] hub 3-1:1.0: 6 ports detected [ 4.129035] tsc: Refined TSC clocksource calibration: 3499.992 MHz ;31mRed Hat Ente[ 4.137323] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327349661d8, max_idle_ns: 440795222604 ns rprise Linux 8.6[ 4.148762] clocksource: Switched to clocksource tsc (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 4.162062] systemd[1]: Set hostname to . [ 4.198403] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.210296] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.222351] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.236094] systemd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... [ 4.255114] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kerne[ 4.267125] s File Systems. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... Starting Apply Kernel Variables... [ OK ] Reached target Swap. [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Timers. Starting Setup Virtual Console... [ OK ] Reached target Slices. [ OK ] Started Create list of required sta…vice nodes for the cur[ 4.347028] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd rent kernel[0;32m OK s and DirectorieOK ] Started Journal Service. [ OK ] Started Apply Kernel Variables. Starting Create Static Device Nodes in /dev... [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Starting dracut cmdline hook... [ OK ] Started dracut cmdli[ 4.458449] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.466885] usb 2-12.1: New USB device strings: Mfr=0, Product=0, Seber=0 [ 4.471822] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... [ 4.537168] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 Mountin[ 4.549682] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 g Kernel Configu[ 4.562098] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 ration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Reached targ[ 4.656810] dca service started, version 1.12.1 et System Initialization. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Started Forward Password Re[ 4.677113] nvme nvme0: pci function 0000:02:00.0 quests to Plymou[ 4.682810] igb: Intel(R) Gigabit Ethernet Network Driver th Directory Wat[ 4.689381] igb: Copyright (c) 2007-2014 Intel Corporation. ch. [ [ 4.696749] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver OK ] Reache[ 4.703823] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.704727] nvme nvme0: 8/0/0 default/read/poll queues d target Basic S[ 4.716596] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.717033] nvme0n1: detected capacity change from 0 to 400088457216 ystem. [ 4.725547] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.741531] ACPI: bus type drm_connector registered [ 4.749252] scsi host0: ahci [ 4.752427] scsi host1: ahci [ 4.755476] scsi host2: ahci [ 4.755583] scsi host3: ahci [ 4.755648] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 [ 4.755655] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 [ 4.755661] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 [ 4.755666] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 [ 4.756209] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.756213] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.761650] igb 0000:07:00.0: added PHC on eth0 [ 4.774455] scsi host4: ahci [ 4.779142] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.786673] scsi host5: ahci [ 4.793927] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:d9:b8 [ 4.802230] scsi host6: ahci [ 4.809772] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.814348] scsi host7: ahci [ 4.817114] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.824111] scsi host8: ahci [ 4.824154] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.824157] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.824174] ast 0000:06:00.0: [drm] Using analog VGA [ 4.824183] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.824401] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.882445] igb 0000:07:00.1: added PHC on eth1 [ 4.885796] scsi host9: ahci [ 4.890199] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.890201] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:d9:b9 [ 4.890277] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.893124] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.899954] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.907097] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.920704] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.927170] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.946895] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.946897] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.946899] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.969162] fbcon: astdrmfb (fb0) is primary device [ 5.004341] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.018534] Console: switching to colour frame buffer device 128x48 [ 5.060717] ata1: SATA link down (SStatus 0 SControl 300) [ 5.063776] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.070385] ata3: SATA link down (SStatus 0 SControl 300) [ 5.087399] ata4: SATA link down (SStatus 0 SControl 300) [ 5.087415] ata2: SATA link down (SStatus 0 SControl 300) [ 5.252884] ata9: SATA link down (SStatus 0 SControl 300) [ 5.258300] ata10: SATA link down (SStatus 0 SControl 300) [ 5.263794] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.269979] ata7: SATA link down (SStatus 0 SControl 300) [ 5.275406] ata8: SATA link down (SStatus 0 SControl 300) [ 5.280831] ata6: SATA link down (SStatus 0 SControl 300) [ 5.286973] ata5.00: NCQ Send/Recv Log not supported [ 5.291939] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.298194] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.306631] ata5.00: NCQ Send/Recv Log not supported [ 5.311596] ata5.00: configured for UDMA/133 [ 5.316027] scsi 4:0:0:0: Direct-Access ATA ST1000SN06 PQ: 0 ANSI:[ 5.329706] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.338730] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.346394] sd 4:0:0:0: [sda] Write Protect is off [ 5.351197] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.366652] sda: sda1 [ 5.369254] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.844340] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.854613] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.863117] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.869296] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d2:6a [ 5.877046] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.883672] libphy: ixgbe-mdio: probed [ 6.044261] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.054538] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.063041] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.070078] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d2:6b [ 6.077795] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.084377] libphy: ixgbe-mdio: probed [ 6.088978] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.100284] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…588-86c5-4fa7-ad82-5a8bfe76a5e8... [ OK ] Started File System Check on /dev/d…0b588-86c5-4fa7-ad82-5a8bfe76a5e8. Mounting /sysroot... [ 6.272039] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Plymouth switch root service... Starting Setup Virtual Console... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Slices. [ OK ] Stopped target Timers. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.602071] printk: systemd: 12 output lines suppressed due to ratelimiting [ 7.215381] SELinux: policy capability network_peer_controls=1 [ 7.221302] SELinux: policy capability open_perms=1 [ 7.226264] SELinux: policy capability extended_socket_class=1 [ 7.232174] SELinux: policy capability always_check_network=0 [ 7.237997] SELinux: policy capability cgroup_seclabel=1 [ 7.243388] SELinux: policy capability nnp_nosuid_transition=1 [ 7.271078] audit: type=1403 audit(1714134870.798:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.272698] systemd[1]: Successfully loaded SELinux policy in 221.632ms. [ 7.329327] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.589ms. [ 7.344741] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.379172] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 7.393423] systemd[1]: Set hostname to . [ 8.444191] systemd[1]: systemd-journald.service: Succeeded. [ 8.450516] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.456688] systemd[1]: Stopped Switch Root. [ OK [[ 8.461458] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.472946] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.483207] systemd[1]: Stopped Journal Service. [ OK [[ 8.489802] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... Mounting Huge Pages File System... [ OK ] Listening on Process Core Dump Socket. Mounting Kernel Debug File System... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Created slice system-getty.slice. Starting Remount Root and Kernel File Systems... [ OK ] Stopped target Switch Root. [ OK ] Created slice system-sshd\x2dkey[ 8.538890] EXT4-fs (sda1): re-mounted. Opts: (null) gen.slice. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... Mounting POSIX Message Queue File System... [ OK ] Listening on udev Kernel Socket. [ OK ] Stopped target Initrd Root File System. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Reached target Swap. Starting Load Kernel Modules... [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped Plymouth switch root service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Read and set NIS d[ 8.725211] fuse: init (API version 7.34) omainname from /[ 8.748759] device-mapper: uevent: version 1.0.3 etc/sysconfig/ne[ 8.754406] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com twork. Starting Load/Save Random Seed... [ OK ] Started Journal Service. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Load/Save Random Seed. Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load Kernel Modules. [ OK ] Started udev Coldplug all Devices. Starting Apply Kernel Variables... Mounting FUSE Control File System... [ OK ] Mounted FUSE Control File System. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Restore /run/initramfs on shutdown... Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... Starting udev Kernel Device Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Mounting RPC Pipe File System... Starting Security Auditing Service... [ 9.410786] IPMI message handler: version 39.2 [ 9.418450] ipmi device interface [ 9.424565] power_meter ACPI000D:00: Found ACPI power meter. [ 9.430277] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.437090] ipmi_si: IPMI System Interface driver [ 9.441880] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.448240] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.455467] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.461309] RPC: Registered named UNIX socket transport module. [ 9.461365] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.467228] RPC: Registered udp transport module. [ 9.473249] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.477857] RPC: Registered tcp transport module. [ 9.477859] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 9.496877] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Started RPC Bind. [[ 9.514221] igb 0000:07:00.0: DCA enabled OK ] Moun[ 9.519542] igb 0000:07:00.1: DCA enabled ted RPC Pipe Fil[ 9.525194] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt e System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event[ 9.545056] input: PC Speaker as /devices/platform/pcspkr/input/input4 activation on d[ 9.552752] mei_me 0000:00:16.0: Device doesn't have valid ME Interface evice 259:0... [ 9.552894] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.570615] ipmi_si: Adding ACPI-specified kcs state machine [ 9.576455] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.622548] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.630493] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.636156] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.660017] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.690938] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.694939] iTCO_vendor_support: vendor-support=0 [ 9.710496] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 9.710620] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 9.710995] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. [ 9.860292] ipmi_si IPI0001:00: IPMI kcs interface initialized Mounting /var/lib/ceph... [ 9.871222] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Listening on D-Bus System Message Bus Socket. [[0;3[ 9.954436] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 9.965713] EDAC sbridge: Ver: 1.1.2 2m OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Updates mlocate database every day. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Reached target Timers. [ OK ] Started CUPS Scheduler. [ OK ] Reached target Paths. [ OK ] Listening on CUPS Scheduler. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting VDO volume services... Starting Kernel Samepage Merging... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting System Security Services Daemon... [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started irqbalance daemon. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting Authorization Manager... [ 10.079336] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 10.087659] XFS (dm-4): Mounting V5 Filesystem [ 10.096073] XFS (dm-4): Ending clean mount Starting NTP client/server... [ OK ] Started Machine Check Exception Logging Daemon. Starting Avahi mDNS/DNS-SD Stack... Starting Resets System Activity Logs... [ OK ] Mounted /var/lib/ceph. [ OK ] Started Kernel Samepage Merging. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ 10.267854] intel_rapl_common: Found RAPL domain package [ 10.273180] intel_rapl_common: Found RAPL domain dram [ 10.278231] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting Enable periodic update of entitlement certificates.... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Enable periodic update of entitlement certificates.. [ OK ] Started Hostname Service. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ OK ] Started OpenSSH server daemon. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 12.155562] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.214008] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ OK ] Started Auth[ 12.221942] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready orization Manager. [ 12.271806] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.289698] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.333028] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.447936] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.455887] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.498645] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 12.607858] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.723520] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 12.927086] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 12.934954] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started VDO volume services. [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting CUPS Scheduler... Starting Permit User Sessions... Starting Login Service... [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ OK ] Started Login Service. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... Starting Notify NFS peers of a restart... [ OK ] Started Nagios Remote Plugin Executor. Starting System Logging Service... Starting /etc/rc.d/rc.local Compatibility... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started System Logging Service. + myips=172.21.15.98 + attempts=1 + sleep 1 + '[' 172.21.15.98 '!=' '' ']' + set -e + '[' -n 172.21.15.98 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.98 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.98 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi098.front.sepia.ceph.com + '[' -n smithi098.front.sepia.ceph.com ']' + hostname smithi098.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi098 + echo smithi098 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.98 smithi098.front.sepia.ceph.com smithi098\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-513.9.1.el8_9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi098 login: [disconnect] 2024-04-26T12:34:49.706 INFO:teuthology.misc:Re-opening connections... 2024-04-26T12:34:49.707 INFO:teuthology.misc:trying to connect to ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T12:34:49.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-26T12:34:49.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:34:50.621 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-04-26T12:34:51.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-26T12:34:51.568 DEBUG:teuthology.misc:waited 1.8615145683288574 2024-04-26T12:34:52.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~135s 2024-04-26T12:34:52.569 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T12:34:52.569 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi098.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-04-26T12:34:52.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:34:52.679 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:34:52.728 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:34:52.728 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:34:52.731 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:34:52.731 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:34:52.870 INFO:teuthology.orchestra.run.smithi098.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T12:34:52.873 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:34:52.873 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T12:34:53.661 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:34:53.659+0000 7fd65e7ee7c0 -1 Falling back to public interface 2024-04-26T12:34:57.874 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:no valid command found; 10 closest matches: 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:0 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:1 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:2 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:abort 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:assert 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:bluefs debug_inject_read_zeros 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:bluefs files list 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:bluefs stats 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:bluestore allocator dump block 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:bluestore allocator fragmentation block 2024-04-26T12:34:58.004 INFO:teuthology.orchestra.run.smithi098.stderr:admin_socket: invalid command 2024-04-26T12:34:58.006 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:34:58.007 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T12:34:58.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-26T12:35:00.733 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:35:00.733+0000 7fd65e7ee7c0 -1 osd.0 63 log_to_monitors true 2024-04-26T12:35:01.156 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-04-26T12:35:01.155+0000 7fd64a77e700 -1 osd.0 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:35:03.008 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:35:03.148 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-04-26T12:35:03.149 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-04-26T12:35:03.149 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-04-26T12:35:03.149 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-04-26T12:35:03.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:35:04.163 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:35:04.180 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:35:05.197 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:35:05.214 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:35:05.904 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:35:05.919 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:35:05.919 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:06.296 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:06.298 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:06.310 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-04-26T12:35:05.896942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":26,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116121,"ondisk_log_size":116121,"up":178,"acting":151,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2855628,"kb_used_data":169948,"kb_used_omap":10,"kb_used_meta":2685621,"kb_avail":280259892,"statfs":{"total":289910292480,"available":286986129408,"internally_reserved":0,"allocated":174026752,"data_stored":200919903,"data_compressed":149554,"data_compressed_allocated":15118336,"data_compressed_original":43102208,"omap_allocated":10267,"internal_metadata":2750076901},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.751570"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2066,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.963734+0000","last_change":"2024-04-26T12:35:04.964078+0000","last_active":"2024-04-26T12:35:04.963734+0000","last_peered":"2024-04-26T12:35:04.963734+0000","last_clean":"2024-04-26T12:32:35.991566+0000","last_became_active":"2024-04-26T12:35:04.962797+0000","last_became_peered":"2024-04-26T12:35:04.962797+0000","last_unstale":"2024-04-26T12:35:04.963734+0000","last_undegraded":"2024-04-26T12:35:04.190831+0000","last_fullsized":"2024-04-26T12:35:04.156108+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:18.058042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":74,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273188+0000","last_change":"2024-04-26T12:32:37.139935+0000","last_active":"2024-04-26T12:33:29.273188+0000","last_peered":"2024-04-26T12:33:29.273188+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.139935+0000","last_became_peered":"2024-04-26T12:32:37.139935+0000","last_unstale":"2024-04-26T12:33:29.273188+0000","last_undegraded":"2024-04-26T12:33:29.273188+0000","last_fullsized":"2024-04-26T12:32:37.136590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:55.581182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4120,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156296+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:03.156296+0000","last_peered":"2024-04-26T12:35:03.156296+0000","last_clean":"2024-04-26T12:35:03.156296+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:03.156296+0000","last_undegraded":"2024-04-26T12:35:03.156296+0000","last_fullsized":"2024-04-26T12:35:03.156296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":105,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.190199+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:03.190199+0000","last_peered":"2024-04-26T12:35:03.190199+0000","last_clean":"2024-04-26T12:35:03.190199+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:03.190199+0000","last_undegraded":"2024-04-26T12:35:03.190199+0000","last_fullsized":"2024-04-26T12:35:03.190199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2142,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.059964+0000","last_change":"2024-04-26T12:35:05.060136+0000","last_active":"2024-04-26T12:35:05.059964+0000","last_peered":"2024-04-26T12:35:05.059964+0000","last_clean":"2024-04-26T12:32:35.988371+0000","last_became_active":"2024-04-26T12:35:04.855454+0000","last_became_peered":"2024-04-26T12:35:04.855454+0000","last_unstale":"2024-04-26T12:35:05.059964+0000","last_undegraded":"2024-04-26T12:35:05.059964+0000","last_fullsized":"2024-04-26T12:35:04.191057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:47.113360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":48,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.268733+0000","last_change":"2024-04-26T12:32:37.143039+0000","last_active":"2024-04-26T12:33:28.268733+0000","last_peered":"2024-04-26T12:33:28.268733+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.143039+0000","last_became_peered":"2024-04-26T12:32:37.143039+0000","last_unstale":"2024-04-26T12:33:28.268733+0000","last_undegraded":"2024-04-26T12:33:28.268733+0000","last_fullsized":"2024-04-26T12:32:37.139286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:52.811599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":47,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.269054+0000","last_change":"2024-04-26T12:32:37.156827+0000","last_active":"2024-04-26T12:33:28.269054+0000","last_peered":"2024-04-26T12:33:28.269054+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.156827+0000","last_became_peered":"2024-04-26T12:32:37.156827+0000","last_unstale":"2024-04-26T12:33:28.269054+0000","last_undegraded":"2024-04-26T12:33:28.269054+0000","last_fullsized":"2024-04-26T12:32:37.140301+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:37.076435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8169,"reported_epoch":87,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2024-04-26T12:35:04.923824+0000","last_change":"2024-04-26T12:35:04.923993+0000","last_active":"2024-04-26T12:35:04.923824+0000","last_peered":"2024-04-26T12:35:04.923824+0000","last_clean":"2024-04-26T12:32:36.110957+0000","last_became_active":"2024-04-26T12:35:04.922253+0000","last_became_peered":"2024-04-26T12:35:04.922253+0000","last_unstale":"2024-04-26T12:35:04.923824+0000","last_undegraded":"2024-04-26T12:35:04.923824+0000","last_fullsized":"2024-04-26T12:35:04.157067+0000","mapping_epoch":86,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:39.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6167,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.964000+0000","last_change":"2024-04-26T12:35:04.964000+0000","last_active":"2024-04-26T12:35:04.964000+0000","last_peered":"2024-04-26T12:35:04.964000+0000","last_clean":"2024-04-26T12:32:36.097694+0000","last_became_active":"2024-04-26T12:35:04.961544+0000","last_became_peered":"2024-04-26T12:35:04.961544+0000","last_unstale":"2024-04-26T12:35:04.964000+0000","last_undegraded":"2024-04-26T12:35:04.235838+0000","last_fullsized":"2024-04-26T12:35:04.156390+0000","mapping_epoch":86,"log_start":"62'1600","ondisk_log_start":"62'1600","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4481,"log_dups_size":1600,"ondisk_log_size":4481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:04.981036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6213,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.915068+0000","last_change":"2024-04-26T12:35:04.915184+0000","last_active":"2024-04-26T12:35:04.915068+0000","last_peered":"2024-04-26T12:35:04.915068+0000","last_clean":"2024-04-26T12:32:36.054632+0000","last_became_active":"2024-04-26T12:35:04.913607+0000","last_became_peered":"2024-04-26T12:35:04.913607+0000","last_unstale":"2024-04-26T12:35:04.915068+0000","last_undegraded":"2024-04-26T12:35:04.234907+0000","last_fullsized":"2024-04-26T12:35:04.156225+0000","mapping_epoch":86,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:13.092049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4068,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.041117+0000","last_change":"2024-04-26T12:35:05.041294+0000","last_active":"2024-04-26T12:35:05.041117+0000","last_peered":"2024-04-26T12:35:05.041117+0000","last_clean":"2024-04-26T12:32:36.099119+0000","last_became_active":"2024-04-26T12:35:04.906093+0000","last_became_peered":"2024-04-26T12:35:04.906093+0000","last_unstale":"2024-04-26T12:35:05.041117+0000","last_undegraded":"2024-04-26T12:35:05.041117+0000","last_fullsized":"2024-04-26T12:35:04.158661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:02.195242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2097,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154707+0000","last_change":"2024-04-26T12:32:16.107668+0000","last_active":"2024-04-26T12:35:03.154707+0000","last_peered":"2024-04-26T12:35:03.154707+0000","last_clean":"2024-04-26T12:35:03.154707+0000","last_became_active":"2024-04-26T12:32:16.107458+0000","last_became_peered":"2024-04-26T12:32:16.107458+0000","last_unstale":"2024-04-26T12:35:03.154707+0000","last_undegraded":"2024-04-26T12:35:03.154707+0000","last_fullsized":"2024-04-26T12:35:03.154707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.458028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2125,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.968364+0000","last_change":"2024-04-26T12:35:04.968539+0000","last_active":"2024-04-26T12:35:04.968364+0000","last_peered":"2024-04-26T12:35:04.968364+0000","last_clean":"2024-04-26T12:32:35.954605+0000","last_became_active":"2024-04-26T12:35:04.854268+0000","last_became_peered":"2024-04-26T12:35:04.854268+0000","last_unstale":"2024-04-26T12:35:04.968364+0000","last_undegraded":"2024-04-26T12:35:04.968364+0000","last_fullsized":"2024-04-26T12:35:04.155082+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:24.178531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2135,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.157272+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:03.157272+0000","last_peered":"2024-04-26T12:35:03.157272+0000","last_clean":"2024-04-26T12:35:03.157272+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:03.157272+0000","last_undegraded":"2024-04-26T12:35:03.157272+0000","last_fullsized":"2024-04-26T12:35:03.157272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160274+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:03.160274+0000","last_peered":"2024-04-26T12:35:03.160274+0000","last_clean":"2024-04-26T12:35:03.160274+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:03.160274+0000","last_undegraded":"2024-04-26T12:35:03.160274+0000","last_fullsized":"2024-04-26T12:35:03.160274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2095,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.923084+0000","last_change":"2024-04-26T12:35:04.923218+0000","last_active":"2024-04-26T12:35:04.923084+0000","last_peered":"2024-04-26T12:35:04.923084+0000","last_clean":"2024-04-26T12:32:35.989411+0000","last_became_active":"2024-04-26T12:35:04.922269+0000","last_became_peered":"2024-04-26T12:35:04.922269+0000","last_unstale":"2024-04-26T12:35:04.923084+0000","last_undegraded":"2024-04-26T12:35:04.186060+0000","last_fullsized":"2024-04-26T12:35:04.157085+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.241095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2105,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.962518+0000","last_change":"2024-04-26T12:35:04.963904+0000","last_active":"2024-04-26T12:35:04.962518+0000","last_peered":"2024-04-26T12:35:04.962518+0000","last_clean":"2024-04-26T12:32:35.945501+0000","last_became_active":"2024-04-26T12:35:04.961537+0000","last_became_peered":"2024-04-26T12:35:04.961537+0000","last_unstale":"2024-04-26T12:35:04.962518+0000","last_undegraded":"2024-04-26T12:35:04.242372+0000","last_fullsized":"2024-04-26T12:35:04.238086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:47.807752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2122,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.913404+0000","last_change":"2024-04-26T12:35:04.914665+0000","last_active":"2024-04-26T12:35:04.913404+0000","last_peered":"2024-04-26T12:35:04.913404+0000","last_clean":"2024-04-26T12:32:36.044461+0000","last_became_active":"2024-04-26T12:35:04.912646+0000","last_became_peered":"2024-04-26T12:35:04.912646+0000","last_unstale":"2024-04-26T12:35:04.913404+0000","last_undegraded":"2024-04-26T12:35:04.242068+0000","last_fullsized":"2024-04-26T12:35:04.237387+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:55.840854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4086,"reported_epoch":87,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.906212+0000","last_change":"2024-04-26T12:35:05.152426+0000","last_active":"2024-04-26T12:35:04.906212+0000","last_peered":"2024-04-26T12:35:04.906212+0000","last_clean":"2024-04-26T12:32:36.045736+0000","last_became_active":"2024-04-26T12:35:04.904573+0000","last_became_peered":"2024-04-26T12:35:04.904573+0000","last_unstale":"2024-04-26T12:35:04.906212+0000","last_undegraded":"2024-04-26T12:35:04.225563+0000","last_fullsized":"2024-04-26T12:35:04.155914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:20.306610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4198,"reported_epoch":87,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:35:05.091495+0000","last_change":"2024-04-26T12:35:05.098528+0000","last_active":"2024-04-26T12:35:05.091495+0000","last_peered":"2024-04-26T12:35:05.091495+0000","last_clean":"2024-04-26T12:32:36.109719+0000","last_became_active":"2024-04-26T12:35:04.916325+0000","last_became_peered":"2024-04-26T12:35:04.916325+0000","last_unstale":"2024-04-26T12:35:05.091495+0000","last_undegraded":"2024-04-26T12:35:04.203928+0000","last_fullsized":"2024-04-26T12:35:04.158911+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:28.705010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":108,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157590+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:04.157590+0000","last_peered":"2024-04-26T12:35:04.157590+0000","last_clean":"2024-04-26T12:35:04.157590+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:04.157590+0000","last_undegraded":"2024-04-26T12:35:04.157590+0000","last_fullsized":"2024-04-26T12:35:04.157590+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2105,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.154914+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:04.154914+0000","last_peered":"2024-04-26T12:35:04.154914+0000","last_clean":"2024-04-26T12:35:04.154914+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:04.154914+0000","last_undegraded":"2024-04-26T12:35:04.154914+0000","last_fullsized":"2024-04-26T12:35:04.154914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2089,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.982579+0000","last_change":"2024-04-26T12:35:04.982742+0000","last_active":"2024-04-26T12:35:04.982579+0000","last_peered":"2024-04-26T12:35:04.982579+0000","last_clean":"2024-04-26T12:32:36.090341+0000","last_became_active":"2024-04-26T12:35:04.864271+0000","last_became_peered":"2024-04-26T12:35:04.864271+0000","last_unstale":"2024-04-26T12:35:04.982579+0000","last_undegraded":"2024-04-26T12:35:04.982579+0000","last_fullsized":"2024-04-26T12:35:04.157008+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:14.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4120,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.923700+0000","last_change":"2024-04-26T12:35:04.923909+0000","last_active":"2024-04-26T12:35:04.923700+0000","last_peered":"2024-04-26T12:35:04.923700+0000","last_clean":"2024-04-26T12:32:36.098162+0000","last_became_active":"2024-04-26T12:35:04.922403+0000","last_became_peered":"2024-04-26T12:35:04.922403+0000","last_unstale":"2024-04-26T12:35:04.923700+0000","last_undegraded":"2024-04-26T12:35:04.214799+0000","last_fullsized":"2024-04-26T12:35:04.155135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:04.379304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2140,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155032+0000","last_change":"2024-04-26T12:32:16.109558+0000","last_active":"2024-04-26T12:35:03.155032+0000","last_peered":"2024-04-26T12:35:03.155032+0000","last_clean":"2024-04-26T12:35:03.155032+0000","last_became_active":"2024-04-26T12:32:16.109196+0000","last_became_peered":"2024-04-26T12:32:16.109196+0000","last_unstale":"2024-04-26T12:35:03.155032+0000","last_undegraded":"2024-04-26T12:35:03.155032+0000","last_fullsized":"2024-04-26T12:35:03.155032+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:25.423545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":42,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.277339+0000","last_change":"2024-04-26T12:32:37.142921+0000","last_active":"2024-04-26T12:33:29.277339+0000","last_peered":"2024-04-26T12:33:29.277339+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.142921+0000","last_became_peered":"2024-04-26T12:32:37.142921+0000","last_unstale":"2024-04-26T12:33:29.277339+0000","last_undegraded":"2024-04-26T12:33:29.277339+0000","last_fullsized":"2024-04-26T12:32:37.139045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:37.961455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2090,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155387+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:03.155387+0000","last_peered":"2024-04-26T12:35:03.155387+0000","last_clean":"2024-04-26T12:35:03.155387+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:03.155387+0000","last_undegraded":"2024-04-26T12:35:03.155387+0000","last_fullsized":"2024-04-26T12:35:03.155387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":71,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.268958+0000","last_change":"2024-04-26T12:32:37.164884+0000","last_active":"2024-04-26T12:33:28.268958+0000","last_peered":"2024-04-26T12:33:28.268958+0000","last_clean":"2024-04-26T12:32:14.263808+0000","last_became_active":"2024-04-26T12:32:37.164884+0000","last_became_peered":"2024-04-26T12:32:37.164884+0000","last_unstale":"2024-04-26T12:33:28.268958+0000","last_undegraded":"2024-04-26T12:33:28.268958+0000","last_fullsized":"2024-04-26T12:32:37.136846+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:53.064759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155103+0000","last_change":"2024-04-26T12:32:16.110135+0000","last_active":"2024-04-26T12:35:03.155103+0000","last_peered":"2024-04-26T12:35:03.155103+0000","last_clean":"2024-04-26T12:35:03.155103+0000","last_became_active":"2024-04-26T12:32:16.109837+0000","last_became_peered":"2024-04-26T12:32:16.109837+0000","last_unstale":"2024-04-26T12:35:03.155103+0000","last_undegraded":"2024-04-26T12:35:03.155103+0000","last_fullsized":"2024-04-26T12:35:03.155103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:19.898367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.268692+0000","last_change":"2024-04-26T12:32:37.157859+0000","last_active":"2024-04-26T12:33:28.268692+0000","last_peered":"2024-04-26T12:33:28.268692+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.157859+0000","last_became_peered":"2024-04-26T12:32:37.157859+0000","last_unstale":"2024-04-26T12:33:28.268692+0000","last_undegraded":"2024-04-26T12:33:28.268692+0000","last_fullsized":"2024-04-26T12:32:37.139659+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:42.515112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":32,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.277863+0000","last_change":"2024-04-26T12:32:37.145802+0000","last_active":"2024-04-26T12:33:29.277863+0000","last_peered":"2024-04-26T12:33:29.277863+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.145802+0000","last_became_peered":"2024-04-26T12:32:37.145802+0000","last_unstale":"2024-04-26T12:33:29.277863+0000","last_undegraded":"2024-04-26T12:33:29.277863+0000","last_fullsized":"2024-04-26T12:32:37.140433+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:13.574704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.268947+0000","last_change":"2024-04-26T12:32:37.153951+0000","last_active":"2024-04-26T12:33:28.268947+0000","last_peered":"2024-04-26T12:33:28.268947+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.153951+0000","last_became_peered":"2024-04-26T12:32:37.153951+0000","last_unstale":"2024-04-26T12:33:28.268947+0000","last_undegraded":"2024-04-26T12:33:28.268947+0000","last_fullsized":"2024-04-26T12:32:37.136360+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:24.892906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156554+0000","last_change":"2024-04-26T12:32:16.109433+0000","last_active":"2024-04-26T12:35:03.156554+0000","last_peered":"2024-04-26T12:35:03.156554+0000","last_clean":"2024-04-26T12:35:03.156554+0000","last_became_active":"2024-04-26T12:32:16.109171+0000","last_became_peered":"2024-04-26T12:32:16.109171+0000","last_unstale":"2024-04-26T12:35:03.156554+0000","last_undegraded":"2024-04-26T12:35:03.156554+0000","last_fullsized":"2024-04-26T12:35:03.156554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":27,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.269812+0000","last_change":"2024-04-26T12:32:37.163385+0000","last_active":"2024-04-26T12:33:28.269812+0000","last_peered":"2024-04-26T12:33:28.269812+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.163385+0000","last_became_peered":"2024-04-26T12:32:37.163385+0000","last_unstale":"2024-04-26T12:33:28.269812+0000","last_undegraded":"2024-04-26T12:33:28.269812+0000","last_fullsized":"2024-04-26T12:32:37.140677+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:37.029134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":33,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272107+0000","last_change":"2024-04-26T12:32:37.138388+0000","last_active":"2024-04-26T12:33:29.272107+0000","last_peered":"2024-04-26T12:33:29.272107+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.138388+0000","last_became_peered":"2024-04-26T12:32:37.138388+0000","last_unstale":"2024-04-26T12:33:29.272107+0000","last_undegraded":"2024-04-26T12:33:29.272107+0000","last_fullsized":"2024-04-26T12:32:37.135837+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:27.473419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":43,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.269806+0000","last_change":"2024-04-26T12:32:37.142429+0000","last_active":"2024-04-26T12:33:28.269806+0000","last_peered":"2024-04-26T12:33:28.269806+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.142429+0000","last_became_peered":"2024-04-26T12:32:37.142429+0000","last_unstale":"2024-04-26T12:33:28.269806+0000","last_undegraded":"2024-04-26T12:33:28.269806+0000","last_fullsized":"2024-04-26T12:32:37.139089+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:09.704532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6150,"reported_epoch":87,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2024-04-26T12:35:04.865878+0000","last_change":"2024-04-26T12:35:04.866031+0000","last_active":"2024-04-26T12:35:04.865878+0000","last_peered":"2024-04-26T12:35:04.865878+0000","last_clean":"2024-04-26T12:32:36.090113+0000","last_became_active":"2024-04-26T12:35:04.864319+0000","last_became_peered":"2024-04-26T12:35:04.864319+0000","last_unstale":"2024-04-26T12:35:04.865878+0000","last_undegraded":"2024-04-26T12:35:04.865878+0000","last_fullsized":"2024-04-26T12:35:04.157028+0000","mapping_epoch":86,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:40.572498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":57,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155132+0000","last_change":"2024-04-26T12:32:16.109604+0000","last_active":"2024-04-26T12:35:03.155132+0000","last_peered":"2024-04-26T12:35:03.155132+0000","last_clean":"2024-04-26T12:35:03.155132+0000","last_became_active":"2024-04-26T12:32:16.109232+0000","last_became_peered":"2024-04-26T12:32:16.109232+0000","last_unstale":"2024-04-26T12:35:03.155132+0000","last_undegraded":"2024-04-26T12:35:03.155132+0000","last_fullsized":"2024-04-26T12:35:03.155132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:08.819922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4156,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.013009+0000","last_change":"2024-04-26T12:35:05.013254+0000","last_active":"2024-04-26T12:35:05.013009+0000","last_peered":"2024-04-26T12:35:05.013009+0000","last_clean":"2024-04-26T12:32:36.101997+0000","last_became_active":"2024-04-26T12:35:04.854225+0000","last_became_peered":"2024-04-26T12:35:04.854225+0000","last_unstale":"2024-04-26T12:35:05.013009+0000","last_undegraded":"2024-04-26T12:35:05.013009+0000","last_fullsized":"2024-04-26T12:35:04.155184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.311308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":180,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156465+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:03.156465+0000","last_peered":"2024-04-26T12:35:03.156465+0000","last_clean":"2024-04-26T12:35:03.156465+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:03.156465+0000","last_undegraded":"2024-04-26T12:35:03.156465+0000","last_fullsized":"2024-04-26T12:35:03.156465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4177,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158648+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:03.158648+0000","last_peered":"2024-04-26T12:35:03.158648+0000","last_clean":"2024-04-26T12:35:03.158648+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:03.158648+0000","last_undegraded":"2024-04-26T12:35:03.158648+0000","last_fullsized":"2024-04-26T12:35:03.158648+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185706+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:03.185706+0000","last_peered":"2024-04-26T12:35:03.185706+0000","last_clean":"2024-04-26T12:35:03.185706+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:03.185706+0000","last_undegraded":"2024-04-26T12:35:03.185706+0000","last_fullsized":"2024-04-26T12:35:03.185706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2063,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.916585+0000","last_change":"2024-04-26T12:35:04.916714+0000","last_active":"2024-04-26T12:35:04.916585+0000","last_peered":"2024-04-26T12:35:04.916585+0000","last_clean":"2024-04-26T12:32:35.952933+0000","last_became_active":"2024-04-26T12:35:04.915892+0000","last_became_peered":"2024-04-26T12:35:04.915892+0000","last_unstale":"2024-04-26T12:35:04.916585+0000","last_undegraded":"2024-04-26T12:35:04.189159+0000","last_fullsized":"2024-04-26T12:35:04.155551+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:29.672337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.277167+0000","last_change":"2024-04-26T12:32:37.143702+0000","last_active":"2024-04-26T12:33:29.277167+0000","last_peered":"2024-04-26T12:33:29.277167+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.143702+0000","last_became_peered":"2024-04-26T12:32:37.143702+0000","last_unstale":"2024-04-26T12:33:29.277167+0000","last_undegraded":"2024-04-26T12:33:29.277167+0000","last_fullsized":"2024-04-26T12:32:37.140209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:12.152629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2065,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.137509+0000","last_change":"2024-04-26T12:35:05.137729+0000","last_active":"2024-04-26T12:35:05.137509+0000","last_peered":"2024-04-26T12:35:05.137509+0000","last_clean":"2024-04-26T12:32:36.076094+0000","last_became_active":"2024-04-26T12:35:04.904565+0000","last_became_peered":"2024-04-26T12:35:04.904565+0000","last_unstale":"2024-04-26T12:35:05.137509+0000","last_undegraded":"2024-04-26T12:35:05.137509+0000","last_fullsized":"2024-04-26T12:35:04.158065+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:07.708928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160145+0000","last_change":"2024-04-26T12:32:16.107025+0000","last_active":"2024-04-26T12:35:03.160145+0000","last_peered":"2024-04-26T12:35:03.160145+0000","last_clean":"2024-04-26T12:35:03.160145+0000","last_became_active":"2024-04-26T12:32:16.106307+0000","last_became_peered":"2024-04-26T12:32:16.106307+0000","last_unstale":"2024-04-26T12:35:03.160145+0000","last_undegraded":"2024-04-26T12:35:03.160145+0000","last_fullsized":"2024-04-26T12:35:03.160145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:31.214495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":36,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.270086+0000","last_change":"2024-04-26T12:32:37.145810+0000","last_active":"2024-04-26T12:33:28.270086+0000","last_peered":"2024-04-26T12:33:28.270086+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.145810+0000","last_became_peered":"2024-04-26T12:32:37.145810+0000","last_unstale":"2024-04-26T12:33:28.270086+0000","last_undegraded":"2024-04-26T12:33:28.270086+0000","last_fullsized":"2024-04-26T12:32:37.140622+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:22.880942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":93,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156725+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:03.156725+0000","last_peered":"2024-04-26T12:35:03.156725+0000","last_clean":"2024-04-26T12:35:03.156725+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:03.156725+0000","last_undegraded":"2024-04-26T12:35:03.156725+0000","last_fullsized":"2024-04-26T12:35:03.156725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2157,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.962246+0000","last_change":"2024-04-26T12:35:04.962246+0000","last_active":"2024-04-26T12:35:04.962246+0000","last_peered":"2024-04-26T12:35:04.962246+0000","last_clean":"2024-04-26T12:32:35.940778+0000","last_became_active":"2024-04-26T12:35:04.961361+0000","last_became_peered":"2024-04-26T12:35:04.961361+0000","last_unstale":"2024-04-26T12:35:04.962246+0000","last_undegraded":"2024-04-26T12:35:04.194420+0000","last_fullsized":"2024-04-26T12:35:04.158738+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:49.140618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.158266+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:04.158266+0000","last_peered":"2024-04-26T12:35:04.158266+0000","last_clean":"2024-04-26T12:35:04.158266+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:04.158266+0000","last_undegraded":"2024-04-26T12:35:04.158266+0000","last_fullsized":"2024-04-26T12:35:04.158266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.153716+0000","last_change":"2024-04-26T12:32:16.109694+0000","last_active":"2024-04-26T12:35:03.153716+0000","last_peered":"2024-04-26T12:35:03.153716+0000","last_clean":"2024-04-26T12:35:03.153716+0000","last_became_active":"2024-04-26T12:32:16.109070+0000","last_became_peered":"2024-04-26T12:32:16.109070+0000","last_unstale":"2024-04-26T12:35:03.153716+0000","last_undegraded":"2024-04-26T12:35:03.153716+0000","last_fullsized":"2024-04-26T12:35:03.153716+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:54.733914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":85,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157540+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:04.157540+0000","last_peered":"2024-04-26T12:35:04.157540+0000","last_clean":"2024-04-26T12:35:04.157540+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:04.157540+0000","last_undegraded":"2024-04-26T12:35:04.157540+0000","last_fullsized":"2024-04-26T12:35:04.157540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":72,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272923+0000","last_change":"2024-04-26T12:32:37.149684+0000","last_active":"2024-04-26T12:33:29.272923+0000","last_peered":"2024-04-26T12:33:29.272923+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.149684+0000","last_became_peered":"2024-04-26T12:32:37.149684+0000","last_unstale":"2024-04-26T12:33:29.272923+0000","last_undegraded":"2024-04-26T12:33:29.272923+0000","last_fullsized":"2024-04-26T12:32:37.136839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:30.471721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":81,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.150234+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:35:03.150234+0000","last_peered":"2024-04-26T12:35:03.150234+0000","last_clean":"2024-04-26T12:35:03.150234+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:35:03.150234+0000","last_undegraded":"2024-04-26T12:35:03.150234+0000","last_fullsized":"2024-04-26T12:35:03.150234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2092,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.889386+0000","last_change":"2024-04-26T12:35:04.889560+0000","last_active":"2024-04-26T12:35:04.889386+0000","last_peered":"2024-04-26T12:35:04.889386+0000","last_clean":"2024-04-26T12:32:36.095836+0000","last_became_active":"2024-04-26T12:35:04.852698+0000","last_became_peered":"2024-04-26T12:35:04.852698+0000","last_unstale":"2024-04-26T12:35:04.889386+0000","last_undegraded":"2024-04-26T12:35:04.889386+0000","last_fullsized":"2024-04-26T12:35:04.158275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:04.200236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157564+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:04.157564+0000","last_peered":"2024-04-26T12:35:04.157564+0000","last_clean":"2024-04-26T12:35:04.157564+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:04.157564+0000","last_undegraded":"2024-04-26T12:35:04.157564+0000","last_fullsized":"2024-04-26T12:35:04.157564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":35,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.276513+0000","last_change":"2024-04-26T12:32:37.142490+0000","last_active":"2024-04-26T12:33:29.276513+0000","last_peered":"2024-04-26T12:33:29.276513+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.142490+0000","last_became_peered":"2024-04-26T12:32:37.142490+0000","last_unstale":"2024-04-26T12:33:29.276513+0000","last_undegraded":"2024-04-26T12:33:29.276513+0000","last_fullsized":"2024-04-26T12:32:37.138774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:59.048653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":36,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.276796+0000","last_change":"2024-04-26T12:32:37.148302+0000","last_active":"2024-04-26T12:33:29.276796+0000","last_peered":"2024-04-26T12:33:29.276796+0000","last_clean":"2024-04-26T12:30:32.599833+0000","last_became_active":"2024-04-26T12:32:37.148302+0000","last_became_peered":"2024-04-26T12:32:37.148302+0000","last_unstale":"2024-04-26T12:33:29.276796+0000","last_undegraded":"2024-04-26T12:32:37.140352+0000","last_fullsized":"2024-04-26T12:32:37.140274+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:05.143389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2080,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.074617+0000","last_change":"2024-04-26T12:35:05.074617+0000","last_active":"2024-04-26T12:35:05.074617+0000","last_peered":"2024-04-26T12:35:05.074617+0000","last_clean":"2024-04-26T12:32:36.109396+0000","last_became_active":"2024-04-26T12:35:04.916362+0000","last_became_peered":"2024-04-26T12:35:04.916362+0000","last_unstale":"2024-04-26T12:35:05.074617+0000","last_undegraded":"2024-04-26T12:35:05.074617+0000","last_fullsized":"2024-04-26T12:35:04.157688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:30.735718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.181023+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:03.181023+0000","last_peered":"2024-04-26T12:35:03.181023+0000","last_clean":"2024-04-26T12:35:03.181023+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:03.181023+0000","last_undegraded":"2024-04-26T12:35:03.181023+0000","last_fullsized":"2024-04-26T12:35:03.181023+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2123,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.161640+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:04.161640+0000","last_peered":"2024-04-26T12:35:04.161640+0000","last_clean":"2024-04-26T12:35:04.161640+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:04.161640+0000","last_undegraded":"2024-04-26T12:35:04.161640+0000","last_fullsized":"2024-04-26T12:35:04.161640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160320+0000","last_change":"2024-04-26T12:32:16.109449+0000","last_active":"2024-04-26T12:35:03.160320+0000","last_peered":"2024-04-26T12:35:03.160320+0000","last_clean":"2024-04-26T12:35:03.160320+0000","last_became_active":"2024-04-26T12:32:16.109131+0000","last_became_peered":"2024-04-26T12:32:16.109131+0000","last_unstale":"2024-04-26T12:35:03.160320+0000","last_undegraded":"2024-04-26T12:35:03.160320+0000","last_fullsized":"2024-04-26T12:35:03.160320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:47.757728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.158233+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:04.158233+0000","last_peered":"2024-04-26T12:35:04.158233+0000","last_clean":"2024-04-26T12:35:04.158233+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:04.158233+0000","last_undegraded":"2024-04-26T12:35:04.158233+0000","last_fullsized":"2024-04-26T12:35:04.158233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272270+0000","last_change":"2024-04-26T12:32:37.138617+0000","last_active":"2024-04-26T12:33:29.272270+0000","last_peered":"2024-04-26T12:33:29.272270+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.138617+0000","last_became_peered":"2024-04-26T12:32:37.138617+0000","last_unstale":"2024-04-26T12:33:29.272270+0000","last_undegraded":"2024-04-26T12:33:29.272270+0000","last_fullsized":"2024-04-26T12:32:37.135998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:08.819922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6171,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.965370+0000","last_change":"2024-04-26T12:35:04.965518+0000","last_active":"2024-04-26T12:35:04.965370+0000","last_peered":"2024-04-26T12:35:04.965370+0000","last_clean":"2024-04-26T12:32:36.042703+0000","last_became_active":"2024-04-26T12:35:04.963869+0000","last_became_peered":"2024-04-26T12:35:04.963869+0000","last_unstale":"2024-04-26T12:35:04.965370+0000","last_undegraded":"2024-04-26T12:35:04.240774+0000","last_fullsized":"2024-04-26T12:35:04.197145+0000","mapping_epoch":86,"log_start":"62'1600","ondisk_log_start":"62'1600","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":1600,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:33.175292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272743+0000","last_change":"2024-04-26T12:32:37.139346+0000","last_active":"2024-04-26T12:33:29.272743+0000","last_peered":"2024-04-26T12:33:29.272743+0000","last_clean":"2024-04-26T12:30:25.764494+0000","last_became_active":"2024-04-26T12:32:37.139346+0000","last_became_peered":"2024-04-26T12:32:37.139346+0000","last_unstale":"2024-04-26T12:33:29.272743+0000","last_undegraded":"2024-04-26T12:33:29.272743+0000","last_fullsized":"2024-04-26T12:32:37.136119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:26.611762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185408+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:03.185408+0000","last_peered":"2024-04-26T12:35:03.185408+0000","last_clean":"2024-04-26T12:35:03.185408+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:03.185408+0000","last_undegraded":"2024-04-26T12:35:03.185408+0000","last_fullsized":"2024-04-26T12:35:03.185408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155589+0000","last_change":"2024-04-26T12:32:16.107013+0000","last_active":"2024-04-26T12:35:03.155589+0000","last_peered":"2024-04-26T12:35:03.155589+0000","last_clean":"2024-04-26T12:35:03.155589+0000","last_became_active":"2024-04-26T12:32:16.106306+0000","last_became_peered":"2024-04-26T12:32:16.106306+0000","last_unstale":"2024-04-26T12:35:03.155589+0000","last_undegraded":"2024-04-26T12:35:03.155589+0000","last_fullsized":"2024-04-26T12:35:03.155589+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:34.079328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183091+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:03.183091+0000","last_peered":"2024-04-26T12:35:03.183091+0000","last_clean":"2024-04-26T12:35:03.183091+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:03.183091+0000","last_undegraded":"2024-04-26T12:35:03.183091+0000","last_fullsized":"2024-04-26T12:35:03.183091+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185719+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:03.185719+0000","last_peered":"2024-04-26T12:35:03.185719+0000","last_clean":"2024-04-26T12:35:03.185719+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:03.185719+0000","last_undegraded":"2024-04-26T12:35:03.185719+0000","last_fullsized":"2024-04-26T12:35:03.185719+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":36,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272847+0000","last_change":"2024-04-26T12:32:37.141563+0000","last_active":"2024-04-26T12:33:29.272847+0000","last_peered":"2024-04-26T12:33:29.272847+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.141563+0000","last_became_peered":"2024-04-26T12:32:37.141563+0000","last_unstale":"2024-04-26T12:33:29.272847+0000","last_undegraded":"2024-04-26T12:33:29.272847+0000","last_fullsized":"2024-04-26T12:32:37.136397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:34.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272452+0000","last_change":"2024-04-26T12:32:37.140247+0000","last_active":"2024-04-26T12:33:29.272452+0000","last_peered":"2024-04-26T12:33:29.272452+0000","last_clean":"2024-04-26T12:30:25.764494+0000","last_became_active":"2024-04-26T12:32:37.140247+0000","last_became_peered":"2024-04-26T12:32:37.140247+0000","last_unstale":"2024-04-26T12:33:29.272452+0000","last_undegraded":"2024-04-26T12:33:29.272452+0000","last_fullsized":"2024-04-26T12:32:37.136930+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:12.361464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.149178+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:03.149178+0000","last_peered":"2024-04-26T12:35:03.149178+0000","last_clean":"2024-04-26T12:35:03.149178+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:03.149178+0000","last_undegraded":"2024-04-26T12:35:03.149178+0000","last_fullsized":"2024-04-26T12:35:03.149178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":32,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273775+0000","last_change":"2024-04-26T12:32:37.156459+0000","last_active":"2024-04-26T12:33:29.273775+0000","last_peered":"2024-04-26T12:33:29.273775+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.156459+0000","last_became_peered":"2024-04-26T12:32:37.156459+0000","last_unstale":"2024-04-26T12:33:29.273775+0000","last_undegraded":"2024-04-26T12:33:29.273775+0000","last_fullsized":"2024-04-26T12:32:37.137899+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:57.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185680+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:03.185680+0000","last_peered":"2024-04-26T12:35:03.185680+0000","last_clean":"2024-04-26T12:35:03.185680+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:03.185680+0000","last_undegraded":"2024-04-26T12:35:03.185680+0000","last_fullsized":"2024-04-26T12:35:03.185680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":284,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155032+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:03.155032+0000","last_peered":"2024-04-26T12:35:03.155032+0000","last_clean":"2024-04-26T12:35:03.155032+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:03.155032+0000","last_undegraded":"2024-04-26T12:35:03.155032+0000","last_fullsized":"2024-04-26T12:35:03.155032+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272350+0000","last_change":"2024-04-26T12:32:37.165168+0000","last_active":"2024-04-26T12:33:29.272350+0000","last_peered":"2024-04-26T12:33:29.272350+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.165168+0000","last_became_peered":"2024-04-26T12:32:37.165168+0000","last_unstale":"2024-04-26T12:33:29.272350+0000","last_undegraded":"2024-04-26T12:33:29.272350+0000","last_fullsized":"2024-04-26T12:32:37.136267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:27.113179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":67,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158127+0000","last_change":"2024-04-26T12:32:16.106958+0000","last_active":"2024-04-26T12:35:03.158127+0000","last_peered":"2024-04-26T12:35:03.158127+0000","last_clean":"2024-04-26T12:35:03.158127+0000","last_became_active":"2024-04-26T12:32:16.106262+0000","last_became_peered":"2024-04-26T12:32:16.106262+0000","last_unstale":"2024-04-26T12:35:03.158127+0000","last_undegraded":"2024-04-26T12:35:03.158127+0000","last_fullsized":"2024-04-26T12:35:03.158127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:33.467447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155192+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:03.155192+0000","last_peered":"2024-04-26T12:35:03.155192+0000","last_clean":"2024-04-26T12:35:03.155192+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:03.155192+0000","last_undegraded":"2024-04-26T12:35:03.155192+0000","last_fullsized":"2024-04-26T12:35:03.155192+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":32,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.276899+0000","last_change":"2024-04-26T12:33:21.670978+0000","last_active":"2024-04-26T12:33:29.276899+0000","last_peered":"2024-04-26T12:33:29.276899+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.156469+0000","last_became_peered":"2024-04-26T12:32:37.156469+0000","last_unstale":"2024-04-26T12:33:29.276899+0000","last_undegraded":"2024-04-26T12:33:21.668269+0000","last_fullsized":"2024-04-26T12:32:37.140070+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:12.925576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8072,"reported_epoch":87,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2024-04-26T12:35:04.914529+0000","last_change":"2024-04-26T12:35:04.914721+0000","last_active":"2024-04-26T12:35:04.914529+0000","last_peered":"2024-04-26T12:35:04.914529+0000","last_clean":"2024-04-26T12:32:36.002439+0000","last_became_active":"2024-04-26T12:35:04.912946+0000","last_became_peered":"2024-04-26T12:35:04.912946+0000","last_unstale":"2024-04-26T12:35:04.914529+0000","last_undegraded":"2024-04-26T12:35:04.914529+0000","last_fullsized":"2024-04-26T12:35:04.157946+0000","mapping_epoch":86,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.611859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273237+0000","last_change":"2024-04-26T12:32:37.140306+0000","last_active":"2024-04-26T12:33:29.273237+0000","last_peered":"2024-04-26T12:33:29.273237+0000","last_clean":"2024-04-26T12:30:25.764494+0000","last_became_active":"2024-04-26T12:32:37.140306+0000","last_became_peered":"2024-04-26T12:32:37.140306+0000","last_unstale":"2024-04-26T12:33:29.273237+0000","last_undegraded":"2024-04-26T12:33:29.273237+0000","last_fullsized":"2024-04-26T12:32:37.136775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:49.376539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273012+0000","last_change":"2024-04-26T12:32:37.141669+0000","last_active":"2024-04-26T12:33:29.273012+0000","last_peered":"2024-04-26T12:33:29.273012+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.141669+0000","last_became_peered":"2024-04-26T12:32:37.141669+0000","last_unstale":"2024-04-26T12:33:29.273012+0000","last_undegraded":"2024-04-26T12:33:29.273012+0000","last_fullsized":"2024-04-26T12:32:37.137647+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:12.238883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2099,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155135+0000","last_change":"2024-04-26T12:32:16.109669+0000","last_active":"2024-04-26T12:35:03.155135+0000","last_peered":"2024-04-26T12:35:03.155135+0000","last_clean":"2024-04-26T12:35:03.155135+0000","last_became_active":"2024-04-26T12:32:16.109328+0000","last_became_peered":"2024-04-26T12:32:16.109328+0000","last_unstale":"2024-04-26T12:35:03.155135+0000","last_undegraded":"2024-04-26T12:35:03.155135+0000","last_fullsized":"2024-04-26T12:35:03.155135+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:32.967100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":36,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.273640+0000","last_change":"2024-04-26T12:32:37.155961+0000","last_active":"2024-04-26T12:33:29.273640+0000","last_peered":"2024-04-26T12:33:29.273640+0000","last_clean":"2024-04-26T12:30:32.600329+0000","last_became_active":"2024-04-26T12:32:37.155961+0000","last_became_peered":"2024-04-26T12:32:37.155961+0000","last_unstale":"2024-04-26T12:33:29.273640+0000","last_undegraded":"2024-04-26T12:32:37.137794+0000","last_fullsized":"2024-04-26T12:32:37.137724+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:08.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273438+0000","last_change":"2024-04-26T12:32:37.141249+0000","last_active":"2024-04-26T12:33:29.273438+0000","last_peered":"2024-04-26T12:33:29.273438+0000","last_clean":"2024-04-26T12:30:25.764494+0000","last_became_active":"2024-04-26T12:32:37.141249+0000","last_became_peered":"2024-04-26T12:32:37.141249+0000","last_unstale":"2024-04-26T12:33:29.273438+0000","last_undegraded":"2024-04-26T12:33:29.273438+0000","last_fullsized":"2024-04-26T12:32:37.136907+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:49.137101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":35,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.276181+0000","last_change":"2024-04-26T12:32:37.143619+0000","last_active":"2024-04-26T12:33:29.276181+0000","last_peered":"2024-04-26T12:33:29.276181+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.143619+0000","last_became_peered":"2024-04-26T12:32:37.143619+0000","last_unstale":"2024-04-26T12:33:29.276181+0000","last_undegraded":"2024-04-26T12:33:29.276181+0000","last_fullsized":"2024-04-26T12:32:37.138469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:20.849071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155312+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:03.155312+0000","last_peered":"2024-04-26T12:35:03.155312+0000","last_clean":"2024-04-26T12:35:03.155312+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:03.155312+0000","last_undegraded":"2024-04-26T12:35:03.155312+0000","last_fullsized":"2024-04-26T12:35:03.155312+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":82,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.277809+0000","last_change":"2024-04-26T12:32:37.145296+0000","last_active":"2024-04-26T12:33:29.277809+0000","last_peered":"2024-04-26T12:33:29.277809+0000","last_clean":"2024-04-26T12:32:20.153309+0000","last_became_active":"2024-04-26T12:32:37.145296+0000","last_became_peered":"2024-04-26T12:32:37.145296+0000","last_unstale":"2024-04-26T12:33:29.277809+0000","last_undegraded":"2024-04-26T12:32:37.140004+0000","last_fullsized":"2024-04-26T12:32:37.139738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:29.170282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":87,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.149820+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:03.149820+0000","last_peered":"2024-04-26T12:35:03.149820+0000","last_clean":"2024-04-26T12:35:03.149820+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:03.149820+0000","last_undegraded":"2024-04-26T12:35:03.149820+0000","last_fullsized":"2024-04-26T12:35:03.149820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155320+0000","last_change":"2024-04-26T12:32:16.110117+0000","last_active":"2024-04-26T12:35:03.155320+0000","last_peered":"2024-04-26T12:35:03.155320+0000","last_clean":"2024-04-26T12:35:03.155320+0000","last_became_active":"2024-04-26T12:32:16.109893+0000","last_became_peered":"2024-04-26T12:32:16.109893+0000","last_unstale":"2024-04-26T12:35:03.155320+0000","last_undegraded":"2024-04-26T12:35:03.155320+0000","last_fullsized":"2024-04-26T12:35:03.155320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:18.025832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2102,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.916634+0000","last_change":"2024-04-26T12:35:04.916758+0000","last_active":"2024-04-26T12:35:04.916634+0000","last_peered":"2024-04-26T12:35:04.916634+0000","last_clean":"2024-04-26T12:32:35.963478+0000","last_became_active":"2024-04-26T12:35:04.915877+0000","last_became_peered":"2024-04-26T12:35:04.915877+0000","last_unstale":"2024-04-26T12:35:04.916634+0000","last_undegraded":"2024-04-26T12:35:04.196807+0000","last_fullsized":"2024-04-26T12:35:04.156105+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:13.025612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.190006+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:03.190006+0000","last_peered":"2024-04-26T12:35:03.190006+0000","last_clean":"2024-04-26T12:35:03.190006+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:03.190006+0000","last_undegraded":"2024-04-26T12:35:03.190006+0000","last_fullsized":"2024-04-26T12:35:03.190006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2138,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.948895+0000","last_change":"2024-04-26T12:35:04.949075+0000","last_active":"2024-04-26T12:35:04.948895+0000","last_peered":"2024-04-26T12:35:04.948895+0000","last_clean":"2024-04-26T12:32:36.098926+0000","last_became_active":"2024-04-26T12:35:04.855031+0000","last_became_peered":"2024-04-26T12:35:04.855031+0000","last_unstale":"2024-04-26T12:35:04.948895+0000","last_undegraded":"2024-04-26T12:35:04.948895+0000","last_fullsized":"2024-04-26T12:35:04.157899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154108+0000","last_change":"2024-04-26T12:32:16.110008+0000","last_active":"2024-04-26T12:35:03.154108+0000","last_peered":"2024-04-26T12:35:03.154108+0000","last_clean":"2024-04-26T12:35:03.154108+0000","last_became_active":"2024-04-26T12:32:16.109548+0000","last_became_peered":"2024-04-26T12:32:16.109548+0000","last_unstale":"2024-04-26T12:35:03.154108+0000","last_undegraded":"2024-04-26T12:35:03.154108+0000","last_fullsized":"2024-04-26T12:35:03.154108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:54.045578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":103,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183117+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:03.183117+0000","last_peered":"2024-04-26T12:35:03.183117+0000","last_clean":"2024-04-26T12:35:03.183117+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:03.183117+0000","last_undegraded":"2024-04-26T12:35:03.183117+0000","last_fullsized":"2024-04-26T12:35:03.183117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273459+0000","last_change":"2024-04-26T12:32:37.141034+0000","last_active":"2024-04-26T12:33:29.273459+0000","last_peered":"2024-04-26T12:33:29.273459+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.141034+0000","last_became_peered":"2024-04-26T12:32:37.141034+0000","last_unstale":"2024-04-26T12:33:29.273459+0000","last_undegraded":"2024-04-26T12:33:29.273459+0000","last_fullsized":"2024-04-26T12:32:37.136943+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:19.844708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4167,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.090858+0000","last_change":"2024-04-26T12:35:05.091032+0000","last_active":"2024-04-26T12:35:05.090858+0000","last_peered":"2024-04-26T12:35:05.090858+0000","last_clean":"2024-04-26T12:32:36.103388+0000","last_became_active":"2024-04-26T12:35:04.864598+0000","last_became_peered":"2024-04-26T12:35:04.864598+0000","last_unstale":"2024-04-26T12:35:05.090858+0000","last_undegraded":"2024-04-26T12:35:05.090858+0000","last_fullsized":"2024-04-26T12:35:04.154810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:04.516863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":35,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.278186+0000","last_change":"2024-04-26T12:32:37.162898+0000","last_active":"2024-04-26T12:33:29.278186+0000","last_peered":"2024-04-26T12:33:29.278186+0000","last_clean":"2024-04-26T12:30:32.601015+0000","last_became_active":"2024-04-26T12:32:37.162898+0000","last_became_peered":"2024-04-26T12:32:37.162898+0000","last_unstale":"2024-04-26T12:33:29.278186+0000","last_undegraded":"2024-04-26T12:32:37.141133+0000","last_fullsized":"2024-04-26T12:32:37.140581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:53.980206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2169,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158416+0000","last_change":"2024-04-26T12:32:26.265982+0000","last_active":"2024-04-26T12:35:03.158416+0000","last_peered":"2024-04-26T12:35:03.158416+0000","last_clean":"2024-04-26T12:35:03.158416+0000","last_became_active":"2024-04-26T12:32:26.264296+0000","last_became_peered":"2024-04-26T12:32:26.264296+0000","last_unstale":"2024-04-26T12:35:03.158416+0000","last_undegraded":"2024-04-26T12:35:03.158416+0000","last_fullsized":"2024-04-26T12:35:03.158416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:25.897269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183050+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:03.183050+0000","last_peered":"2024-04-26T12:35:03.183050+0000","last_clean":"2024-04-26T12:35:03.183050+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:03.183050+0000","last_undegraded":"2024-04-26T12:35:03.183050+0000","last_fullsized":"2024-04-26T12:35:03.183050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":39,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272331+0000","last_change":"2024-04-26T12:32:37.138381+0000","last_active":"2024-04-26T12:33:29.272331+0000","last_peered":"2024-04-26T12:33:29.272331+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.138381+0000","last_became_peered":"2024-04-26T12:32:37.138381+0000","last_unstale":"2024-04-26T12:33:29.272331+0000","last_undegraded":"2024-04-26T12:33:29.272331+0000","last_fullsized":"2024-04-26T12:32:37.136001+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2032,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154382+0000","last_change":"2024-04-26T12:32:16.107224+0000","last_active":"2024-04-26T12:35:03.154382+0000","last_peered":"2024-04-26T12:35:03.154382+0000","last_clean":"2024-04-26T12:35:03.154382+0000","last_became_active":"2024-04-26T12:32:16.106255+0000","last_became_peered":"2024-04-26T12:32:16.106255+0000","last_unstale":"2024-04-26T12:35:03.154382+0000","last_undegraded":"2024-04-26T12:35:03.154382+0000","last_fullsized":"2024-04-26T12:35:03.154382+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:01.140990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2122,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.918637+0000","last_change":"2024-04-26T12:35:04.918822+0000","last_active":"2024-04-26T12:35:04.918637+0000","last_peered":"2024-04-26T12:35:04.918637+0000","last_clean":"2024-04-26T12:32:36.073786+0000","last_became_active":"2024-04-26T12:35:04.854230+0000","last_became_peered":"2024-04-26T12:35:04.854230+0000","last_unstale":"2024-04-26T12:35:04.918637+0000","last_undegraded":"2024-04-26T12:35:04.918637+0000","last_fullsized":"2024-04-26T12:35:04.155076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:29.948430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.152280+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:03.152280+0000","last_peered":"2024-04-26T12:35:03.152280+0000","last_clean":"2024-04-26T12:35:03.152280+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:03.152280+0000","last_undegraded":"2024-04-26T12:35:03.152280+0000","last_fullsized":"2024-04-26T12:35:03.152280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":171343872,"data_stored":198207577,"data_compressed":131484,"data_compressed_allocated":15028224,"data_compressed_original":41897984,"omap_allocated":0,"internal_metadata":0},"log_size":115817,"ondisk_log_size":115817,"up":115,"acting":88,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":570274,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":49,"acting":49,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738426,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142900,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228940,"statfs":{"total":96636764160,"available":95466434560,"internally_reserved":0,"allocated":1081344,"data_stored":1231353,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.46899999999999997}]}]},{"osd":0,"up_from":0,"seq":1,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201644,"kb_used_data":167844,"kb_used_omap":6,"kb_used_meta":33785,"kb_avail":94170196,"statfs":{"total":96636764160,"available":96430280704,"internally_reserved":0,"allocated":171872256,"data_stored":198456306,"data_compressed":131484,"data_compressed_allocated":15028224,"data_compressed_original":41897984,"omap_allocated":7079,"internal_metadata":34595929},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":8,"seq":34359738427,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511084,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860756,"statfs":{"total":96636764160,"available":95089414144,"internally_reserved":0,"allocated":1073152,"data_stored":1232244,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.152},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.19}]},{"osd":2,"last update":"Fri Apr 26 12:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.436},"min":{"1min":0.33900000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.372,"5min":0.188,"15min":0.188},"max":{"1min":0.70199999999999996,"5min":1.137,"15min":1.137},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":171343872,"data_stored":198207577,"data_compressed":131484,"data_compressed_allocated":15028224,"data_compressed_original":41897984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:06.315 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:06.722 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:06.724 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:06.736 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-04-26T12:35:05.896942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":26,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116121,"ondisk_log_size":116121,"up":178,"acting":151,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2855628,"kb_used_data":169948,"kb_used_omap":10,"kb_used_meta":2685621,"kb_avail":280259892,"statfs":{"total":289910292480,"available":286986129408,"internally_reserved":0,"allocated":174026752,"data_stored":200919903,"data_compressed":149554,"data_compressed_allocated":15118336,"data_compressed_original":43102208,"omap_allocated":10267,"internal_metadata":2750076901},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.751570"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2066,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.963734+0000","last_change":"2024-04-26T12:35:04.964078+0000","last_active":"2024-04-26T12:35:04.963734+0000","last_peered":"2024-04-26T12:35:04.963734+0000","last_clean":"2024-04-26T12:32:35.991566+0000","last_became_active":"2024-04-26T12:35:04.962797+0000","last_became_peered":"2024-04-26T12:35:04.962797+0000","last_unstale":"2024-04-26T12:35:04.963734+0000","last_undegraded":"2024-04-26T12:35:04.190831+0000","last_fullsized":"2024-04-26T12:35:04.156108+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:18.058042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":74,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273188+0000","last_change":"2024-04-26T12:32:37.139935+0000","last_active":"2024-04-26T12:33:29.273188+0000","last_peered":"2024-04-26T12:33:29.273188+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.139935+0000","last_became_peered":"2024-04-26T12:32:37.139935+0000","last_unstale":"2024-04-26T12:33:29.273188+0000","last_undegraded":"2024-04-26T12:33:29.273188+0000","last_fullsized":"2024-04-26T12:32:37.136590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:55.581182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4120,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156296+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:03.156296+0000","last_peered":"2024-04-26T12:35:03.156296+0000","last_clean":"2024-04-26T12:35:03.156296+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:03.156296+0000","last_undegraded":"2024-04-26T12:35:03.156296+0000","last_fullsized":"2024-04-26T12:35:03.156296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":105,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.190199+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:03.190199+0000","last_peered":"2024-04-26T12:35:03.190199+0000","last_clean":"2024-04-26T12:35:03.190199+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:03.190199+0000","last_undegraded":"2024-04-26T12:35:03.190199+0000","last_fullsized":"2024-04-26T12:35:03.190199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2142,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.059964+0000","last_change":"2024-04-26T12:35:05.060136+0000","last_active":"2024-04-26T12:35:05.059964+0000","last_peered":"2024-04-26T12:35:05.059964+0000","last_clean":"2024-04-26T12:32:35.988371+0000","last_became_active":"2024-04-26T12:35:04.855454+0000","last_became_peered":"2024-04-26T12:35:04.855454+0000","last_unstale":"2024-04-26T12:35:05.059964+0000","last_undegraded":"2024-04-26T12:35:05.059964+0000","last_fullsized":"2024-04-26T12:35:04.191057+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:47.113360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":48,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.268733+0000","last_change":"2024-04-26T12:32:37.143039+0000","last_active":"2024-04-26T12:33:28.268733+0000","last_peered":"2024-04-26T12:33:28.268733+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.143039+0000","last_became_peered":"2024-04-26T12:32:37.143039+0000","last_unstale":"2024-04-26T12:33:28.268733+0000","last_undegraded":"2024-04-26T12:33:28.268733+0000","last_fullsized":"2024-04-26T12:32:37.139286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:52.811599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":47,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.269054+0000","last_change":"2024-04-26T12:32:37.156827+0000","last_active":"2024-04-26T12:33:28.269054+0000","last_peered":"2024-04-26T12:33:28.269054+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.156827+0000","last_became_peered":"2024-04-26T12:32:37.156827+0000","last_unstale":"2024-04-26T12:33:28.269054+0000","last_undegraded":"2024-04-26T12:33:28.269054+0000","last_fullsized":"2024-04-26T12:32:37.140301+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:37.076435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8169,"reported_epoch":87,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2024-04-26T12:35:04.923824+0000","last_change":"2024-04-26T12:35:04.923993+0000","last_active":"2024-04-26T12:35:04.923824+0000","last_peered":"2024-04-26T12:35:04.923824+0000","last_clean":"2024-04-26T12:32:36.110957+0000","last_became_active":"2024-04-26T12:35:04.922253+0000","last_became_peered":"2024-04-26T12:35:04.922253+0000","last_unstale":"2024-04-26T12:35:04.923824+0000","last_undegraded":"2024-04-26T12:35:04.923824+0000","last_fullsized":"2024-04-26T12:35:04.157067+0000","mapping_epoch":86,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:39.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6167,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.964000+0000","last_change":"2024-04-26T12:35:04.964000+0000","last_active":"2024-04-26T12:35:04.964000+0000","last_peered":"2024-04-26T12:35:04.964000+0000","last_clean":"2024-04-26T12:32:36.097694+0000","last_became_active":"2024-04-26T12:35:04.961544+0000","last_became_peered":"2024-04-26T12:35:04.961544+0000","last_unstale":"2024-04-26T12:35:04.964000+0000","last_undegraded":"2024-04-26T12:35:04.235838+0000","last_fullsized":"2024-04-26T12:35:04.156390+0000","mapping_epoch":86,"log_start":"62'1600","ondisk_log_start":"62'1600","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4481,"log_dups_size":1600,"ondisk_log_size":4481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:04.981036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6213,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.915068+0000","last_change":"2024-04-26T12:35:04.915184+0000","last_active":"2024-04-26T12:35:04.915068+0000","last_peered":"2024-04-26T12:35:04.915068+0000","last_clean":"2024-04-26T12:32:36.054632+0000","last_became_active":"2024-04-26T12:35:04.913607+0000","last_became_peered":"2024-04-26T12:35:04.913607+0000","last_unstale":"2024-04-26T12:35:04.915068+0000","last_undegraded":"2024-04-26T12:35:04.234907+0000","last_fullsized":"2024-04-26T12:35:04.156225+0000","mapping_epoch":86,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:13.092049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4068,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.041117+0000","last_change":"2024-04-26T12:35:05.041294+0000","last_active":"2024-04-26T12:35:05.041117+0000","last_peered":"2024-04-26T12:35:05.041117+0000","last_clean":"2024-04-26T12:32:36.099119+0000","last_became_active":"2024-04-26T12:35:04.906093+0000","last_became_peered":"2024-04-26T12:35:04.906093+0000","last_unstale":"2024-04-26T12:35:05.041117+0000","last_undegraded":"2024-04-26T12:35:05.041117+0000","last_fullsized":"2024-04-26T12:35:04.158661+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:02.195242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2097,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154707+0000","last_change":"2024-04-26T12:32:16.107668+0000","last_active":"2024-04-26T12:35:03.154707+0000","last_peered":"2024-04-26T12:35:03.154707+0000","last_clean":"2024-04-26T12:35:03.154707+0000","last_became_active":"2024-04-26T12:32:16.107458+0000","last_became_peered":"2024-04-26T12:32:16.107458+0000","last_unstale":"2024-04-26T12:35:03.154707+0000","last_undegraded":"2024-04-26T12:35:03.154707+0000","last_fullsized":"2024-04-26T12:35:03.154707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.458028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2125,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.968364+0000","last_change":"2024-04-26T12:35:04.968539+0000","last_active":"2024-04-26T12:35:04.968364+0000","last_peered":"2024-04-26T12:35:04.968364+0000","last_clean":"2024-04-26T12:32:35.954605+0000","last_became_active":"2024-04-26T12:35:04.854268+0000","last_became_peered":"2024-04-26T12:35:04.854268+0000","last_unstale":"2024-04-26T12:35:04.968364+0000","last_undegraded":"2024-04-26T12:35:04.968364+0000","last_fullsized":"2024-04-26T12:35:04.155082+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:24.178531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2135,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.157272+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:03.157272+0000","last_peered":"2024-04-26T12:35:03.157272+0000","last_clean":"2024-04-26T12:35:03.157272+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:03.157272+0000","last_undegraded":"2024-04-26T12:35:03.157272+0000","last_fullsized":"2024-04-26T12:35:03.157272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160274+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:03.160274+0000","last_peered":"2024-04-26T12:35:03.160274+0000","last_clean":"2024-04-26T12:35:03.160274+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:03.160274+0000","last_undegraded":"2024-04-26T12:35:03.160274+0000","last_fullsized":"2024-04-26T12:35:03.160274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2095,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.923084+0000","last_change":"2024-04-26T12:35:04.923218+0000","last_active":"2024-04-26T12:35:04.923084+0000","last_peered":"2024-04-26T12:35:04.923084+0000","last_clean":"2024-04-26T12:32:35.989411+0000","last_became_active":"2024-04-26T12:35:04.922269+0000","last_became_peered":"2024-04-26T12:35:04.922269+0000","last_unstale":"2024-04-26T12:35:04.923084+0000","last_undegraded":"2024-04-26T12:35:04.186060+0000","last_fullsized":"2024-04-26T12:35:04.157085+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.241095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2105,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.962518+0000","last_change":"2024-04-26T12:35:04.963904+0000","last_active":"2024-04-26T12:35:04.962518+0000","last_peered":"2024-04-26T12:35:04.962518+0000","last_clean":"2024-04-26T12:32:35.945501+0000","last_became_active":"2024-04-26T12:35:04.961537+0000","last_became_peered":"2024-04-26T12:35:04.961537+0000","last_unstale":"2024-04-26T12:35:04.962518+0000","last_undegraded":"2024-04-26T12:35:04.242372+0000","last_fullsized":"2024-04-26T12:35:04.238086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:47:47.807752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2122,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.913404+0000","last_change":"2024-04-26T12:35:04.914665+0000","last_active":"2024-04-26T12:35:04.913404+0000","last_peered":"2024-04-26T12:35:04.913404+0000","last_clean":"2024-04-26T12:32:36.044461+0000","last_became_active":"2024-04-26T12:35:04.912646+0000","last_became_peered":"2024-04-26T12:35:04.912646+0000","last_unstale":"2024-04-26T12:35:04.913404+0000","last_undegraded":"2024-04-26T12:35:04.242068+0000","last_fullsized":"2024-04-26T12:35:04.237387+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:22:55.840854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4086,"reported_epoch":87,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.906212+0000","last_change":"2024-04-26T12:35:05.152426+0000","last_active":"2024-04-26T12:35:04.906212+0000","last_peered":"2024-04-26T12:35:04.906212+0000","last_clean":"2024-04-26T12:32:36.045736+0000","last_became_active":"2024-04-26T12:35:04.904573+0000","last_became_peered":"2024-04-26T12:35:04.904573+0000","last_unstale":"2024-04-26T12:35:04.906212+0000","last_undegraded":"2024-04-26T12:35:04.225563+0000","last_fullsized":"2024-04-26T12:35:04.155914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:20.306610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4198,"reported_epoch":87,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:35:05.091495+0000","last_change":"2024-04-26T12:35:05.098528+0000","last_active":"2024-04-26T12:35:05.091495+0000","last_peered":"2024-04-26T12:35:05.091495+0000","last_clean":"2024-04-26T12:32:36.109719+0000","last_became_active":"2024-04-26T12:35:04.916325+0000","last_became_peered":"2024-04-26T12:35:04.916325+0000","last_unstale":"2024-04-26T12:35:05.091495+0000","last_undegraded":"2024-04-26T12:35:04.203928+0000","last_fullsized":"2024-04-26T12:35:04.158911+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:28.705010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":108,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157590+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:04.157590+0000","last_peered":"2024-04-26T12:35:04.157590+0000","last_clean":"2024-04-26T12:35:04.157590+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:04.157590+0000","last_undegraded":"2024-04-26T12:35:04.157590+0000","last_fullsized":"2024-04-26T12:35:04.157590+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2105,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.154914+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:04.154914+0000","last_peered":"2024-04-26T12:35:04.154914+0000","last_clean":"2024-04-26T12:35:04.154914+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:04.154914+0000","last_undegraded":"2024-04-26T12:35:04.154914+0000","last_fullsized":"2024-04-26T12:35:04.154914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2089,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.982579+0000","last_change":"2024-04-26T12:35:04.982742+0000","last_active":"2024-04-26T12:35:04.982579+0000","last_peered":"2024-04-26T12:35:04.982579+0000","last_clean":"2024-04-26T12:32:36.090341+0000","last_became_active":"2024-04-26T12:35:04.864271+0000","last_became_peered":"2024-04-26T12:35:04.864271+0000","last_unstale":"2024-04-26T12:35:04.982579+0000","last_undegraded":"2024-04-26T12:35:04.982579+0000","last_fullsized":"2024-04-26T12:35:04.157008+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:14.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4120,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.923700+0000","last_change":"2024-04-26T12:35:04.923909+0000","last_active":"2024-04-26T12:35:04.923700+0000","last_peered":"2024-04-26T12:35:04.923700+0000","last_clean":"2024-04-26T12:32:36.098162+0000","last_became_active":"2024-04-26T12:35:04.922403+0000","last_became_peered":"2024-04-26T12:35:04.922403+0000","last_unstale":"2024-04-26T12:35:04.923700+0000","last_undegraded":"2024-04-26T12:35:04.214799+0000","last_fullsized":"2024-04-26T12:35:04.155135+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:04.379304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2140,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155032+0000","last_change":"2024-04-26T12:32:16.109558+0000","last_active":"2024-04-26T12:35:03.155032+0000","last_peered":"2024-04-26T12:35:03.155032+0000","last_clean":"2024-04-26T12:35:03.155032+0000","last_became_active":"2024-04-26T12:32:16.109196+0000","last_became_peered":"2024-04-26T12:32:16.109196+0000","last_unstale":"2024-04-26T12:35:03.155032+0000","last_undegraded":"2024-04-26T12:35:03.155032+0000","last_fullsized":"2024-04-26T12:35:03.155032+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:25.423545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":42,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.277339+0000","last_change":"2024-04-26T12:32:37.142921+0000","last_active":"2024-04-26T12:33:29.277339+0000","last_peered":"2024-04-26T12:33:29.277339+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.142921+0000","last_became_peered":"2024-04-26T12:32:37.142921+0000","last_unstale":"2024-04-26T12:33:29.277339+0000","last_undegraded":"2024-04-26T12:33:29.277339+0000","last_fullsized":"2024-04-26T12:32:37.139045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:37.961455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2090,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155387+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:03.155387+0000","last_peered":"2024-04-26T12:35:03.155387+0000","last_clean":"2024-04-26T12:35:03.155387+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:03.155387+0000","last_undegraded":"2024-04-26T12:35:03.155387+0000","last_fullsized":"2024-04-26T12:35:03.155387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":71,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.268958+0000","last_change":"2024-04-26T12:32:37.164884+0000","last_active":"2024-04-26T12:33:28.268958+0000","last_peered":"2024-04-26T12:33:28.268958+0000","last_clean":"2024-04-26T12:32:14.263808+0000","last_became_active":"2024-04-26T12:32:37.164884+0000","last_became_peered":"2024-04-26T12:32:37.164884+0000","last_unstale":"2024-04-26T12:33:28.268958+0000","last_undegraded":"2024-04-26T12:33:28.268958+0000","last_fullsized":"2024-04-26T12:32:37.136846+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:53.064759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155103+0000","last_change":"2024-04-26T12:32:16.110135+0000","last_active":"2024-04-26T12:35:03.155103+0000","last_peered":"2024-04-26T12:35:03.155103+0000","last_clean":"2024-04-26T12:35:03.155103+0000","last_became_active":"2024-04-26T12:32:16.109837+0000","last_became_peered":"2024-04-26T12:32:16.109837+0000","last_unstale":"2024-04-26T12:35:03.155103+0000","last_undegraded":"2024-04-26T12:35:03.155103+0000","last_fullsized":"2024-04-26T12:35:03.155103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:19.898367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.268692+0000","last_change":"2024-04-26T12:32:37.157859+0000","last_active":"2024-04-26T12:33:28.268692+0000","last_peered":"2024-04-26T12:33:28.268692+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.157859+0000","last_became_peered":"2024-04-26T12:32:37.157859+0000","last_unstale":"2024-04-26T12:33:28.268692+0000","last_undegraded":"2024-04-26T12:33:28.268692+0000","last_fullsized":"2024-04-26T12:32:37.139659+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:42.515112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":32,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.277863+0000","last_change":"2024-04-26T12:32:37.145802+0000","last_active":"2024-04-26T12:33:29.277863+0000","last_peered":"2024-04-26T12:33:29.277863+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.145802+0000","last_became_peered":"2024-04-26T12:32:37.145802+0000","last_unstale":"2024-04-26T12:33:29.277863+0000","last_undegraded":"2024-04-26T12:33:29.277863+0000","last_fullsized":"2024-04-26T12:32:37.140433+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:13.574704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.268947+0000","last_change":"2024-04-26T12:32:37.153951+0000","last_active":"2024-04-26T12:33:28.268947+0000","last_peered":"2024-04-26T12:33:28.268947+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.153951+0000","last_became_peered":"2024-04-26T12:32:37.153951+0000","last_unstale":"2024-04-26T12:33:28.268947+0000","last_undegraded":"2024-04-26T12:33:28.268947+0000","last_fullsized":"2024-04-26T12:32:37.136360+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:24.892906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156554+0000","last_change":"2024-04-26T12:32:16.109433+0000","last_active":"2024-04-26T12:35:03.156554+0000","last_peered":"2024-04-26T12:35:03.156554+0000","last_clean":"2024-04-26T12:35:03.156554+0000","last_became_active":"2024-04-26T12:32:16.109171+0000","last_became_peered":"2024-04-26T12:32:16.109171+0000","last_unstale":"2024-04-26T12:35:03.156554+0000","last_undegraded":"2024-04-26T12:35:03.156554+0000","last_fullsized":"2024-04-26T12:35:03.156554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":27,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.269812+0000","last_change":"2024-04-26T12:32:37.163385+0000","last_active":"2024-04-26T12:33:28.269812+0000","last_peered":"2024-04-26T12:33:28.269812+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.163385+0000","last_became_peered":"2024-04-26T12:32:37.163385+0000","last_unstale":"2024-04-26T12:33:28.269812+0000","last_undegraded":"2024-04-26T12:33:28.269812+0000","last_fullsized":"2024-04-26T12:32:37.140677+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:37.029134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":33,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272107+0000","last_change":"2024-04-26T12:32:37.138388+0000","last_active":"2024-04-26T12:33:29.272107+0000","last_peered":"2024-04-26T12:33:29.272107+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.138388+0000","last_became_peered":"2024-04-26T12:32:37.138388+0000","last_unstale":"2024-04-26T12:33:29.272107+0000","last_undegraded":"2024-04-26T12:33:29.272107+0000","last_fullsized":"2024-04-26T12:32:37.135837+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:27.473419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":43,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.269806+0000","last_change":"2024-04-26T12:32:37.142429+0000","last_active":"2024-04-26T12:33:28.269806+0000","last_peered":"2024-04-26T12:33:28.269806+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.142429+0000","last_became_peered":"2024-04-26T12:32:37.142429+0000","last_unstale":"2024-04-26T12:33:28.269806+0000","last_undegraded":"2024-04-26T12:33:28.269806+0000","last_fullsized":"2024-04-26T12:32:37.139089+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:09.704532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6150,"reported_epoch":87,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2024-04-26T12:35:04.865878+0000","last_change":"2024-04-26T12:35:04.866031+0000","last_active":"2024-04-26T12:35:04.865878+0000","last_peered":"2024-04-26T12:35:04.865878+0000","last_clean":"2024-04-26T12:32:36.090113+0000","last_became_active":"2024-04-26T12:35:04.864319+0000","last_became_peered":"2024-04-26T12:35:04.864319+0000","last_unstale":"2024-04-26T12:35:04.865878+0000","last_undegraded":"2024-04-26T12:35:04.865878+0000","last_fullsized":"2024-04-26T12:35:04.157028+0000","mapping_epoch":86,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:40.572498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":57,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155132+0000","last_change":"2024-04-26T12:32:16.109604+0000","last_active":"2024-04-26T12:35:03.155132+0000","last_peered":"2024-04-26T12:35:03.155132+0000","last_clean":"2024-04-26T12:35:03.155132+0000","last_became_active":"2024-04-26T12:32:16.109232+0000","last_became_peered":"2024-04-26T12:32:16.109232+0000","last_unstale":"2024-04-26T12:35:03.155132+0000","last_undegraded":"2024-04-26T12:35:03.155132+0000","last_fullsized":"2024-04-26T12:35:03.155132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:08.819922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4156,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.013009+0000","last_change":"2024-04-26T12:35:05.013254+0000","last_active":"2024-04-26T12:35:05.013009+0000","last_peered":"2024-04-26T12:35:05.013009+0000","last_clean":"2024-04-26T12:32:36.101997+0000","last_became_active":"2024-04-26T12:35:04.854225+0000","last_became_peered":"2024-04-26T12:35:04.854225+0000","last_unstale":"2024-04-26T12:35:05.013009+0000","last_undegraded":"2024-04-26T12:35:05.013009+0000","last_fullsized":"2024-04-26T12:35:04.155184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:33.311308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":180,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156465+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:03.156465+0000","last_peered":"2024-04-26T12:35:03.156465+0000","last_clean":"2024-04-26T12:35:03.156465+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:03.156465+0000","last_undegraded":"2024-04-26T12:35:03.156465+0000","last_fullsized":"2024-04-26T12:35:03.156465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4177,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158648+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:03.158648+0000","last_peered":"2024-04-26T12:35:03.158648+0000","last_clean":"2024-04-26T12:35:03.158648+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:03.158648+0000","last_undegraded":"2024-04-26T12:35:03.158648+0000","last_fullsized":"2024-04-26T12:35:03.158648+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185706+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:03.185706+0000","last_peered":"2024-04-26T12:35:03.185706+0000","last_clean":"2024-04-26T12:35:03.185706+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:03.185706+0000","last_undegraded":"2024-04-26T12:35:03.185706+0000","last_fullsized":"2024-04-26T12:35:03.185706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2063,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.916585+0000","last_change":"2024-04-26T12:35:04.916714+0000","last_active":"2024-04-26T12:35:04.916585+0000","last_peered":"2024-04-26T12:35:04.916585+0000","last_clean":"2024-04-26T12:32:35.952933+0000","last_became_active":"2024-04-26T12:35:04.915892+0000","last_became_peered":"2024-04-26T12:35:04.915892+0000","last_unstale":"2024-04-26T12:35:04.916585+0000","last_undegraded":"2024-04-26T12:35:04.189159+0000","last_fullsized":"2024-04-26T12:35:04.155551+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:29.672337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.277167+0000","last_change":"2024-04-26T12:32:37.143702+0000","last_active":"2024-04-26T12:33:29.277167+0000","last_peered":"2024-04-26T12:33:29.277167+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.143702+0000","last_became_peered":"2024-04-26T12:32:37.143702+0000","last_unstale":"2024-04-26T12:33:29.277167+0000","last_undegraded":"2024-04-26T12:33:29.277167+0000","last_fullsized":"2024-04-26T12:32:37.140209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:12.152629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2065,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.137509+0000","last_change":"2024-04-26T12:35:05.137729+0000","last_active":"2024-04-26T12:35:05.137509+0000","last_peered":"2024-04-26T12:35:05.137509+0000","last_clean":"2024-04-26T12:32:36.076094+0000","last_became_active":"2024-04-26T12:35:04.904565+0000","last_became_peered":"2024-04-26T12:35:04.904565+0000","last_unstale":"2024-04-26T12:35:05.137509+0000","last_undegraded":"2024-04-26T12:35:05.137509+0000","last_fullsized":"2024-04-26T12:35:04.158065+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:07.708928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160145+0000","last_change":"2024-04-26T12:32:16.107025+0000","last_active":"2024-04-26T12:35:03.160145+0000","last_peered":"2024-04-26T12:35:03.160145+0000","last_clean":"2024-04-26T12:35:03.160145+0000","last_became_active":"2024-04-26T12:32:16.106307+0000","last_became_peered":"2024-04-26T12:32:16.106307+0000","last_unstale":"2024-04-26T12:35:03.160145+0000","last_undegraded":"2024-04-26T12:35:03.160145+0000","last_fullsized":"2024-04-26T12:35:03.160145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:31.214495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":36,"reported_epoch":82,"state":"active+undersized","last_fresh":"2024-04-26T12:33:28.270086+0000","last_change":"2024-04-26T12:32:37.145810+0000","last_active":"2024-04-26T12:33:28.270086+0000","last_peered":"2024-04-26T12:33:28.270086+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.145810+0000","last_became_peered":"2024-04-26T12:32:37.145810+0000","last_unstale":"2024-04-26T12:33:28.270086+0000","last_undegraded":"2024-04-26T12:33:28.270086+0000","last_fullsized":"2024-04-26T12:32:37.140622+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:22.880942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":93,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156725+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:03.156725+0000","last_peered":"2024-04-26T12:35:03.156725+0000","last_clean":"2024-04-26T12:35:03.156725+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:03.156725+0000","last_undegraded":"2024-04-26T12:35:03.156725+0000","last_fullsized":"2024-04-26T12:35:03.156725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2157,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.962246+0000","last_change":"2024-04-26T12:35:04.962246+0000","last_active":"2024-04-26T12:35:04.962246+0000","last_peered":"2024-04-26T12:35:04.962246+0000","last_clean":"2024-04-26T12:32:35.940778+0000","last_became_active":"2024-04-26T12:35:04.961361+0000","last_became_peered":"2024-04-26T12:35:04.961361+0000","last_unstale":"2024-04-26T12:35:04.962246+0000","last_undegraded":"2024-04-26T12:35:04.194420+0000","last_fullsized":"2024-04-26T12:35:04.158738+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:49.140618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.158266+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:04.158266+0000","last_peered":"2024-04-26T12:35:04.158266+0000","last_clean":"2024-04-26T12:35:04.158266+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:04.158266+0000","last_undegraded":"2024-04-26T12:35:04.158266+0000","last_fullsized":"2024-04-26T12:35:04.158266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.153716+0000","last_change":"2024-04-26T12:32:16.109694+0000","last_active":"2024-04-26T12:35:03.153716+0000","last_peered":"2024-04-26T12:35:03.153716+0000","last_clean":"2024-04-26T12:35:03.153716+0000","last_became_active":"2024-04-26T12:32:16.109070+0000","last_became_peered":"2024-04-26T12:32:16.109070+0000","last_unstale":"2024-04-26T12:35:03.153716+0000","last_undegraded":"2024-04-26T12:35:03.153716+0000","last_fullsized":"2024-04-26T12:35:03.153716+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:54.733914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":85,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157540+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:04.157540+0000","last_peered":"2024-04-26T12:35:04.157540+0000","last_clean":"2024-04-26T12:35:04.157540+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:04.157540+0000","last_undegraded":"2024-04-26T12:35:04.157540+0000","last_fullsized":"2024-04-26T12:35:04.157540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":72,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272923+0000","last_change":"2024-04-26T12:32:37.149684+0000","last_active":"2024-04-26T12:33:29.272923+0000","last_peered":"2024-04-26T12:33:29.272923+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.149684+0000","last_became_peered":"2024-04-26T12:32:37.149684+0000","last_unstale":"2024-04-26T12:33:29.272923+0000","last_undegraded":"2024-04-26T12:33:29.272923+0000","last_fullsized":"2024-04-26T12:32:37.136839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:30.471721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":81,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.150234+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:35:03.150234+0000","last_peered":"2024-04-26T12:35:03.150234+0000","last_clean":"2024-04-26T12:35:03.150234+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:35:03.150234+0000","last_undegraded":"2024-04-26T12:35:03.150234+0000","last_fullsized":"2024-04-26T12:35:03.150234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2092,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.889386+0000","last_change":"2024-04-26T12:35:04.889560+0000","last_active":"2024-04-26T12:35:04.889386+0000","last_peered":"2024-04-26T12:35:04.889386+0000","last_clean":"2024-04-26T12:32:36.095836+0000","last_became_active":"2024-04-26T12:35:04.852698+0000","last_became_peered":"2024-04-26T12:35:04.852698+0000","last_unstale":"2024-04-26T12:35:04.889386+0000","last_undegraded":"2024-04-26T12:35:04.889386+0000","last_fullsized":"2024-04-26T12:35:04.158275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:04.200236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157564+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:04.157564+0000","last_peered":"2024-04-26T12:35:04.157564+0000","last_clean":"2024-04-26T12:35:04.157564+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:04.157564+0000","last_undegraded":"2024-04-26T12:35:04.157564+0000","last_fullsized":"2024-04-26T12:35:04.157564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":35,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.276513+0000","last_change":"2024-04-26T12:32:37.142490+0000","last_active":"2024-04-26T12:33:29.276513+0000","last_peered":"2024-04-26T12:33:29.276513+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.142490+0000","last_became_peered":"2024-04-26T12:32:37.142490+0000","last_unstale":"2024-04-26T12:33:29.276513+0000","last_undegraded":"2024-04-26T12:33:29.276513+0000","last_fullsized":"2024-04-26T12:32:37.138774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:59.048653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":36,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.276796+0000","last_change":"2024-04-26T12:32:37.148302+0000","last_active":"2024-04-26T12:33:29.276796+0000","last_peered":"2024-04-26T12:33:29.276796+0000","last_clean":"2024-04-26T12:30:32.599833+0000","last_became_active":"2024-04-26T12:32:37.148302+0000","last_became_peered":"2024-04-26T12:32:37.148302+0000","last_unstale":"2024-04-26T12:33:29.276796+0000","last_undegraded":"2024-04-26T12:32:37.140352+0000","last_fullsized":"2024-04-26T12:32:37.140274+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:05.143389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2080,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.074617+0000","last_change":"2024-04-26T12:35:05.074617+0000","last_active":"2024-04-26T12:35:05.074617+0000","last_peered":"2024-04-26T12:35:05.074617+0000","last_clean":"2024-04-26T12:32:36.109396+0000","last_became_active":"2024-04-26T12:35:04.916362+0000","last_became_peered":"2024-04-26T12:35:04.916362+0000","last_unstale":"2024-04-26T12:35:05.074617+0000","last_undegraded":"2024-04-26T12:35:05.074617+0000","last_fullsized":"2024-04-26T12:35:04.157688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:30.735718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.181023+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:03.181023+0000","last_peered":"2024-04-26T12:35:03.181023+0000","last_clean":"2024-04-26T12:35:03.181023+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:03.181023+0000","last_undegraded":"2024-04-26T12:35:03.181023+0000","last_fullsized":"2024-04-26T12:35:03.181023+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2123,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.161640+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:04.161640+0000","last_peered":"2024-04-26T12:35:04.161640+0000","last_clean":"2024-04-26T12:35:04.161640+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:04.161640+0000","last_undegraded":"2024-04-26T12:35:04.161640+0000","last_fullsized":"2024-04-26T12:35:04.161640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160320+0000","last_change":"2024-04-26T12:32:16.109449+0000","last_active":"2024-04-26T12:35:03.160320+0000","last_peered":"2024-04-26T12:35:03.160320+0000","last_clean":"2024-04-26T12:35:03.160320+0000","last_became_active":"2024-04-26T12:32:16.109131+0000","last_became_peered":"2024-04-26T12:32:16.109131+0000","last_unstale":"2024-04-26T12:35:03.160320+0000","last_undegraded":"2024-04-26T12:35:03.160320+0000","last_fullsized":"2024-04-26T12:35:03.160320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:47.757728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.158233+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:04.158233+0000","last_peered":"2024-04-26T12:35:04.158233+0000","last_clean":"2024-04-26T12:35:04.158233+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:04.158233+0000","last_undegraded":"2024-04-26T12:35:04.158233+0000","last_fullsized":"2024-04-26T12:35:04.158233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":71,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272270+0000","last_change":"2024-04-26T12:32:37.138617+0000","last_active":"2024-04-26T12:33:29.272270+0000","last_peered":"2024-04-26T12:33:29.272270+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.138617+0000","last_became_peered":"2024-04-26T12:32:37.138617+0000","last_unstale":"2024-04-26T12:33:29.272270+0000","last_undegraded":"2024-04-26T12:33:29.272270+0000","last_fullsized":"2024-04-26T12:32:37.135998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:08.819922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6171,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.965370+0000","last_change":"2024-04-26T12:35:04.965518+0000","last_active":"2024-04-26T12:35:04.965370+0000","last_peered":"2024-04-26T12:35:04.965370+0000","last_clean":"2024-04-26T12:32:36.042703+0000","last_became_active":"2024-04-26T12:35:04.963869+0000","last_became_peered":"2024-04-26T12:35:04.963869+0000","last_unstale":"2024-04-26T12:35:04.965370+0000","last_undegraded":"2024-04-26T12:35:04.240774+0000","last_fullsized":"2024-04-26T12:35:04.197145+0000","mapping_epoch":86,"log_start":"62'1600","ondisk_log_start":"62'1600","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":1600,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:33.175292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272743+0000","last_change":"2024-04-26T12:32:37.139346+0000","last_active":"2024-04-26T12:33:29.272743+0000","last_peered":"2024-04-26T12:33:29.272743+0000","last_clean":"2024-04-26T12:30:25.764494+0000","last_became_active":"2024-04-26T12:32:37.139346+0000","last_became_peered":"2024-04-26T12:32:37.139346+0000","last_unstale":"2024-04-26T12:33:29.272743+0000","last_undegraded":"2024-04-26T12:33:29.272743+0000","last_fullsized":"2024-04-26T12:32:37.136119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:26.611762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185408+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:03.185408+0000","last_peered":"2024-04-26T12:35:03.185408+0000","last_clean":"2024-04-26T12:35:03.185408+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:03.185408+0000","last_undegraded":"2024-04-26T12:35:03.185408+0000","last_fullsized":"2024-04-26T12:35:03.185408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155589+0000","last_change":"2024-04-26T12:32:16.107013+0000","last_active":"2024-04-26T12:35:03.155589+0000","last_peered":"2024-04-26T12:35:03.155589+0000","last_clean":"2024-04-26T12:35:03.155589+0000","last_became_active":"2024-04-26T12:32:16.106306+0000","last_became_peered":"2024-04-26T12:32:16.106306+0000","last_unstale":"2024-04-26T12:35:03.155589+0000","last_undegraded":"2024-04-26T12:35:03.155589+0000","last_fullsized":"2024-04-26T12:35:03.155589+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:34.079328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183091+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:03.183091+0000","last_peered":"2024-04-26T12:35:03.183091+0000","last_clean":"2024-04-26T12:35:03.183091+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:03.183091+0000","last_undegraded":"2024-04-26T12:35:03.183091+0000","last_fullsized":"2024-04-26T12:35:03.183091+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185719+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:03.185719+0000","last_peered":"2024-04-26T12:35:03.185719+0000","last_clean":"2024-04-26T12:35:03.185719+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:03.185719+0000","last_undegraded":"2024-04-26T12:35:03.185719+0000","last_fullsized":"2024-04-26T12:35:03.185719+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":36,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272847+0000","last_change":"2024-04-26T12:32:37.141563+0000","last_active":"2024-04-26T12:33:29.272847+0000","last_peered":"2024-04-26T12:33:29.272847+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.141563+0000","last_became_peered":"2024-04-26T12:32:37.141563+0000","last_unstale":"2024-04-26T12:33:29.272847+0000","last_undegraded":"2024-04-26T12:33:29.272847+0000","last_fullsized":"2024-04-26T12:32:37.136397+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:34.172877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272452+0000","last_change":"2024-04-26T12:32:37.140247+0000","last_active":"2024-04-26T12:33:29.272452+0000","last_peered":"2024-04-26T12:33:29.272452+0000","last_clean":"2024-04-26T12:30:25.764494+0000","last_became_active":"2024-04-26T12:32:37.140247+0000","last_became_peered":"2024-04-26T12:32:37.140247+0000","last_unstale":"2024-04-26T12:33:29.272452+0000","last_undegraded":"2024-04-26T12:33:29.272452+0000","last_fullsized":"2024-04-26T12:32:37.136930+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:12.361464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.149178+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:03.149178+0000","last_peered":"2024-04-26T12:35:03.149178+0000","last_clean":"2024-04-26T12:35:03.149178+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:03.149178+0000","last_undegraded":"2024-04-26T12:35:03.149178+0000","last_fullsized":"2024-04-26T12:35:03.149178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":32,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273775+0000","last_change":"2024-04-26T12:32:37.156459+0000","last_active":"2024-04-26T12:33:29.273775+0000","last_peered":"2024-04-26T12:33:29.273775+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.156459+0000","last_became_peered":"2024-04-26T12:32:37.156459+0000","last_unstale":"2024-04-26T12:33:29.273775+0000","last_undegraded":"2024-04-26T12:33:29.273775+0000","last_fullsized":"2024-04-26T12:32:37.137899+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:57.400543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185680+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:03.185680+0000","last_peered":"2024-04-26T12:35:03.185680+0000","last_clean":"2024-04-26T12:35:03.185680+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:03.185680+0000","last_undegraded":"2024-04-26T12:35:03.185680+0000","last_fullsized":"2024-04-26T12:35:03.185680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":284,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155032+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:03.155032+0000","last_peered":"2024-04-26T12:35:03.155032+0000","last_clean":"2024-04-26T12:35:03.155032+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:03.155032+0000","last_undegraded":"2024-04-26T12:35:03.155032+0000","last_fullsized":"2024-04-26T12:35:03.155032+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272350+0000","last_change":"2024-04-26T12:32:37.165168+0000","last_active":"2024-04-26T12:33:29.272350+0000","last_peered":"2024-04-26T12:33:29.272350+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.165168+0000","last_became_peered":"2024-04-26T12:32:37.165168+0000","last_unstale":"2024-04-26T12:33:29.272350+0000","last_undegraded":"2024-04-26T12:33:29.272350+0000","last_fullsized":"2024-04-26T12:32:37.136267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:27.113179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":67,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158127+0000","last_change":"2024-04-26T12:32:16.106958+0000","last_active":"2024-04-26T12:35:03.158127+0000","last_peered":"2024-04-26T12:35:03.158127+0000","last_clean":"2024-04-26T12:35:03.158127+0000","last_became_active":"2024-04-26T12:32:16.106262+0000","last_became_peered":"2024-04-26T12:32:16.106262+0000","last_unstale":"2024-04-26T12:35:03.158127+0000","last_undegraded":"2024-04-26T12:35:03.158127+0000","last_fullsized":"2024-04-26T12:35:03.158127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:33.467447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155192+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:03.155192+0000","last_peered":"2024-04-26T12:35:03.155192+0000","last_clean":"2024-04-26T12:35:03.155192+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:03.155192+0000","last_undegraded":"2024-04-26T12:35:03.155192+0000","last_fullsized":"2024-04-26T12:35:03.155192+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":32,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.276899+0000","last_change":"2024-04-26T12:33:21.670978+0000","last_active":"2024-04-26T12:33:29.276899+0000","last_peered":"2024-04-26T12:33:29.276899+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.156469+0000","last_became_peered":"2024-04-26T12:32:37.156469+0000","last_unstale":"2024-04-26T12:33:29.276899+0000","last_undegraded":"2024-04-26T12:33:21.668269+0000","last_fullsized":"2024-04-26T12:32:37.140070+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:12.925576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8072,"reported_epoch":87,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2024-04-26T12:35:04.914529+0000","last_change":"2024-04-26T12:35:04.914721+0000","last_active":"2024-04-26T12:35:04.914529+0000","last_peered":"2024-04-26T12:35:04.914529+0000","last_clean":"2024-04-26T12:32:36.002439+0000","last_became_active":"2024-04-26T12:35:04.912946+0000","last_became_peered":"2024-04-26T12:35:04.912946+0000","last_unstale":"2024-04-26T12:35:04.914529+0000","last_undegraded":"2024-04-26T12:35:04.914529+0000","last_fullsized":"2024-04-26T12:35:04.157946+0000","mapping_epoch":86,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:03.611859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273237+0000","last_change":"2024-04-26T12:32:37.140306+0000","last_active":"2024-04-26T12:33:29.273237+0000","last_peered":"2024-04-26T12:33:29.273237+0000","last_clean":"2024-04-26T12:30:25.764494+0000","last_became_active":"2024-04-26T12:32:37.140306+0000","last_became_peered":"2024-04-26T12:32:37.140306+0000","last_unstale":"2024-04-26T12:33:29.273237+0000","last_undegraded":"2024-04-26T12:33:29.273237+0000","last_fullsized":"2024-04-26T12:32:37.136775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:49.376539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273012+0000","last_change":"2024-04-26T12:32:37.141669+0000","last_active":"2024-04-26T12:33:29.273012+0000","last_peered":"2024-04-26T12:33:29.273012+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.141669+0000","last_became_peered":"2024-04-26T12:32:37.141669+0000","last_unstale":"2024-04-26T12:33:29.273012+0000","last_undegraded":"2024-04-26T12:33:29.273012+0000","last_fullsized":"2024-04-26T12:32:37.137647+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:12.238883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2099,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155135+0000","last_change":"2024-04-26T12:32:16.109669+0000","last_active":"2024-04-26T12:35:03.155135+0000","last_peered":"2024-04-26T12:35:03.155135+0000","last_clean":"2024-04-26T12:35:03.155135+0000","last_became_active":"2024-04-26T12:32:16.109328+0000","last_became_peered":"2024-04-26T12:32:16.109328+0000","last_unstale":"2024-04-26T12:35:03.155135+0000","last_undegraded":"2024-04-26T12:35:03.155135+0000","last_fullsized":"2024-04-26T12:35:03.155135+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:32.967100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":36,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.273640+0000","last_change":"2024-04-26T12:32:37.155961+0000","last_active":"2024-04-26T12:33:29.273640+0000","last_peered":"2024-04-26T12:33:29.273640+0000","last_clean":"2024-04-26T12:30:32.600329+0000","last_became_active":"2024-04-26T12:32:37.155961+0000","last_became_peered":"2024-04-26T12:32:37.155961+0000","last_unstale":"2024-04-26T12:33:29.273640+0000","last_undegraded":"2024-04-26T12:32:37.137794+0000","last_fullsized":"2024-04-26T12:32:37.137724+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:08.208679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273438+0000","last_change":"2024-04-26T12:32:37.141249+0000","last_active":"2024-04-26T12:33:29.273438+0000","last_peered":"2024-04-26T12:33:29.273438+0000","last_clean":"2024-04-26T12:30:25.764494+0000","last_became_active":"2024-04-26T12:32:37.141249+0000","last_became_peered":"2024-04-26T12:32:37.141249+0000","last_unstale":"2024-04-26T12:33:29.273438+0000","last_undegraded":"2024-04-26T12:33:29.273438+0000","last_fullsized":"2024-04-26T12:32:37.136907+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:49.137101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":35,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.276181+0000","last_change":"2024-04-26T12:32:37.143619+0000","last_active":"2024-04-26T12:33:29.276181+0000","last_peered":"2024-04-26T12:33:29.276181+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.143619+0000","last_became_peered":"2024-04-26T12:32:37.143619+0000","last_unstale":"2024-04-26T12:33:29.276181+0000","last_undegraded":"2024-04-26T12:33:29.276181+0000","last_fullsized":"2024-04-26T12:32:37.138469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:20.849071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155312+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:03.155312+0000","last_peered":"2024-04-26T12:35:03.155312+0000","last_clean":"2024-04-26T12:35:03.155312+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:03.155312+0000","last_undegraded":"2024-04-26T12:35:03.155312+0000","last_fullsized":"2024-04-26T12:35:03.155312+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":82,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.277809+0000","last_change":"2024-04-26T12:32:37.145296+0000","last_active":"2024-04-26T12:33:29.277809+0000","last_peered":"2024-04-26T12:33:29.277809+0000","last_clean":"2024-04-26T12:32:20.153309+0000","last_became_active":"2024-04-26T12:32:37.145296+0000","last_became_peered":"2024-04-26T12:32:37.145296+0000","last_unstale":"2024-04-26T12:33:29.277809+0000","last_undegraded":"2024-04-26T12:32:37.140004+0000","last_fullsized":"2024-04-26T12:32:37.139738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:29.170282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":87,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.149820+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:03.149820+0000","last_peered":"2024-04-26T12:35:03.149820+0000","last_clean":"2024-04-26T12:35:03.149820+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:03.149820+0000","last_undegraded":"2024-04-26T12:35:03.149820+0000","last_fullsized":"2024-04-26T12:35:03.149820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155320+0000","last_change":"2024-04-26T12:32:16.110117+0000","last_active":"2024-04-26T12:35:03.155320+0000","last_peered":"2024-04-26T12:35:03.155320+0000","last_clean":"2024-04-26T12:35:03.155320+0000","last_became_active":"2024-04-26T12:32:16.109893+0000","last_became_peered":"2024-04-26T12:32:16.109893+0000","last_unstale":"2024-04-26T12:35:03.155320+0000","last_undegraded":"2024-04-26T12:35:03.155320+0000","last_fullsized":"2024-04-26T12:35:03.155320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:18.025832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2102,"reported_epoch":87,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:35:04.916634+0000","last_change":"2024-04-26T12:35:04.916758+0000","last_active":"2024-04-26T12:35:04.916634+0000","last_peered":"2024-04-26T12:35:04.916634+0000","last_clean":"2024-04-26T12:32:35.963478+0000","last_became_active":"2024-04-26T12:35:04.915877+0000","last_became_peered":"2024-04-26T12:35:04.915877+0000","last_unstale":"2024-04-26T12:35:04.916634+0000","last_undegraded":"2024-04-26T12:35:04.196807+0000","last_fullsized":"2024-04-26T12:35:04.156105+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:13.025612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.190006+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:03.190006+0000","last_peered":"2024-04-26T12:35:03.190006+0000","last_clean":"2024-04-26T12:35:03.190006+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:03.190006+0000","last_undegraded":"2024-04-26T12:35:03.190006+0000","last_fullsized":"2024-04-26T12:35:03.190006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2138,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.948895+0000","last_change":"2024-04-26T12:35:04.949075+0000","last_active":"2024-04-26T12:35:04.948895+0000","last_peered":"2024-04-26T12:35:04.948895+0000","last_clean":"2024-04-26T12:32:36.098926+0000","last_became_active":"2024-04-26T12:35:04.855031+0000","last_became_peered":"2024-04-26T12:35:04.855031+0000","last_unstale":"2024-04-26T12:35:04.948895+0000","last_undegraded":"2024-04-26T12:35:04.948895+0000","last_fullsized":"2024-04-26T12:35:04.157899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154108+0000","last_change":"2024-04-26T12:32:16.110008+0000","last_active":"2024-04-26T12:35:03.154108+0000","last_peered":"2024-04-26T12:35:03.154108+0000","last_clean":"2024-04-26T12:35:03.154108+0000","last_became_active":"2024-04-26T12:32:16.109548+0000","last_became_peered":"2024-04-26T12:32:16.109548+0000","last_unstale":"2024-04-26T12:35:03.154108+0000","last_undegraded":"2024-04-26T12:35:03.154108+0000","last_fullsized":"2024-04-26T12:35:03.154108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:54.045578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":103,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183117+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:03.183117+0000","last_peered":"2024-04-26T12:35:03.183117+0000","last_clean":"2024-04-26T12:35:03.183117+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:03.183117+0000","last_undegraded":"2024-04-26T12:35:03.183117+0000","last_fullsized":"2024-04-26T12:35:03.183117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":27,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.273459+0000","last_change":"2024-04-26T12:32:37.141034+0000","last_active":"2024-04-26T12:33:29.273459+0000","last_peered":"2024-04-26T12:33:29.273459+0000","last_clean":"2024-04-26T12:30:31.115468+0000","last_became_active":"2024-04-26T12:32:37.141034+0000","last_became_peered":"2024-04-26T12:32:37.141034+0000","last_unstale":"2024-04-26T12:33:29.273459+0000","last_undegraded":"2024-04-26T12:33:29.273459+0000","last_fullsized":"2024-04-26T12:32:37.136943+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:19.844708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4167,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.090858+0000","last_change":"2024-04-26T12:35:05.091032+0000","last_active":"2024-04-26T12:35:05.090858+0000","last_peered":"2024-04-26T12:35:05.090858+0000","last_clean":"2024-04-26T12:32:36.103388+0000","last_became_active":"2024-04-26T12:35:04.864598+0000","last_became_peered":"2024-04-26T12:35:04.864598+0000","last_unstale":"2024-04-26T12:35:05.090858+0000","last_undegraded":"2024-04-26T12:35:05.090858+0000","last_fullsized":"2024-04-26T12:35:04.154810+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:04.516863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":35,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:33:29.278186+0000","last_change":"2024-04-26T12:32:37.162898+0000","last_active":"2024-04-26T12:33:29.278186+0000","last_peered":"2024-04-26T12:33:29.278186+0000","last_clean":"2024-04-26T12:30:32.601015+0000","last_became_active":"2024-04-26T12:32:37.162898+0000","last_became_peered":"2024-04-26T12:32:37.162898+0000","last_unstale":"2024-04-26T12:33:29.278186+0000","last_undegraded":"2024-04-26T12:32:37.141133+0000","last_fullsized":"2024-04-26T12:32:37.140581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:53.980206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2169,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158416+0000","last_change":"2024-04-26T12:32:26.265982+0000","last_active":"2024-04-26T12:35:03.158416+0000","last_peered":"2024-04-26T12:35:03.158416+0000","last_clean":"2024-04-26T12:35:03.158416+0000","last_became_active":"2024-04-26T12:32:26.264296+0000","last_became_peered":"2024-04-26T12:32:26.264296+0000","last_unstale":"2024-04-26T12:35:03.158416+0000","last_undegraded":"2024-04-26T12:35:03.158416+0000","last_fullsized":"2024-04-26T12:35:03.158416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:25.897269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183050+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:03.183050+0000","last_peered":"2024-04-26T12:35:03.183050+0000","last_clean":"2024-04-26T12:35:03.183050+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:03.183050+0000","last_undegraded":"2024-04-26T12:35:03.183050+0000","last_fullsized":"2024-04-26T12:35:03.183050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":39,"reported_epoch":83,"state":"active+undersized","last_fresh":"2024-04-26T12:33:29.272331+0000","last_change":"2024-04-26T12:32:37.138381+0000","last_active":"2024-04-26T12:33:29.272331+0000","last_peered":"2024-04-26T12:33:29.272331+0000","last_clean":"2024-04-26T12:30:32.119831+0000","last_became_active":"2024-04-26T12:32:37.138381+0000","last_became_peered":"2024-04-26T12:32:37.138381+0000","last_unstale":"2024-04-26T12:33:29.272331+0000","last_undegraded":"2024-04-26T12:33:29.272331+0000","last_fullsized":"2024-04-26T12:32:37.136001+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2032,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154382+0000","last_change":"2024-04-26T12:32:16.107224+0000","last_active":"2024-04-26T12:35:03.154382+0000","last_peered":"2024-04-26T12:35:03.154382+0000","last_clean":"2024-04-26T12:35:03.154382+0000","last_became_active":"2024-04-26T12:32:16.106255+0000","last_became_peered":"2024-04-26T12:32:16.106255+0000","last_unstale":"2024-04-26T12:35:03.154382+0000","last_undegraded":"2024-04-26T12:35:03.154382+0000","last_fullsized":"2024-04-26T12:35:03.154382+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:01.140990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2122,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.918637+0000","last_change":"2024-04-26T12:35:04.918822+0000","last_active":"2024-04-26T12:35:04.918637+0000","last_peered":"2024-04-26T12:35:04.918637+0000","last_clean":"2024-04-26T12:32:36.073786+0000","last_became_active":"2024-04-26T12:35:04.854230+0000","last_became_peered":"2024-04-26T12:35:04.854230+0000","last_unstale":"2024-04-26T12:35:04.918637+0000","last_undegraded":"2024-04-26T12:35:04.918637+0000","last_fullsized":"2024-04-26T12:35:04.155076+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:29.948430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.152280+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:03.152280+0000","last_peered":"2024-04-26T12:35:03.152280+0000","last_clean":"2024-04-26T12:35:03.152280+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:03.152280+0000","last_undegraded":"2024-04-26T12:35:03.152280+0000","last_fullsized":"2024-04-26T12:35:03.152280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":171343872,"data_stored":198207577,"data_compressed":131484,"data_compressed_allocated":15028224,"data_compressed_original":41897984,"omap_allocated":0,"internal_metadata":0},"log_size":115817,"ondisk_log_size":115817,"up":115,"acting":88,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":570274,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":49,"acting":49,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738426,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142900,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228940,"statfs":{"total":96636764160,"available":95466434560,"internally_reserved":0,"allocated":1081344,"data_stored":1231353,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.46899999999999997}]}]},{"osd":0,"up_from":0,"seq":1,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201644,"kb_used_data":167844,"kb_used_omap":6,"kb_used_meta":33785,"kb_avail":94170196,"statfs":{"total":96636764160,"available":96430280704,"internally_reserved":0,"allocated":171872256,"data_stored":198456306,"data_compressed":131484,"data_compressed_allocated":15028224,"data_compressed_original":41897984,"omap_allocated":7079,"internal_metadata":34595929},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":8,"seq":34359738427,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511084,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860756,"statfs":{"total":96636764160,"available":95089414144,"internally_reserved":0,"allocated":1073152,"data_stored":1232244,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.152},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.19}]},{"osd":2,"last update":"Fri Apr 26 12:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.436},"min":{"1min":0.33900000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.372,"5min":0.188,"15min":0.188},"max":{"1min":0.70199999999999996,"5min":1.137,"15min":1.137},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":171343872,"data_stored":198207577,"data_compressed":131484,"data_compressed_allocated":15028224,"data_compressed_original":41897984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:06.741 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T12:35:07.236 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:07.236 INFO:teuthology.orchestra.run.smithi038.stdout:{"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 9/50 objects degraded (18.000%), 7 pgs degraded, 71 pgs undersized","count":78},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":291,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":90,"num_osds":3,"num_up_osds":3,"osd_up_since":1714134902,"num_in_osds":3,"osd_in_since":1714134617,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":64},{"state_name":"active+clean","count":34},{"state_name":"active+undersized+degraded","count":7}],"num_pgs":105,"num_pools":4,"num_objects":25,"data_bytes":875808,"bytes_used":2924068864,"bytes_avail":286986223616,"bytes_total":289910292480,"degraded_objects":9,"degraded_total":50,"degraded_ratio":0.17999999999999999},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4190}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T12:31:38.983635+0000","services":{}},"progress_events":{}} 2024-04-26T12:35:07.252 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-26T12:35:07.253 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:07.625 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:07.627 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:07.639 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-04-26T12:35:07.044235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121021,"ondisk_log_size":121021,"up":210,"acting":205,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706572,"kb_used_data":2836,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408948,"statfs":{"total":289910292480,"available":287138762752,"internally_reserved":0,"allocated":2904064,"data_stored":2826266,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.892347"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2063,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.893468+0000","last_change":"2024-04-26T12:35:05.893468+0000","last_active":"2024-04-26T12:35:03.151885+0000","last_peered":"2024-04-26T12:35:01.140467+0000","last_clean":"2024-04-26T12:32:35.991566+0000","last_became_active":"2024-04-26T12:32:37.140332+0000","last_became_peered":"2024-04-26T12:32:37.140332+0000","last_unstale":"2024-04-26T12:35:05.893468+0000","last_undegraded":"2024-04-26T12:35:05.893468+0000","last_fullsized":"2024-04-26T12:35:05.893468+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:23.680548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188195+0000","last_change":"2024-04-26T12:35:03.176728+0000","last_active":"2024-04-26T12:35:05.188195+0000","last_peered":"2024-04-26T12:35:05.188195+0000","last_clean":"2024-04-26T12:35:05.188195+0000","last_became_active":"2024-04-26T12:35:03.165372+0000","last_became_peered":"2024-04-26T12:35:03.165372+0000","last_unstale":"2024-04-26T12:35:05.188195+0000","last_undegraded":"2024-04-26T12:35:05.188195+0000","last_fullsized":"2024-04-26T12:35:05.188195+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:18.088107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4120,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156296+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:03.156296+0000","last_peered":"2024-04-26T12:35:03.156296+0000","last_clean":"2024-04-26T12:35:03.156296+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:03.156296+0000","last_undegraded":"2024-04-26T12:35:03.156296+0000","last_fullsized":"2024-04-26T12:35:03.156296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":105,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.190199+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:03.190199+0000","last_peered":"2024-04-26T12:35:03.190199+0000","last_clean":"2024-04-26T12:35:03.190199+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:03.190199+0000","last_undegraded":"2024-04-26T12:35:03.190199+0000","last_fullsized":"2024-04-26T12:35:03.190199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898378+0000","last_change":"2024-04-26T12:35:05.898378+0000","last_active":"2024-04-26T12:35:05.898378+0000","last_peered":"2024-04-26T12:35:05.898378+0000","last_clean":"2024-04-26T12:35:05.898378+0000","last_became_active":"2024-04-26T12:35:05.897932+0000","last_became_peered":"2024-04-26T12:35:05.897932+0000","last_unstale":"2024-04-26T12:35:05.898378+0000","last_undegraded":"2024-04-26T12:35:05.898378+0000","last_fullsized":"2024-04-26T12:35:05.898378+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:20.346496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186732+0000","last_change":"2024-04-26T12:35:03.180071+0000","last_active":"2024-04-26T12:35:05.186732+0000","last_peered":"2024-04-26T12:35:05.186732+0000","last_clean":"2024-04-26T12:35:05.186732+0000","last_became_active":"2024-04-26T12:35:03.175460+0000","last_became_peered":"2024-04-26T12:35:03.175460+0000","last_unstale":"2024-04-26T12:35:05.186732+0000","last_undegraded":"2024-04-26T12:35:05.186732+0000","last_fullsized":"2024-04-26T12:35:05.186732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:21.916488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186232+0000","last_change":"2024-04-26T12:35:03.188701+0000","last_active":"2024-04-26T12:35:05.186232+0000","last_peered":"2024-04-26T12:35:05.186232+0000","last_clean":"2024-04-26T12:35:05.186232+0000","last_became_active":"2024-04-26T12:35:03.183610+0000","last_became_peered":"2024-04-26T12:35:03.183610+0000","last_unstale":"2024-04-26T12:35:05.186232+0000","last_undegraded":"2024-04-26T12:35:05.186232+0000","last_fullsized":"2024-04-26T12:35:05.186232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:10.730025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8169,"reported_epoch":87,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2024-04-26T12:35:04.923824+0000","last_change":"2024-04-26T12:35:04.923993+0000","last_active":"2024-04-26T12:35:04.923824+0000","last_peered":"2024-04-26T12:35:04.923824+0000","last_clean":"2024-04-26T12:32:36.110957+0000","last_became_active":"2024-04-26T12:35:04.922253+0000","last_became_peered":"2024-04-26T12:35:04.922253+0000","last_unstale":"2024-04-26T12:35:04.923824+0000","last_undegraded":"2024-04-26T12:35:04.923824+0000","last_fullsized":"2024-04-26T12:35:04.157067+0000","mapping_epoch":86,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:39.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6163,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.891874+0000","last_change":"2024-04-26T12:35:05.891874+0000","last_active":"2024-04-26T12:35:03.152078+0000","last_peered":"2024-04-26T12:35:01.140500+0000","last_clean":"2024-04-26T12:32:36.097694+0000","last_became_active":"2024-04-26T12:32:37.139385+0000","last_became_peered":"2024-04-26T12:32:37.139385+0000","last_unstale":"2024-04-26T12:35:05.891874+0000","last_undegraded":"2024-04-26T12:35:05.891874+0000","last_fullsized":"2024-04-26T12:35:05.891874+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:56.575745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6210,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.895234+0000","last_change":"2024-04-26T12:35:05.895234+0000","last_active":"2024-04-26T12:35:03.150974+0000","last_peered":"2024-04-26T12:35:01.140536+0000","last_clean":"2024-04-26T12:32:36.054632+0000","last_became_active":"2024-04-26T12:32:37.140156+0000","last_became_peered":"2024-04-26T12:32:37.140156+0000","last_unstale":"2024-04-26T12:35:05.895234+0000","last_undegraded":"2024-04-26T12:35:05.895234+0000","last_fullsized":"2024-04-26T12:35:05.895234+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6120,"log_dups_size":0,"ondisk_log_size":6120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:10.422122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4067,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.900074+0000","last_change":"2024-04-26T12:35:05.900074+0000","last_active":"2024-04-26T12:35:05.900074+0000","last_peered":"2024-04-26T12:35:05.900074+0000","last_clean":"2024-04-26T12:35:05.900074+0000","last_became_active":"2024-04-26T12:35:05.899482+0000","last_became_peered":"2024-04-26T12:35:05.899482+0000","last_unstale":"2024-04-26T12:35:05.900074+0000","last_undegraded":"2024-04-26T12:35:05.900074+0000","last_fullsized":"2024-04-26T12:35:05.900074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:52.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2097,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154707+0000","last_change":"2024-04-26T12:32:16.107668+0000","last_active":"2024-04-26T12:35:03.154707+0000","last_peered":"2024-04-26T12:35:03.154707+0000","last_clean":"2024-04-26T12:35:03.154707+0000","last_became_active":"2024-04-26T12:32:16.107458+0000","last_became_peered":"2024-04-26T12:32:16.107458+0000","last_unstale":"2024-04-26T12:35:03.154707+0000","last_undegraded":"2024-04-26T12:35:03.154707+0000","last_fullsized":"2024-04-26T12:35:03.154707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.458028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2126,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.896349+0000","last_change":"2024-04-26T12:35:05.896349+0000","last_active":"2024-04-26T12:35:05.896349+0000","last_peered":"2024-04-26T12:35:05.896349+0000","last_clean":"2024-04-26T12:35:05.896349+0000","last_became_active":"2024-04-26T12:35:05.895047+0000","last_became_peered":"2024-04-26T12:35:05.895047+0000","last_unstale":"2024-04-26T12:35:05.896349+0000","last_undegraded":"2024-04-26T12:35:05.896349+0000","last_fullsized":"2024-04-26T12:35:05.896349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:43.511788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2135,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.157272+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:03.157272+0000","last_peered":"2024-04-26T12:35:03.157272+0000","last_clean":"2024-04-26T12:35:03.157272+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:03.157272+0000","last_undegraded":"2024-04-26T12:35:03.157272+0000","last_fullsized":"2024-04-26T12:35:03.157272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160274+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:03.160274+0000","last_peered":"2024-04-26T12:35:03.160274+0000","last_clean":"2024-04-26T12:35:03.160274+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:03.160274+0000","last_undegraded":"2024-04-26T12:35:03.160274+0000","last_fullsized":"2024-04-26T12:35:03.160274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2100,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897209+0000","last_change":"2024-04-26T12:35:05.897209+0000","last_active":"2024-04-26T12:35:05.897209+0000","last_peered":"2024-04-26T12:35:05.897209+0000","last_clean":"2024-04-26T12:35:05.897209+0000","last_became_active":"2024-04-26T12:35:05.896312+0000","last_became_peered":"2024-04-26T12:35:05.896312+0000","last_unstale":"2024-04-26T12:35:05.897209+0000","last_undegraded":"2024-04-26T12:35:05.897209+0000","last_fullsized":"2024-04-26T12:35:05.897209+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:34.224468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2102,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.894963+0000","last_change":"2024-04-26T12:35:05.894963+0000","last_active":"2024-04-26T12:35:03.154215+0000","last_peered":"2024-04-26T12:35:01.140981+0000","last_clean":"2024-04-26T12:32:35.945501+0000","last_became_active":"2024-04-26T12:32:37.156603+0000","last_became_peered":"2024-04-26T12:32:37.156603+0000","last_unstale":"2024-04-26T12:35:05.894963+0000","last_undegraded":"2024-04-26T12:35:05.894963+0000","last_fullsized":"2024-04-26T12:35:05.894963+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:32.001613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2119,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.892007+0000","last_change":"2024-04-26T12:35:05.892007+0000","last_active":"2024-04-26T12:35:03.152777+0000","last_peered":"2024-04-26T12:35:01.140831+0000","last_clean":"2024-04-26T12:32:36.044461+0000","last_became_active":"2024-04-26T12:32:37.143785+0000","last_became_peered":"2024-04-26T12:32:37.143785+0000","last_unstale":"2024-04-26T12:35:05.892007+0000","last_undegraded":"2024-04-26T12:35:05.892007+0000","last_fullsized":"2024-04-26T12:35:05.892007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:09.951622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4082,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.893680+0000","last_change":"2024-04-26T12:35:05.893680+0000","last_active":"2024-04-26T12:35:03.151902+0000","last_peered":"2024-04-26T12:35:01.140123+0000","last_clean":"2024-04-26T12:32:36.045736+0000","last_became_active":"2024-04-26T12:32:37.139277+0000","last_became_peered":"2024-04-26T12:32:37.139277+0000","last_unstale":"2024-04-26T12:35:05.893680+0000","last_undegraded":"2024-04-26T12:35:05.893680+0000","last_fullsized":"2024-04-26T12:35:05.893680+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:49.499643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4198,"reported_epoch":87,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:35:05.091495+0000","last_change":"2024-04-26T12:35:05.098528+0000","last_active":"2024-04-26T12:35:05.091495+0000","last_peered":"2024-04-26T12:35:05.091495+0000","last_clean":"2024-04-26T12:32:36.109719+0000","last_became_active":"2024-04-26T12:35:04.916325+0000","last_became_peered":"2024-04-26T12:35:04.916325+0000","last_unstale":"2024-04-26T12:35:05.091495+0000","last_undegraded":"2024-04-26T12:35:04.203928+0000","last_fullsized":"2024-04-26T12:35:04.158911+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:28.705010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":108,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157590+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:04.157590+0000","last_peered":"2024-04-26T12:35:04.157590+0000","last_clean":"2024-04-26T12:35:04.157590+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:04.157590+0000","last_undegraded":"2024-04-26T12:35:04.157590+0000","last_fullsized":"2024-04-26T12:35:04.157590+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2105,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.154914+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:04.154914+0000","last_peered":"2024-04-26T12:35:04.154914+0000","last_clean":"2024-04-26T12:35:04.154914+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:04.154914+0000","last_undegraded":"2024-04-26T12:35:04.154914+0000","last_fullsized":"2024-04-26T12:35:04.154914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2090,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897472+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:05.897472+0000","last_peered":"2024-04-26T12:35:05.897472+0000","last_clean":"2024-04-26T12:35:05.897472+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:05.897472+0000","last_undegraded":"2024-04-26T12:35:05.897472+0000","last_fullsized":"2024-04-26T12:35:05.897472+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4117,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.890872+0000","last_change":"2024-04-26T12:35:05.890872+0000","last_active":"2024-04-26T12:35:03.150075+0000","last_peered":"2024-04-26T12:35:01.139535+0000","last_clean":"2024-04-26T12:32:36.098162+0000","last_became_active":"2024-04-26T12:32:37.139435+0000","last_became_peered":"2024-04-26T12:32:37.139435+0000","last_unstale":"2024-04-26T12:35:05.890872+0000","last_undegraded":"2024-04-26T12:35:05.890872+0000","last_fullsized":"2024-04-26T12:35:05.890872+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:06.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2140,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155032+0000","last_change":"2024-04-26T12:32:16.109558+0000","last_active":"2024-04-26T12:35:03.155032+0000","last_peered":"2024-04-26T12:35:03.155032+0000","last_clean":"2024-04-26T12:35:03.155032+0000","last_became_active":"2024-04-26T12:32:16.109196+0000","last_became_peered":"2024-04-26T12:32:16.109196+0000","last_unstale":"2024-04-26T12:35:03.155032+0000","last_undegraded":"2024-04-26T12:35:03.155032+0000","last_fullsized":"2024-04-26T12:35:03.155032+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:25.423545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188611+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:05.188611+0000","last_peered":"2024-04-26T12:35:05.188611+0000","last_clean":"2024-04-26T12:35:05.188611+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:05.188611+0000","last_undegraded":"2024-04-26T12:35:05.188611+0000","last_fullsized":"2024-04-26T12:35:05.188611+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2090,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155387+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:03.155387+0000","last_peered":"2024-04-26T12:35:03.155387+0000","last_clean":"2024-04-26T12:35:03.155387+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:03.155387+0000","last_undegraded":"2024-04-26T12:35:03.155387+0000","last_fullsized":"2024-04-26T12:35:03.155387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188099+0000","last_change":"2024-04-26T12:35:03.178830+0000","last_active":"2024-04-26T12:35:05.188099+0000","last_peered":"2024-04-26T12:35:05.188099+0000","last_clean":"2024-04-26T12:35:05.188099+0000","last_became_active":"2024-04-26T12:35:03.166452+0000","last_became_peered":"2024-04-26T12:35:03.166452+0000","last_unstale":"2024-04-26T12:35:05.188099+0000","last_undegraded":"2024-04-26T12:35:05.188099+0000","last_fullsized":"2024-04-26T12:35:05.188099+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:03.037906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155103+0000","last_change":"2024-04-26T12:32:16.110135+0000","last_active":"2024-04-26T12:35:03.155103+0000","last_peered":"2024-04-26T12:35:03.155103+0000","last_clean":"2024-04-26T12:35:03.155103+0000","last_became_active":"2024-04-26T12:32:16.109837+0000","last_became_peered":"2024-04-26T12:32:16.109837+0000","last_unstale":"2024-04-26T12:35:03.155103+0000","last_undegraded":"2024-04-26T12:35:03.155103+0000","last_fullsized":"2024-04-26T12:35:03.155103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:19.898367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186022+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:05.186022+0000","last_peered":"2024-04-26T12:35:05.186022+0000","last_clean":"2024-04-26T12:35:05.186022+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:05.186022+0000","last_undegraded":"2024-04-26T12:35:05.186022+0000","last_fullsized":"2024-04-26T12:35:05.186022+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188243+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:05.188243+0000","last_peered":"2024-04-26T12:35:05.188243+0000","last_clean":"2024-04-26T12:35:05.188243+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:05.188243+0000","last_undegraded":"2024-04-26T12:35:05.188243+0000","last_fullsized":"2024-04-26T12:35:05.188243+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.185766+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:05.185766+0000","last_peered":"2024-04-26T12:35:05.185766+0000","last_clean":"2024-04-26T12:35:05.185766+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:05.185766+0000","last_undegraded":"2024-04-26T12:35:05.185766+0000","last_fullsized":"2024-04-26T12:35:05.185766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156554+0000","last_change":"2024-04-26T12:32:16.109433+0000","last_active":"2024-04-26T12:35:03.156554+0000","last_peered":"2024-04-26T12:35:03.156554+0000","last_clean":"2024-04-26T12:35:03.156554+0000","last_became_active":"2024-04-26T12:32:16.109171+0000","last_became_peered":"2024-04-26T12:32:16.109171+0000","last_unstale":"2024-04-26T12:35:03.156554+0000","last_undegraded":"2024-04-26T12:35:03.156554+0000","last_fullsized":"2024-04-26T12:35:03.156554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188356+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:05.188356+0000","last_peered":"2024-04-26T12:35:05.188356+0000","last_clean":"2024-04-26T12:35:05.188356+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:05.188356+0000","last_undegraded":"2024-04-26T12:35:05.188356+0000","last_fullsized":"2024-04-26T12:35:05.188356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186233+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:05.186233+0000","last_peered":"2024-04-26T12:35:05.186233+0000","last_clean":"2024-04-26T12:35:05.186233+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:05.186233+0000","last_undegraded":"2024-04-26T12:35:05.186233+0000","last_fullsized":"2024-04-26T12:35:05.186233+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187289+0000","last_change":"2024-04-26T12:35:03.190889+0000","last_active":"2024-04-26T12:35:05.187289+0000","last_peered":"2024-04-26T12:35:05.187289+0000","last_clean":"2024-04-26T12:35:05.187289+0000","last_became_active":"2024-04-26T12:35:03.189699+0000","last_became_peered":"2024-04-26T12:35:03.189699+0000","last_unstale":"2024-04-26T12:35:05.187289+0000","last_undegraded":"2024-04-26T12:35:05.187289+0000","last_fullsized":"2024-04-26T12:35:05.187289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:58.599512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6166,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-26T12:35:05.405934+0000","last_change":"2024-04-26T12:35:05.891229+0000","last_active":"2024-04-26T12:35:05.891229+0000","last_peered":"2024-04-26T12:35:05.405934+0000","last_clean":"2024-04-26T12:32:36.090113+0000","last_became_active":"2024-04-26T12:35:04.864319+0000","last_became_peered":"2024-04-26T12:35:04.864319+0000","last_unstale":"2024-04-26T12:35:05.405934+0000","last_undegraded":"2024-04-26T12:35:05.405934+0000","last_fullsized":"2024-04-26T12:35:04.157028+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:09.983277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":57,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155132+0000","last_change":"2024-04-26T12:32:16.109604+0000","last_active":"2024-04-26T12:35:03.155132+0000","last_peered":"2024-04-26T12:35:03.155132+0000","last_clean":"2024-04-26T12:35:03.155132+0000","last_became_active":"2024-04-26T12:32:16.109232+0000","last_became_peered":"2024-04-26T12:32:16.109232+0000","last_unstale":"2024-04-26T12:35:03.155132+0000","last_undegraded":"2024-04-26T12:35:03.155132+0000","last_fullsized":"2024-04-26T12:35:03.155132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:08.819922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898374+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:05.898374+0000","last_peered":"2024-04-26T12:35:05.898374+0000","last_clean":"2024-04-26T12:35:05.898374+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:05.898374+0000","last_undegraded":"2024-04-26T12:35:05.898374+0000","last_fullsized":"2024-04-26T12:35:05.898374+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":180,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156465+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:03.156465+0000","last_peered":"2024-04-26T12:35:03.156465+0000","last_clean":"2024-04-26T12:35:03.156465+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:03.156465+0000","last_undegraded":"2024-04-26T12:35:03.156465+0000","last_fullsized":"2024-04-26T12:35:03.156465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4177,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158648+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:03.158648+0000","last_peered":"2024-04-26T12:35:03.158648+0000","last_clean":"2024-04-26T12:35:03.158648+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:03.158648+0000","last_undegraded":"2024-04-26T12:35:03.158648+0000","last_fullsized":"2024-04-26T12:35:03.158648+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185706+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:03.185706+0000","last_peered":"2024-04-26T12:35:03.185706+0000","last_clean":"2024-04-26T12:35:03.185706+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:03.185706+0000","last_undegraded":"2024-04-26T12:35:03.185706+0000","last_fullsized":"2024-04-26T12:35:03.185706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2060,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.891467+0000","last_change":"2024-04-26T12:35:05.891467+0000","last_active":"2024-04-26T12:35:03.151921+0000","last_peered":"2024-04-26T12:35:01.139783+0000","last_clean":"2024-04-26T12:32:35.952933+0000","last_became_active":"2024-04-26T12:32:37.141807+0000","last_became_peered":"2024-04-26T12:32:37.141807+0000","last_unstale":"2024-04-26T12:35:05.891467+0000","last_undegraded":"2024-04-26T12:35:05.891467+0000","last_fullsized":"2024-04-26T12:35:05.891467+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:36.967055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186045+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:05.186045+0000","last_peered":"2024-04-26T12:35:05.186045+0000","last_clean":"2024-04-26T12:35:05.186045+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:05.186045+0000","last_undegraded":"2024-04-26T12:35:05.186045+0000","last_fullsized":"2024-04-26T12:35:05.186045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2066,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897734+0000","last_change":"2024-04-26T12:35:05.897734+0000","last_active":"2024-04-26T12:35:05.897734+0000","last_peered":"2024-04-26T12:35:05.897734+0000","last_clean":"2024-04-26T12:35:05.897734+0000","last_became_active":"2024-04-26T12:35:05.897297+0000","last_became_peered":"2024-04-26T12:35:05.897297+0000","last_unstale":"2024-04-26T12:35:05.897734+0000","last_undegraded":"2024-04-26T12:35:05.897734+0000","last_fullsized":"2024-04-26T12:35:05.897734+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:22.684365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160145+0000","last_change":"2024-04-26T12:32:16.107025+0000","last_active":"2024-04-26T12:35:03.160145+0000","last_peered":"2024-04-26T12:35:03.160145+0000","last_clean":"2024-04-26T12:35:03.160145+0000","last_became_active":"2024-04-26T12:32:16.106307+0000","last_became_peered":"2024-04-26T12:32:16.106307+0000","last_unstale":"2024-04-26T12:35:03.160145+0000","last_undegraded":"2024-04-26T12:35:03.160145+0000","last_fullsized":"2024-04-26T12:35:03.160145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:31.214495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188548+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:05.188548+0000","last_peered":"2024-04-26T12:35:05.188548+0000","last_clean":"2024-04-26T12:35:05.188548+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:05.188548+0000","last_undegraded":"2024-04-26T12:35:05.188548+0000","last_fullsized":"2024-04-26T12:35:05.188548+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":93,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156725+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:03.156725+0000","last_peered":"2024-04-26T12:35:03.156725+0000","last_clean":"2024-04-26T12:35:03.156725+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:03.156725+0000","last_undegraded":"2024-04-26T12:35:03.156725+0000","last_fullsized":"2024-04-26T12:35:03.156725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2153,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.896130+0000","last_change":"2024-04-26T12:35:05.896130+0000","last_active":"2024-04-26T12:35:03.157039+0000","last_peered":"2024-04-26T12:35:01.143823+0000","last_clean":"2024-04-26T12:32:35.940778+0000","last_became_active":"2024-04-26T12:32:37.144911+0000","last_became_peered":"2024-04-26T12:32:37.144911+0000","last_unstale":"2024-04-26T12:35:05.896130+0000","last_undegraded":"2024-04-26T12:35:05.896130+0000","last_fullsized":"2024-04-26T12:35:05.896130+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:24.704812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.158266+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:04.158266+0000","last_peered":"2024-04-26T12:35:04.158266+0000","last_clean":"2024-04-26T12:35:04.158266+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:04.158266+0000","last_undegraded":"2024-04-26T12:35:04.158266+0000","last_fullsized":"2024-04-26T12:35:04.158266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.153716+0000","last_change":"2024-04-26T12:32:16.109694+0000","last_active":"2024-04-26T12:35:03.153716+0000","last_peered":"2024-04-26T12:35:03.153716+0000","last_clean":"2024-04-26T12:35:03.153716+0000","last_became_active":"2024-04-26T12:32:16.109070+0000","last_became_peered":"2024-04-26T12:32:16.109070+0000","last_unstale":"2024-04-26T12:35:03.153716+0000","last_undegraded":"2024-04-26T12:35:03.153716+0000","last_fullsized":"2024-04-26T12:35:03.153716+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:54.733914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":85,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157540+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:04.157540+0000","last_peered":"2024-04-26T12:35:04.157540+0000","last_clean":"2024-04-26T12:35:04.157540+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:04.157540+0000","last_undegraded":"2024-04-26T12:35:04.157540+0000","last_fullsized":"2024-04-26T12:35:04.157540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.185775+0000","last_change":"2024-04-26T12:35:03.186376+0000","last_active":"2024-04-26T12:35:05.185775+0000","last_peered":"2024-04-26T12:35:05.185775+0000","last_clean":"2024-04-26T12:35:05.185775+0000","last_became_active":"2024-04-26T12:35:03.168583+0000","last_became_peered":"2024-04-26T12:35:03.168583+0000","last_unstale":"2024-04-26T12:35:05.185775+0000","last_undegraded":"2024-04-26T12:35:05.185775+0000","last_fullsized":"2024-04-26T12:35:05.185775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:20.154397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":81,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.150234+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:35:03.150234+0000","last_peered":"2024-04-26T12:35:03.150234+0000","last_clean":"2024-04-26T12:35:03.150234+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:35:03.150234+0000","last_undegraded":"2024-04-26T12:35:03.150234+0000","last_fullsized":"2024-04-26T12:35:03.150234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2092,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.889386+0000","last_change":"2024-04-26T12:35:04.889560+0000","last_active":"2024-04-26T12:35:04.889386+0000","last_peered":"2024-04-26T12:35:04.889386+0000","last_clean":"2024-04-26T12:32:36.095836+0000","last_became_active":"2024-04-26T12:35:04.852698+0000","last_became_peered":"2024-04-26T12:35:04.852698+0000","last_unstale":"2024-04-26T12:35:04.889386+0000","last_undegraded":"2024-04-26T12:35:04.889386+0000","last_fullsized":"2024-04-26T12:35:04.158275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:04.200236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157564+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:04.157564+0000","last_peered":"2024-04-26T12:35:04.157564+0000","last_clean":"2024-04-26T12:35:04.157564+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:04.157564+0000","last_undegraded":"2024-04-26T12:35:04.157564+0000","last_fullsized":"2024-04-26T12:35:04.157564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.189069+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:05.189069+0000","last_peered":"2024-04-26T12:35:05.189069+0000","last_clean":"2024-04-26T12:35:05.189069+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:05.189069+0000","last_undegraded":"2024-04-26T12:35:05.189069+0000","last_fullsized":"2024-04-26T12:35:05.189069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187136+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:05.187136+0000","last_peered":"2024-04-26T12:35:05.187136+0000","last_clean":"2024-04-26T12:35:05.187136+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:05.187136+0000","last_undegraded":"2024-04-26T12:35:05.187136+0000","last_fullsized":"2024-04-26T12:35:05.187136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2080,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.074617+0000","last_change":"2024-04-26T12:35:05.074617+0000","last_active":"2024-04-26T12:35:05.074617+0000","last_peered":"2024-04-26T12:35:05.074617+0000","last_clean":"2024-04-26T12:32:36.109396+0000","last_became_active":"2024-04-26T12:35:04.916362+0000","last_became_peered":"2024-04-26T12:35:04.916362+0000","last_unstale":"2024-04-26T12:35:05.074617+0000","last_undegraded":"2024-04-26T12:35:05.074617+0000","last_fullsized":"2024-04-26T12:35:04.157688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:30.735718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.181023+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:03.181023+0000","last_peered":"2024-04-26T12:35:03.181023+0000","last_clean":"2024-04-26T12:35:03.181023+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:03.181023+0000","last_undegraded":"2024-04-26T12:35:03.181023+0000","last_fullsized":"2024-04-26T12:35:03.181023+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2123,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.161640+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:04.161640+0000","last_peered":"2024-04-26T12:35:04.161640+0000","last_clean":"2024-04-26T12:35:04.161640+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:04.161640+0000","last_undegraded":"2024-04-26T12:35:04.161640+0000","last_fullsized":"2024-04-26T12:35:04.161640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160320+0000","last_change":"2024-04-26T12:32:16.109449+0000","last_active":"2024-04-26T12:35:03.160320+0000","last_peered":"2024-04-26T12:35:03.160320+0000","last_clean":"2024-04-26T12:35:03.160320+0000","last_became_active":"2024-04-26T12:32:16.109131+0000","last_became_peered":"2024-04-26T12:32:16.109131+0000","last_unstale":"2024-04-26T12:35:03.160320+0000","last_undegraded":"2024-04-26T12:35:03.160320+0000","last_fullsized":"2024-04-26T12:35:03.160320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:47.757728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.158233+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:04.158233+0000","last_peered":"2024-04-26T12:35:04.158233+0000","last_clean":"2024-04-26T12:35:04.158233+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:04.158233+0000","last_undegraded":"2024-04-26T12:35:04.158233+0000","last_fullsized":"2024-04-26T12:35:04.158233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186034+0000","last_change":"2024-04-26T12:35:03.171996+0000","last_active":"2024-04-26T12:35:05.186034+0000","last_peered":"2024-04-26T12:35:05.186034+0000","last_clean":"2024-04-26T12:35:05.186034+0000","last_became_active":"2024-04-26T12:35:03.163038+0000","last_became_peered":"2024-04-26T12:35:03.163038+0000","last_unstale":"2024-04-26T12:35:05.186034+0000","last_undegraded":"2024-04-26T12:35:05.186034+0000","last_fullsized":"2024-04-26T12:35:05.186034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:29.580246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6168,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.894905+0000","last_change":"2024-04-26T12:35:05.894905+0000","last_active":"2024-04-26T12:35:03.153778+0000","last_peered":"2024-04-26T12:35:01.140789+0000","last_clean":"2024-04-26T12:32:36.042703+0000","last_became_active":"2024-04-26T12:32:37.155816+0000","last_became_peered":"2024-04-26T12:32:37.155816+0000","last_unstale":"2024-04-26T12:35:05.894905+0000","last_undegraded":"2024-04-26T12:35:05.894905+0000","last_fullsized":"2024-04-26T12:35:05.894905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:58.465619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188216+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:05.188216+0000","last_peered":"2024-04-26T12:35:05.188216+0000","last_clean":"2024-04-26T12:35:05.188216+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:05.188216+0000","last_undegraded":"2024-04-26T12:35:05.188216+0000","last_fullsized":"2024-04-26T12:35:05.188216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185408+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:03.185408+0000","last_peered":"2024-04-26T12:35:03.185408+0000","last_clean":"2024-04-26T12:35:03.185408+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:03.185408+0000","last_undegraded":"2024-04-26T12:35:03.185408+0000","last_fullsized":"2024-04-26T12:35:03.185408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155589+0000","last_change":"2024-04-26T12:32:16.107013+0000","last_active":"2024-04-26T12:35:03.155589+0000","last_peered":"2024-04-26T12:35:03.155589+0000","last_clean":"2024-04-26T12:35:03.155589+0000","last_became_active":"2024-04-26T12:32:16.106306+0000","last_became_peered":"2024-04-26T12:32:16.106306+0000","last_unstale":"2024-04-26T12:35:03.155589+0000","last_undegraded":"2024-04-26T12:35:03.155589+0000","last_fullsized":"2024-04-26T12:35:03.155589+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:34.079328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183091+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:03.183091+0000","last_peered":"2024-04-26T12:35:03.183091+0000","last_clean":"2024-04-26T12:35:03.183091+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:03.183091+0000","last_undegraded":"2024-04-26T12:35:03.183091+0000","last_fullsized":"2024-04-26T12:35:03.183091+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185719+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:03.185719+0000","last_peered":"2024-04-26T12:35:03.185719+0000","last_clean":"2024-04-26T12:35:03.185719+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:03.185719+0000","last_undegraded":"2024-04-26T12:35:03.185719+0000","last_fullsized":"2024-04-26T12:35:03.185719+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187109+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:05.187109+0000","last_peered":"2024-04-26T12:35:05.187109+0000","last_clean":"2024-04-26T12:35:05.187109+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:05.187109+0000","last_undegraded":"2024-04-26T12:35:05.187109+0000","last_fullsized":"2024-04-26T12:35:05.187109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186587+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:05.186587+0000","last_peered":"2024-04-26T12:35:05.186587+0000","last_clean":"2024-04-26T12:35:05.186587+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:05.186587+0000","last_undegraded":"2024-04-26T12:35:05.186587+0000","last_fullsized":"2024-04-26T12:35:05.186587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.149178+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:03.149178+0000","last_peered":"2024-04-26T12:35:03.149178+0000","last_clean":"2024-04-26T12:35:03.149178+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:03.149178+0000","last_undegraded":"2024-04-26T12:35:03.149178+0000","last_fullsized":"2024-04-26T12:35:03.149178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188456+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:05.188456+0000","last_peered":"2024-04-26T12:35:05.188456+0000","last_clean":"2024-04-26T12:35:05.188456+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:05.188456+0000","last_undegraded":"2024-04-26T12:35:05.188456+0000","last_fullsized":"2024-04-26T12:35:05.188456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185680+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:03.185680+0000","last_peered":"2024-04-26T12:35:03.185680+0000","last_clean":"2024-04-26T12:35:03.185680+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:03.185680+0000","last_undegraded":"2024-04-26T12:35:03.185680+0000","last_fullsized":"2024-04-26T12:35:03.185680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":284,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155032+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:03.155032+0000","last_peered":"2024-04-26T12:35:03.155032+0000","last_clean":"2024-04-26T12:35:03.155032+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:03.155032+0000","last_undegraded":"2024-04-26T12:35:03.155032+0000","last_fullsized":"2024-04-26T12:35:03.155032+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186724+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:05.186724+0000","last_peered":"2024-04-26T12:35:05.186724+0000","last_clean":"2024-04-26T12:35:05.186724+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:05.186724+0000","last_undegraded":"2024-04-26T12:35:05.186724+0000","last_fullsized":"2024-04-26T12:35:05.186724+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":67,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158127+0000","last_change":"2024-04-26T12:32:16.106958+0000","last_active":"2024-04-26T12:35:03.158127+0000","last_peered":"2024-04-26T12:35:03.158127+0000","last_clean":"2024-04-26T12:35:03.158127+0000","last_became_active":"2024-04-26T12:32:16.106262+0000","last_became_peered":"2024-04-26T12:32:16.106262+0000","last_unstale":"2024-04-26T12:35:03.158127+0000","last_undegraded":"2024-04-26T12:35:03.158127+0000","last_fullsized":"2024-04-26T12:35:03.158127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:33.467447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155192+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:03.155192+0000","last_peered":"2024-04-26T12:35:03.155192+0000","last_clean":"2024-04-26T12:35:03.155192+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:03.155192+0000","last_undegraded":"2024-04-26T12:35:03.155192+0000","last_fullsized":"2024-04-26T12:35:03.155192+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186747+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:05.186747+0000","last_peered":"2024-04-26T12:35:05.186747+0000","last_clean":"2024-04-26T12:35:05.186747+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:05.186747+0000","last_undegraded":"2024-04-26T12:35:05.186747+0000","last_fullsized":"2024-04-26T12:35:05.186747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8076,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-26T12:35:05.451340+0000","last_change":"2024-04-26T12:35:05.891484+0000","last_active":"2024-04-26T12:35:05.891484+0000","last_peered":"2024-04-26T12:35:05.451340+0000","last_clean":"2024-04-26T12:32:36.002439+0000","last_became_active":"2024-04-26T12:35:04.912946+0000","last_became_peered":"2024-04-26T12:35:04.912946+0000","last_unstale":"2024-04-26T12:35:05.451340+0000","last_undegraded":"2024-04-26T12:35:05.451340+0000","last_fullsized":"2024-04-26T12:35:04.157946+0000","mapping_epoch":89,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:59.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186967+0000","last_change":"2024-04-26T12:35:03.179164+0000","last_active":"2024-04-26T12:35:05.186967+0000","last_peered":"2024-04-26T12:35:05.186967+0000","last_clean":"2024-04-26T12:35:05.186967+0000","last_became_active":"2024-04-26T12:35:03.176940+0000","last_became_peered":"2024-04-26T12:35:03.176940+0000","last_unstale":"2024-04-26T12:35:05.186967+0000","last_undegraded":"2024-04-26T12:35:05.186967+0000","last_fullsized":"2024-04-26T12:35:05.186967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:29.707002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.189056+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:05.189056+0000","last_peered":"2024-04-26T12:35:05.189056+0000","last_clean":"2024-04-26T12:35:05.189056+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:05.189056+0000","last_undegraded":"2024-04-26T12:35:05.189056+0000","last_fullsized":"2024-04-26T12:35:05.189056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2099,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155135+0000","last_change":"2024-04-26T12:32:16.109669+0000","last_active":"2024-04-26T12:35:03.155135+0000","last_peered":"2024-04-26T12:35:03.155135+0000","last_clean":"2024-04-26T12:35:03.155135+0000","last_became_active":"2024-04-26T12:32:16.109328+0000","last_became_peered":"2024-04-26T12:32:16.109328+0000","last_unstale":"2024-04-26T12:35:03.155135+0000","last_undegraded":"2024-04-26T12:35:03.155135+0000","last_fullsized":"2024-04-26T12:35:03.155135+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:32.967100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187210+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:05.187210+0000","last_peered":"2024-04-26T12:35:05.187210+0000","last_clean":"2024-04-26T12:35:05.187210+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:05.187210+0000","last_undegraded":"2024-04-26T12:35:05.187210+0000","last_fullsized":"2024-04-26T12:35:05.187210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187396+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:05.187396+0000","last_peered":"2024-04-26T12:35:05.187396+0000","last_clean":"2024-04-26T12:35:05.187396+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:05.187396+0000","last_undegraded":"2024-04-26T12:35:05.187396+0000","last_fullsized":"2024-04-26T12:35:05.187396+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.185945+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:05.185945+0000","last_peered":"2024-04-26T12:35:05.185945+0000","last_clean":"2024-04-26T12:35:05.185945+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:05.185945+0000","last_undegraded":"2024-04-26T12:35:05.185945+0000","last_fullsized":"2024-04-26T12:35:05.185945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155312+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:03.155312+0000","last_peered":"2024-04-26T12:35:03.155312+0000","last_clean":"2024-04-26T12:35:03.155312+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:03.155312+0000","last_undegraded":"2024-04-26T12:35:03.155312+0000","last_fullsized":"2024-04-26T12:35:03.155312+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188428+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:05.188428+0000","last_peered":"2024-04-26T12:35:05.188428+0000","last_clean":"2024-04-26T12:35:05.188428+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:05.188428+0000","last_undegraded":"2024-04-26T12:35:05.188428+0000","last_fullsized":"2024-04-26T12:35:05.188428+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":87,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.149820+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:03.149820+0000","last_peered":"2024-04-26T12:35:03.149820+0000","last_clean":"2024-04-26T12:35:03.149820+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:03.149820+0000","last_undegraded":"2024-04-26T12:35:03.149820+0000","last_fullsized":"2024-04-26T12:35:03.149820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155320+0000","last_change":"2024-04-26T12:32:16.110117+0000","last_active":"2024-04-26T12:35:03.155320+0000","last_peered":"2024-04-26T12:35:03.155320+0000","last_clean":"2024-04-26T12:35:03.155320+0000","last_became_active":"2024-04-26T12:32:16.109893+0000","last_became_peered":"2024-04-26T12:32:16.109893+0000","last_unstale":"2024-04-26T12:35:03.155320+0000","last_undegraded":"2024-04-26T12:35:03.155320+0000","last_fullsized":"2024-04-26T12:35:03.155320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:18.025832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2099,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.891098+0000","last_change":"2024-04-26T12:35:05.891098+0000","last_active":"2024-04-26T12:35:03.152192+0000","last_peered":"2024-04-26T12:35:01.140160+0000","last_clean":"2024-04-26T12:32:35.963478+0000","last_became_active":"2024-04-26T12:32:37.142589+0000","last_became_peered":"2024-04-26T12:32:37.142589+0000","last_unstale":"2024-04-26T12:35:05.891098+0000","last_undegraded":"2024-04-26T12:35:05.891098+0000","last_fullsized":"2024-04-26T12:35:05.891098+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.164659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.190006+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:03.190006+0000","last_peered":"2024-04-26T12:35:03.190006+0000","last_clean":"2024-04-26T12:35:03.190006+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:03.190006+0000","last_undegraded":"2024-04-26T12:35:03.190006+0000","last_fullsized":"2024-04-26T12:35:03.190006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2138,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.948895+0000","last_change":"2024-04-26T12:35:04.949075+0000","last_active":"2024-04-26T12:35:04.948895+0000","last_peered":"2024-04-26T12:35:04.948895+0000","last_clean":"2024-04-26T12:32:36.098926+0000","last_became_active":"2024-04-26T12:35:04.855031+0000","last_became_peered":"2024-04-26T12:35:04.855031+0000","last_unstale":"2024-04-26T12:35:04.948895+0000","last_undegraded":"2024-04-26T12:35:04.948895+0000","last_fullsized":"2024-04-26T12:35:04.157899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154108+0000","last_change":"2024-04-26T12:32:16.110008+0000","last_active":"2024-04-26T12:35:03.154108+0000","last_peered":"2024-04-26T12:35:03.154108+0000","last_clean":"2024-04-26T12:35:03.154108+0000","last_became_active":"2024-04-26T12:32:16.109548+0000","last_became_peered":"2024-04-26T12:32:16.109548+0000","last_unstale":"2024-04-26T12:35:03.154108+0000","last_undegraded":"2024-04-26T12:35:03.154108+0000","last_fullsized":"2024-04-26T12:35:03.154108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:54.045578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":103,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183117+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:03.183117+0000","last_peered":"2024-04-26T12:35:03.183117+0000","last_clean":"2024-04-26T12:35:03.183117+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:03.183117+0000","last_undegraded":"2024-04-26T12:35:03.183117+0000","last_fullsized":"2024-04-26T12:35:03.183117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":66,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188093+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:05.188093+0000","last_peered":"2024-04-26T12:35:05.188093+0000","last_clean":"2024-04-26T12:35:05.188093+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:05.188093+0000","last_undegraded":"2024-04-26T12:35:05.188093+0000","last_fullsized":"2024-04-26T12:35:05.188093+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4166,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895130+0000","last_change":"2024-04-26T12:35:05.895130+0000","last_active":"2024-04-26T12:35:05.895130+0000","last_peered":"2024-04-26T12:35:05.895130+0000","last_clean":"2024-04-26T12:35:05.895130+0000","last_became_active":"2024-04-26T12:35:05.893689+0000","last_became_peered":"2024-04-26T12:35:05.893689+0000","last_unstale":"2024-04-26T12:35:05.895130+0000","last_undegraded":"2024-04-26T12:35:05.895130+0000","last_fullsized":"2024-04-26T12:35:05.895130+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:15.086674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188548+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:05.188548+0000","last_peered":"2024-04-26T12:35:05.188548+0000","last_clean":"2024-04-26T12:35:05.188548+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:05.188548+0000","last_undegraded":"2024-04-26T12:35:05.188548+0000","last_fullsized":"2024-04-26T12:35:05.188548+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2169,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158416+0000","last_change":"2024-04-26T12:32:26.265982+0000","last_active":"2024-04-26T12:35:03.158416+0000","last_peered":"2024-04-26T12:35:03.158416+0000","last_clean":"2024-04-26T12:35:03.158416+0000","last_became_active":"2024-04-26T12:32:26.264296+0000","last_became_peered":"2024-04-26T12:32:26.264296+0000","last_unstale":"2024-04-26T12:35:03.158416+0000","last_undegraded":"2024-04-26T12:35:03.158416+0000","last_fullsized":"2024-04-26T12:35:03.158416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:25.897269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183050+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:03.183050+0000","last_peered":"2024-04-26T12:35:03.183050+0000","last_clean":"2024-04-26T12:35:03.183050+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:03.183050+0000","last_undegraded":"2024-04-26T12:35:03.183050+0000","last_fullsized":"2024-04-26T12:35:03.183050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186653+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:05.186653+0000","last_peered":"2024-04-26T12:35:05.186653+0000","last_clean":"2024-04-26T12:35:05.186653+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:05.186653+0000","last_undegraded":"2024-04-26T12:35:05.186653+0000","last_fullsized":"2024-04-26T12:35:05.186653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2032,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154382+0000","last_change":"2024-04-26T12:32:16.107224+0000","last_active":"2024-04-26T12:35:03.154382+0000","last_peered":"2024-04-26T12:35:03.154382+0000","last_clean":"2024-04-26T12:35:03.154382+0000","last_became_active":"2024-04-26T12:32:16.106255+0000","last_became_peered":"2024-04-26T12:32:16.106255+0000","last_unstale":"2024-04-26T12:35:03.154382+0000","last_undegraded":"2024-04-26T12:35:03.154382+0000","last_fullsized":"2024-04-26T12:35:03.154382+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:01.140990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898005+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:05.898005+0000","last_peered":"2024-04-26T12:35:05.898005+0000","last_clean":"2024-04-26T12:35:05.898005+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:05.898005+0000","last_undegraded":"2024-04-26T12:35:05.898005+0000","last_fullsized":"2024-04-26T12:35:05.898005+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.152280+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:03.152280+0000","last_peered":"2024-04-26T12:35:03.152280+0000","last_clean":"2024-04-26T12:35:03.152280+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:03.152280+0000","last_undegraded":"2024-04-26T12:35:03.152280+0000","last_fullsized":"2024-04-26T12:35:03.152280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120717,"ondisk_log_size":120717,"up":128,"acting":123,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738426,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142900,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228940,"statfs":{"total":96636764160,"available":95466434560,"internally_reserved":0,"allocated":1081344,"data_stored":1231353,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.46899999999999997}]}]},{"osd":0,"up_from":85,"seq":365072220162,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52588,"kb_used_data":732,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319252,"statfs":{"total":96636764160,"available":96582914048,"internally_reserved":0,"allocated":749568,"data_stored":362669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738427,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511084,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860756,"statfs":{"total":96636764160,"available":95089414144,"internally_reserved":0,"allocated":1073152,"data_stored":1232244,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.152},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.19}]},{"osd":2,"last update":"Fri Apr 26 12:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.436},"min":{"1min":0.33900000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.372,"5min":0.188,"15min":0.188},"max":{"1min":0.70199999999999996,"5min":1.137,"15min":1.137},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:10.644 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:11.024 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:11.025 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:11.037 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-04-26T12:35:09.044536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121021,"ondisk_log_size":121021,"up":210,"acting":205,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706572,"kb_used_data":2836,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408948,"statfs":{"total":289910292480,"available":287138762752,"internally_reserved":0,"allocated":2904064,"data_stored":2826266,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.889372"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2063,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.893468+0000","last_change":"2024-04-26T12:35:05.893468+0000","last_active":"2024-04-26T12:35:03.151885+0000","last_peered":"2024-04-26T12:35:01.140467+0000","last_clean":"2024-04-26T12:32:35.991566+0000","last_became_active":"2024-04-26T12:32:37.140332+0000","last_became_peered":"2024-04-26T12:32:37.140332+0000","last_unstale":"2024-04-26T12:35:05.893468+0000","last_undegraded":"2024-04-26T12:35:05.893468+0000","last_fullsized":"2024-04-26T12:35:05.893468+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:23.680548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188195+0000","last_change":"2024-04-26T12:35:03.176728+0000","last_active":"2024-04-26T12:35:05.188195+0000","last_peered":"2024-04-26T12:35:05.188195+0000","last_clean":"2024-04-26T12:35:05.188195+0000","last_became_active":"2024-04-26T12:35:03.165372+0000","last_became_peered":"2024-04-26T12:35:03.165372+0000","last_unstale":"2024-04-26T12:35:05.188195+0000","last_undegraded":"2024-04-26T12:35:05.188195+0000","last_fullsized":"2024-04-26T12:35:05.188195+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:18.088107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4120,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156296+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:03.156296+0000","last_peered":"2024-04-26T12:35:03.156296+0000","last_clean":"2024-04-26T12:35:03.156296+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:03.156296+0000","last_undegraded":"2024-04-26T12:35:03.156296+0000","last_fullsized":"2024-04-26T12:35:03.156296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":105,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.190199+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:03.190199+0000","last_peered":"2024-04-26T12:35:03.190199+0000","last_clean":"2024-04-26T12:35:03.190199+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:03.190199+0000","last_undegraded":"2024-04-26T12:35:03.190199+0000","last_fullsized":"2024-04-26T12:35:03.190199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898378+0000","last_change":"2024-04-26T12:35:05.898378+0000","last_active":"2024-04-26T12:35:05.898378+0000","last_peered":"2024-04-26T12:35:05.898378+0000","last_clean":"2024-04-26T12:35:05.898378+0000","last_became_active":"2024-04-26T12:35:05.897932+0000","last_became_peered":"2024-04-26T12:35:05.897932+0000","last_unstale":"2024-04-26T12:35:05.898378+0000","last_undegraded":"2024-04-26T12:35:05.898378+0000","last_fullsized":"2024-04-26T12:35:05.898378+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:20.346496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186732+0000","last_change":"2024-04-26T12:35:03.180071+0000","last_active":"2024-04-26T12:35:05.186732+0000","last_peered":"2024-04-26T12:35:05.186732+0000","last_clean":"2024-04-26T12:35:05.186732+0000","last_became_active":"2024-04-26T12:35:03.175460+0000","last_became_peered":"2024-04-26T12:35:03.175460+0000","last_unstale":"2024-04-26T12:35:05.186732+0000","last_undegraded":"2024-04-26T12:35:05.186732+0000","last_fullsized":"2024-04-26T12:35:05.186732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:21.916488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186232+0000","last_change":"2024-04-26T12:35:03.188701+0000","last_active":"2024-04-26T12:35:05.186232+0000","last_peered":"2024-04-26T12:35:05.186232+0000","last_clean":"2024-04-26T12:35:05.186232+0000","last_became_active":"2024-04-26T12:35:03.183610+0000","last_became_peered":"2024-04-26T12:35:03.183610+0000","last_unstale":"2024-04-26T12:35:05.186232+0000","last_undegraded":"2024-04-26T12:35:05.186232+0000","last_fullsized":"2024-04-26T12:35:05.186232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:10.730025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8169,"reported_epoch":87,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2024-04-26T12:35:04.923824+0000","last_change":"2024-04-26T12:35:04.923993+0000","last_active":"2024-04-26T12:35:04.923824+0000","last_peered":"2024-04-26T12:35:04.923824+0000","last_clean":"2024-04-26T12:32:36.110957+0000","last_became_active":"2024-04-26T12:35:04.922253+0000","last_became_peered":"2024-04-26T12:35:04.922253+0000","last_unstale":"2024-04-26T12:35:04.923824+0000","last_undegraded":"2024-04-26T12:35:04.923824+0000","last_fullsized":"2024-04-26T12:35:04.157067+0000","mapping_epoch":86,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:39.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6163,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.891874+0000","last_change":"2024-04-26T12:35:05.891874+0000","last_active":"2024-04-26T12:35:03.152078+0000","last_peered":"2024-04-26T12:35:01.140500+0000","last_clean":"2024-04-26T12:32:36.097694+0000","last_became_active":"2024-04-26T12:32:37.139385+0000","last_became_peered":"2024-04-26T12:32:37.139385+0000","last_unstale":"2024-04-26T12:35:05.891874+0000","last_undegraded":"2024-04-26T12:35:05.891874+0000","last_fullsized":"2024-04-26T12:35:05.891874+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:56.575745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6210,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.895234+0000","last_change":"2024-04-26T12:35:05.895234+0000","last_active":"2024-04-26T12:35:03.150974+0000","last_peered":"2024-04-26T12:35:01.140536+0000","last_clean":"2024-04-26T12:32:36.054632+0000","last_became_active":"2024-04-26T12:32:37.140156+0000","last_became_peered":"2024-04-26T12:32:37.140156+0000","last_unstale":"2024-04-26T12:35:05.895234+0000","last_undegraded":"2024-04-26T12:35:05.895234+0000","last_fullsized":"2024-04-26T12:35:05.895234+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6120,"log_dups_size":0,"ondisk_log_size":6120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:10.422122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4067,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.900074+0000","last_change":"2024-04-26T12:35:05.900074+0000","last_active":"2024-04-26T12:35:05.900074+0000","last_peered":"2024-04-26T12:35:05.900074+0000","last_clean":"2024-04-26T12:35:05.900074+0000","last_became_active":"2024-04-26T12:35:05.899482+0000","last_became_peered":"2024-04-26T12:35:05.899482+0000","last_unstale":"2024-04-26T12:35:05.900074+0000","last_undegraded":"2024-04-26T12:35:05.900074+0000","last_fullsized":"2024-04-26T12:35:05.900074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:52.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2097,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154707+0000","last_change":"2024-04-26T12:32:16.107668+0000","last_active":"2024-04-26T12:35:03.154707+0000","last_peered":"2024-04-26T12:35:03.154707+0000","last_clean":"2024-04-26T12:35:03.154707+0000","last_became_active":"2024-04-26T12:32:16.107458+0000","last_became_peered":"2024-04-26T12:32:16.107458+0000","last_unstale":"2024-04-26T12:35:03.154707+0000","last_undegraded":"2024-04-26T12:35:03.154707+0000","last_fullsized":"2024-04-26T12:35:03.154707+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.458028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2126,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.896349+0000","last_change":"2024-04-26T12:35:05.896349+0000","last_active":"2024-04-26T12:35:05.896349+0000","last_peered":"2024-04-26T12:35:05.896349+0000","last_clean":"2024-04-26T12:35:05.896349+0000","last_became_active":"2024-04-26T12:35:05.895047+0000","last_became_peered":"2024-04-26T12:35:05.895047+0000","last_unstale":"2024-04-26T12:35:05.896349+0000","last_undegraded":"2024-04-26T12:35:05.896349+0000","last_fullsized":"2024-04-26T12:35:05.896349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:43.511788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2135,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.157272+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:03.157272+0000","last_peered":"2024-04-26T12:35:03.157272+0000","last_clean":"2024-04-26T12:35:03.157272+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:03.157272+0000","last_undegraded":"2024-04-26T12:35:03.157272+0000","last_fullsized":"2024-04-26T12:35:03.157272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2154,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160274+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:03.160274+0000","last_peered":"2024-04-26T12:35:03.160274+0000","last_clean":"2024-04-26T12:35:03.160274+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:03.160274+0000","last_undegraded":"2024-04-26T12:35:03.160274+0000","last_fullsized":"2024-04-26T12:35:03.160274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2100,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897209+0000","last_change":"2024-04-26T12:35:05.897209+0000","last_active":"2024-04-26T12:35:05.897209+0000","last_peered":"2024-04-26T12:35:05.897209+0000","last_clean":"2024-04-26T12:35:05.897209+0000","last_became_active":"2024-04-26T12:35:05.896312+0000","last_became_peered":"2024-04-26T12:35:05.896312+0000","last_unstale":"2024-04-26T12:35:05.897209+0000","last_undegraded":"2024-04-26T12:35:05.897209+0000","last_fullsized":"2024-04-26T12:35:05.897209+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:34.224468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2102,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.894963+0000","last_change":"2024-04-26T12:35:05.894963+0000","last_active":"2024-04-26T12:35:03.154215+0000","last_peered":"2024-04-26T12:35:01.140981+0000","last_clean":"2024-04-26T12:32:35.945501+0000","last_became_active":"2024-04-26T12:32:37.156603+0000","last_became_peered":"2024-04-26T12:32:37.156603+0000","last_unstale":"2024-04-26T12:35:05.894963+0000","last_undegraded":"2024-04-26T12:35:05.894963+0000","last_fullsized":"2024-04-26T12:35:05.894963+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:32.001613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2119,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.892007+0000","last_change":"2024-04-26T12:35:05.892007+0000","last_active":"2024-04-26T12:35:03.152777+0000","last_peered":"2024-04-26T12:35:01.140831+0000","last_clean":"2024-04-26T12:32:36.044461+0000","last_became_active":"2024-04-26T12:32:37.143785+0000","last_became_peered":"2024-04-26T12:32:37.143785+0000","last_unstale":"2024-04-26T12:35:05.892007+0000","last_undegraded":"2024-04-26T12:35:05.892007+0000","last_fullsized":"2024-04-26T12:35:05.892007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:09.951622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4082,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.893680+0000","last_change":"2024-04-26T12:35:05.893680+0000","last_active":"2024-04-26T12:35:03.151902+0000","last_peered":"2024-04-26T12:35:01.140123+0000","last_clean":"2024-04-26T12:32:36.045736+0000","last_became_active":"2024-04-26T12:32:37.139277+0000","last_became_peered":"2024-04-26T12:32:37.139277+0000","last_unstale":"2024-04-26T12:35:05.893680+0000","last_undegraded":"2024-04-26T12:35:05.893680+0000","last_fullsized":"2024-04-26T12:35:05.893680+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:49.499643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4198,"reported_epoch":87,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:35:05.091495+0000","last_change":"2024-04-26T12:35:05.098528+0000","last_active":"2024-04-26T12:35:05.091495+0000","last_peered":"2024-04-26T12:35:05.091495+0000","last_clean":"2024-04-26T12:32:36.109719+0000","last_became_active":"2024-04-26T12:35:04.916325+0000","last_became_peered":"2024-04-26T12:35:04.916325+0000","last_unstale":"2024-04-26T12:35:05.091495+0000","last_undegraded":"2024-04-26T12:35:04.203928+0000","last_fullsized":"2024-04-26T12:35:04.158911+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:28.705010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":108,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157590+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:04.157590+0000","last_peered":"2024-04-26T12:35:04.157590+0000","last_clean":"2024-04-26T12:35:04.157590+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:04.157590+0000","last_undegraded":"2024-04-26T12:35:04.157590+0000","last_fullsized":"2024-04-26T12:35:04.157590+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2105,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.154914+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:04.154914+0000","last_peered":"2024-04-26T12:35:04.154914+0000","last_clean":"2024-04-26T12:35:04.154914+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:04.154914+0000","last_undegraded":"2024-04-26T12:35:04.154914+0000","last_fullsized":"2024-04-26T12:35:04.154914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2090,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897472+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:05.897472+0000","last_peered":"2024-04-26T12:35:05.897472+0000","last_clean":"2024-04-26T12:35:05.897472+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:05.897472+0000","last_undegraded":"2024-04-26T12:35:05.897472+0000","last_fullsized":"2024-04-26T12:35:05.897472+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4117,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.890872+0000","last_change":"2024-04-26T12:35:05.890872+0000","last_active":"2024-04-26T12:35:03.150075+0000","last_peered":"2024-04-26T12:35:01.139535+0000","last_clean":"2024-04-26T12:32:36.098162+0000","last_became_active":"2024-04-26T12:32:37.139435+0000","last_became_peered":"2024-04-26T12:32:37.139435+0000","last_unstale":"2024-04-26T12:35:05.890872+0000","last_undegraded":"2024-04-26T12:35:05.890872+0000","last_fullsized":"2024-04-26T12:35:05.890872+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:06.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2140,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155032+0000","last_change":"2024-04-26T12:32:16.109558+0000","last_active":"2024-04-26T12:35:03.155032+0000","last_peered":"2024-04-26T12:35:03.155032+0000","last_clean":"2024-04-26T12:35:03.155032+0000","last_became_active":"2024-04-26T12:32:16.109196+0000","last_became_peered":"2024-04-26T12:32:16.109196+0000","last_unstale":"2024-04-26T12:35:03.155032+0000","last_undegraded":"2024-04-26T12:35:03.155032+0000","last_fullsized":"2024-04-26T12:35:03.155032+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:25.423545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188611+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:05.188611+0000","last_peered":"2024-04-26T12:35:05.188611+0000","last_clean":"2024-04-26T12:35:05.188611+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:05.188611+0000","last_undegraded":"2024-04-26T12:35:05.188611+0000","last_fullsized":"2024-04-26T12:35:05.188611+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2090,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155387+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:03.155387+0000","last_peered":"2024-04-26T12:35:03.155387+0000","last_clean":"2024-04-26T12:35:03.155387+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:03.155387+0000","last_undegraded":"2024-04-26T12:35:03.155387+0000","last_fullsized":"2024-04-26T12:35:03.155387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188099+0000","last_change":"2024-04-26T12:35:03.178830+0000","last_active":"2024-04-26T12:35:05.188099+0000","last_peered":"2024-04-26T12:35:05.188099+0000","last_clean":"2024-04-26T12:35:05.188099+0000","last_became_active":"2024-04-26T12:35:03.166452+0000","last_became_peered":"2024-04-26T12:35:03.166452+0000","last_unstale":"2024-04-26T12:35:05.188099+0000","last_undegraded":"2024-04-26T12:35:05.188099+0000","last_fullsized":"2024-04-26T12:35:05.188099+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:03.037906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155103+0000","last_change":"2024-04-26T12:32:16.110135+0000","last_active":"2024-04-26T12:35:03.155103+0000","last_peered":"2024-04-26T12:35:03.155103+0000","last_clean":"2024-04-26T12:35:03.155103+0000","last_became_active":"2024-04-26T12:32:16.109837+0000","last_became_peered":"2024-04-26T12:32:16.109837+0000","last_unstale":"2024-04-26T12:35:03.155103+0000","last_undegraded":"2024-04-26T12:35:03.155103+0000","last_fullsized":"2024-04-26T12:35:03.155103+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:19.898367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186022+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:05.186022+0000","last_peered":"2024-04-26T12:35:05.186022+0000","last_clean":"2024-04-26T12:35:05.186022+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:05.186022+0000","last_undegraded":"2024-04-26T12:35:05.186022+0000","last_fullsized":"2024-04-26T12:35:05.186022+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188243+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:05.188243+0000","last_peered":"2024-04-26T12:35:05.188243+0000","last_clean":"2024-04-26T12:35:05.188243+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:05.188243+0000","last_undegraded":"2024-04-26T12:35:05.188243+0000","last_fullsized":"2024-04-26T12:35:05.188243+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.185766+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:05.185766+0000","last_peered":"2024-04-26T12:35:05.185766+0000","last_clean":"2024-04-26T12:35:05.185766+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:05.185766+0000","last_undegraded":"2024-04-26T12:35:05.185766+0000","last_fullsized":"2024-04-26T12:35:05.185766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156554+0000","last_change":"2024-04-26T12:32:16.109433+0000","last_active":"2024-04-26T12:35:03.156554+0000","last_peered":"2024-04-26T12:35:03.156554+0000","last_clean":"2024-04-26T12:35:03.156554+0000","last_became_active":"2024-04-26T12:32:16.109171+0000","last_became_peered":"2024-04-26T12:32:16.109171+0000","last_unstale":"2024-04-26T12:35:03.156554+0000","last_undegraded":"2024-04-26T12:35:03.156554+0000","last_fullsized":"2024-04-26T12:35:03.156554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188356+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:05.188356+0000","last_peered":"2024-04-26T12:35:05.188356+0000","last_clean":"2024-04-26T12:35:05.188356+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:05.188356+0000","last_undegraded":"2024-04-26T12:35:05.188356+0000","last_fullsized":"2024-04-26T12:35:05.188356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186233+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:05.186233+0000","last_peered":"2024-04-26T12:35:05.186233+0000","last_clean":"2024-04-26T12:35:05.186233+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:05.186233+0000","last_undegraded":"2024-04-26T12:35:05.186233+0000","last_fullsized":"2024-04-26T12:35:05.186233+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187289+0000","last_change":"2024-04-26T12:35:03.190889+0000","last_active":"2024-04-26T12:35:05.187289+0000","last_peered":"2024-04-26T12:35:05.187289+0000","last_clean":"2024-04-26T12:35:05.187289+0000","last_became_active":"2024-04-26T12:35:03.189699+0000","last_became_peered":"2024-04-26T12:35:03.189699+0000","last_unstale":"2024-04-26T12:35:05.187289+0000","last_undegraded":"2024-04-26T12:35:05.187289+0000","last_fullsized":"2024-04-26T12:35:05.187289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:58.599512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6166,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-26T12:35:05.405934+0000","last_change":"2024-04-26T12:35:05.891229+0000","last_active":"2024-04-26T12:35:05.891229+0000","last_peered":"2024-04-26T12:35:05.405934+0000","last_clean":"2024-04-26T12:32:36.090113+0000","last_became_active":"2024-04-26T12:35:04.864319+0000","last_became_peered":"2024-04-26T12:35:04.864319+0000","last_unstale":"2024-04-26T12:35:05.405934+0000","last_undegraded":"2024-04-26T12:35:05.405934+0000","last_fullsized":"2024-04-26T12:35:04.157028+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:09.983277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":57,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155132+0000","last_change":"2024-04-26T12:32:16.109604+0000","last_active":"2024-04-26T12:35:03.155132+0000","last_peered":"2024-04-26T12:35:03.155132+0000","last_clean":"2024-04-26T12:35:03.155132+0000","last_became_active":"2024-04-26T12:32:16.109232+0000","last_became_peered":"2024-04-26T12:32:16.109232+0000","last_unstale":"2024-04-26T12:35:03.155132+0000","last_undegraded":"2024-04-26T12:35:03.155132+0000","last_fullsized":"2024-04-26T12:35:03.155132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:08.819922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898374+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:05.898374+0000","last_peered":"2024-04-26T12:35:05.898374+0000","last_clean":"2024-04-26T12:35:05.898374+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:05.898374+0000","last_undegraded":"2024-04-26T12:35:05.898374+0000","last_fullsized":"2024-04-26T12:35:05.898374+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":180,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156465+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:03.156465+0000","last_peered":"2024-04-26T12:35:03.156465+0000","last_clean":"2024-04-26T12:35:03.156465+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:03.156465+0000","last_undegraded":"2024-04-26T12:35:03.156465+0000","last_fullsized":"2024-04-26T12:35:03.156465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4177,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158648+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:03.158648+0000","last_peered":"2024-04-26T12:35:03.158648+0000","last_clean":"2024-04-26T12:35:03.158648+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:03.158648+0000","last_undegraded":"2024-04-26T12:35:03.158648+0000","last_fullsized":"2024-04-26T12:35:03.158648+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185706+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:03.185706+0000","last_peered":"2024-04-26T12:35:03.185706+0000","last_clean":"2024-04-26T12:35:03.185706+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:03.185706+0000","last_undegraded":"2024-04-26T12:35:03.185706+0000","last_fullsized":"2024-04-26T12:35:03.185706+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2060,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.891467+0000","last_change":"2024-04-26T12:35:05.891467+0000","last_active":"2024-04-26T12:35:03.151921+0000","last_peered":"2024-04-26T12:35:01.139783+0000","last_clean":"2024-04-26T12:32:35.952933+0000","last_became_active":"2024-04-26T12:32:37.141807+0000","last_became_peered":"2024-04-26T12:32:37.141807+0000","last_unstale":"2024-04-26T12:35:05.891467+0000","last_undegraded":"2024-04-26T12:35:05.891467+0000","last_fullsized":"2024-04-26T12:35:05.891467+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:36.967055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186045+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:05.186045+0000","last_peered":"2024-04-26T12:35:05.186045+0000","last_clean":"2024-04-26T12:35:05.186045+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:05.186045+0000","last_undegraded":"2024-04-26T12:35:05.186045+0000","last_fullsized":"2024-04-26T12:35:05.186045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2066,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897734+0000","last_change":"2024-04-26T12:35:05.897734+0000","last_active":"2024-04-26T12:35:05.897734+0000","last_peered":"2024-04-26T12:35:05.897734+0000","last_clean":"2024-04-26T12:35:05.897734+0000","last_became_active":"2024-04-26T12:35:05.897297+0000","last_became_peered":"2024-04-26T12:35:05.897297+0000","last_unstale":"2024-04-26T12:35:05.897734+0000","last_undegraded":"2024-04-26T12:35:05.897734+0000","last_fullsized":"2024-04-26T12:35:05.897734+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:22.684365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160145+0000","last_change":"2024-04-26T12:32:16.107025+0000","last_active":"2024-04-26T12:35:03.160145+0000","last_peered":"2024-04-26T12:35:03.160145+0000","last_clean":"2024-04-26T12:35:03.160145+0000","last_became_active":"2024-04-26T12:32:16.106307+0000","last_became_peered":"2024-04-26T12:32:16.106307+0000","last_unstale":"2024-04-26T12:35:03.160145+0000","last_undegraded":"2024-04-26T12:35:03.160145+0000","last_fullsized":"2024-04-26T12:35:03.160145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:31.214495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188548+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:05.188548+0000","last_peered":"2024-04-26T12:35:05.188548+0000","last_clean":"2024-04-26T12:35:05.188548+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:05.188548+0000","last_undegraded":"2024-04-26T12:35:05.188548+0000","last_fullsized":"2024-04-26T12:35:05.188548+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":93,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.156725+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:03.156725+0000","last_peered":"2024-04-26T12:35:03.156725+0000","last_clean":"2024-04-26T12:35:03.156725+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:03.156725+0000","last_undegraded":"2024-04-26T12:35:03.156725+0000","last_fullsized":"2024-04-26T12:35:03.156725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2153,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.896130+0000","last_change":"2024-04-26T12:35:05.896130+0000","last_active":"2024-04-26T12:35:03.157039+0000","last_peered":"2024-04-26T12:35:01.143823+0000","last_clean":"2024-04-26T12:32:35.940778+0000","last_became_active":"2024-04-26T12:32:37.144911+0000","last_became_peered":"2024-04-26T12:32:37.144911+0000","last_unstale":"2024-04-26T12:35:05.896130+0000","last_undegraded":"2024-04-26T12:35:05.896130+0000","last_fullsized":"2024-04-26T12:35:05.896130+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:24.704812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":86,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.158266+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:04.158266+0000","last_peered":"2024-04-26T12:35:04.158266+0000","last_clean":"2024-04-26T12:35:04.158266+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:04.158266+0000","last_undegraded":"2024-04-26T12:35:04.158266+0000","last_fullsized":"2024-04-26T12:35:04.158266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.153716+0000","last_change":"2024-04-26T12:32:16.109694+0000","last_active":"2024-04-26T12:35:03.153716+0000","last_peered":"2024-04-26T12:35:03.153716+0000","last_clean":"2024-04-26T12:35:03.153716+0000","last_became_active":"2024-04-26T12:32:16.109070+0000","last_became_peered":"2024-04-26T12:32:16.109070+0000","last_unstale":"2024-04-26T12:35:03.153716+0000","last_undegraded":"2024-04-26T12:35:03.153716+0000","last_fullsized":"2024-04-26T12:35:03.153716+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:54.733914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":85,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157540+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:04.157540+0000","last_peered":"2024-04-26T12:35:04.157540+0000","last_clean":"2024-04-26T12:35:04.157540+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:04.157540+0000","last_undegraded":"2024-04-26T12:35:04.157540+0000","last_fullsized":"2024-04-26T12:35:04.157540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.185775+0000","last_change":"2024-04-26T12:35:03.186376+0000","last_active":"2024-04-26T12:35:05.185775+0000","last_peered":"2024-04-26T12:35:05.185775+0000","last_clean":"2024-04-26T12:35:05.185775+0000","last_became_active":"2024-04-26T12:35:03.168583+0000","last_became_peered":"2024-04-26T12:35:03.168583+0000","last_unstale":"2024-04-26T12:35:05.185775+0000","last_undegraded":"2024-04-26T12:35:05.185775+0000","last_fullsized":"2024-04-26T12:35:05.185775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:20.154397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":81,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.150234+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:35:03.150234+0000","last_peered":"2024-04-26T12:35:03.150234+0000","last_clean":"2024-04-26T12:35:03.150234+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:35:03.150234+0000","last_undegraded":"2024-04-26T12:35:03.150234+0000","last_fullsized":"2024-04-26T12:35:03.150234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2092,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.889386+0000","last_change":"2024-04-26T12:35:04.889560+0000","last_active":"2024-04-26T12:35:04.889386+0000","last_peered":"2024-04-26T12:35:04.889386+0000","last_clean":"2024-04-26T12:32:36.095836+0000","last_became_active":"2024-04-26T12:35:04.852698+0000","last_became_peered":"2024-04-26T12:35:04.852698+0000","last_unstale":"2024-04-26T12:35:04.889386+0000","last_undegraded":"2024-04-26T12:35:04.889386+0000","last_fullsized":"2024-04-26T12:35:04.158275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:04.200236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.157564+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:04.157564+0000","last_peered":"2024-04-26T12:35:04.157564+0000","last_clean":"2024-04-26T12:35:04.157564+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:04.157564+0000","last_undegraded":"2024-04-26T12:35:04.157564+0000","last_fullsized":"2024-04-26T12:35:04.157564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.189069+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:05.189069+0000","last_peered":"2024-04-26T12:35:05.189069+0000","last_clean":"2024-04-26T12:35:05.189069+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:05.189069+0000","last_undegraded":"2024-04-26T12:35:05.189069+0000","last_fullsized":"2024-04-26T12:35:05.189069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187136+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:05.187136+0000","last_peered":"2024-04-26T12:35:05.187136+0000","last_clean":"2024-04-26T12:35:05.187136+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:05.187136+0000","last_undegraded":"2024-04-26T12:35:05.187136+0000","last_fullsized":"2024-04-26T12:35:05.187136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2080,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:05.074617+0000","last_change":"2024-04-26T12:35:05.074617+0000","last_active":"2024-04-26T12:35:05.074617+0000","last_peered":"2024-04-26T12:35:05.074617+0000","last_clean":"2024-04-26T12:32:36.109396+0000","last_became_active":"2024-04-26T12:35:04.916362+0000","last_became_peered":"2024-04-26T12:35:04.916362+0000","last_unstale":"2024-04-26T12:35:05.074617+0000","last_undegraded":"2024-04-26T12:35:05.074617+0000","last_fullsized":"2024-04-26T12:35:04.157688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:30.735718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.181023+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:03.181023+0000","last_peered":"2024-04-26T12:35:03.181023+0000","last_clean":"2024-04-26T12:35:03.181023+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:03.181023+0000","last_undegraded":"2024-04-26T12:35:03.181023+0000","last_fullsized":"2024-04-26T12:35:03.181023+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2123,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.161640+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:04.161640+0000","last_peered":"2024-04-26T12:35:04.161640+0000","last_clean":"2024-04-26T12:35:04.161640+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:04.161640+0000","last_undegraded":"2024-04-26T12:35:04.161640+0000","last_fullsized":"2024-04-26T12:35:04.161640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.160320+0000","last_change":"2024-04-26T12:32:16.109449+0000","last_active":"2024-04-26T12:35:03.160320+0000","last_peered":"2024-04-26T12:35:03.160320+0000","last_clean":"2024-04-26T12:35:03.160320+0000","last_became_active":"2024-04-26T12:32:16.109131+0000","last_became_peered":"2024-04-26T12:32:16.109131+0000","last_unstale":"2024-04-26T12:35:03.160320+0000","last_undegraded":"2024-04-26T12:35:03.160320+0000","last_fullsized":"2024-04-26T12:35:03.160320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:47.757728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T12:35:04.158233+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:04.158233+0000","last_peered":"2024-04-26T12:35:04.158233+0000","last_clean":"2024-04-26T12:35:04.158233+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:04.158233+0000","last_undegraded":"2024-04-26T12:35:04.158233+0000","last_fullsized":"2024-04-26T12:35:04.158233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186034+0000","last_change":"2024-04-26T12:35:03.171996+0000","last_active":"2024-04-26T12:35:05.186034+0000","last_peered":"2024-04-26T12:35:05.186034+0000","last_clean":"2024-04-26T12:35:05.186034+0000","last_became_active":"2024-04-26T12:35:03.163038+0000","last_became_peered":"2024-04-26T12:35:03.163038+0000","last_unstale":"2024-04-26T12:35:05.186034+0000","last_undegraded":"2024-04-26T12:35:05.186034+0000","last_fullsized":"2024-04-26T12:35:05.186034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:29.580246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6168,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.894905+0000","last_change":"2024-04-26T12:35:05.894905+0000","last_active":"2024-04-26T12:35:03.153778+0000","last_peered":"2024-04-26T12:35:01.140789+0000","last_clean":"2024-04-26T12:32:36.042703+0000","last_became_active":"2024-04-26T12:32:37.155816+0000","last_became_peered":"2024-04-26T12:32:37.155816+0000","last_unstale":"2024-04-26T12:35:05.894905+0000","last_undegraded":"2024-04-26T12:35:05.894905+0000","last_fullsized":"2024-04-26T12:35:05.894905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:58.465619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188216+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:05.188216+0000","last_peered":"2024-04-26T12:35:05.188216+0000","last_clean":"2024-04-26T12:35:05.188216+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:05.188216+0000","last_undegraded":"2024-04-26T12:35:05.188216+0000","last_fullsized":"2024-04-26T12:35:05.188216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185408+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:03.185408+0000","last_peered":"2024-04-26T12:35:03.185408+0000","last_clean":"2024-04-26T12:35:03.185408+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:03.185408+0000","last_undegraded":"2024-04-26T12:35:03.185408+0000","last_fullsized":"2024-04-26T12:35:03.185408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155589+0000","last_change":"2024-04-26T12:32:16.107013+0000","last_active":"2024-04-26T12:35:03.155589+0000","last_peered":"2024-04-26T12:35:03.155589+0000","last_clean":"2024-04-26T12:35:03.155589+0000","last_became_active":"2024-04-26T12:32:16.106306+0000","last_became_peered":"2024-04-26T12:32:16.106306+0000","last_unstale":"2024-04-26T12:35:03.155589+0000","last_undegraded":"2024-04-26T12:35:03.155589+0000","last_fullsized":"2024-04-26T12:35:03.155589+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:34.079328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183091+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:03.183091+0000","last_peered":"2024-04-26T12:35:03.183091+0000","last_clean":"2024-04-26T12:35:03.183091+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:03.183091+0000","last_undegraded":"2024-04-26T12:35:03.183091+0000","last_fullsized":"2024-04-26T12:35:03.183091+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":98,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185719+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:03.185719+0000","last_peered":"2024-04-26T12:35:03.185719+0000","last_clean":"2024-04-26T12:35:03.185719+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:03.185719+0000","last_undegraded":"2024-04-26T12:35:03.185719+0000","last_fullsized":"2024-04-26T12:35:03.185719+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187109+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:05.187109+0000","last_peered":"2024-04-26T12:35:05.187109+0000","last_clean":"2024-04-26T12:35:05.187109+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:05.187109+0000","last_undegraded":"2024-04-26T12:35:05.187109+0000","last_fullsized":"2024-04-26T12:35:05.187109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186587+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:05.186587+0000","last_peered":"2024-04-26T12:35:05.186587+0000","last_clean":"2024-04-26T12:35:05.186587+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:05.186587+0000","last_undegraded":"2024-04-26T12:35:05.186587+0000","last_fullsized":"2024-04-26T12:35:05.186587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.149178+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:03.149178+0000","last_peered":"2024-04-26T12:35:03.149178+0000","last_clean":"2024-04-26T12:35:03.149178+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:03.149178+0000","last_undegraded":"2024-04-26T12:35:03.149178+0000","last_fullsized":"2024-04-26T12:35:03.149178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188456+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:05.188456+0000","last_peered":"2024-04-26T12:35:05.188456+0000","last_clean":"2024-04-26T12:35:05.188456+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:05.188456+0000","last_undegraded":"2024-04-26T12:35:05.188456+0000","last_fullsized":"2024-04-26T12:35:05.188456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.185680+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:03.185680+0000","last_peered":"2024-04-26T12:35:03.185680+0000","last_clean":"2024-04-26T12:35:03.185680+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:03.185680+0000","last_undegraded":"2024-04-26T12:35:03.185680+0000","last_fullsized":"2024-04-26T12:35:03.185680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":284,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155032+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:03.155032+0000","last_peered":"2024-04-26T12:35:03.155032+0000","last_clean":"2024-04-26T12:35:03.155032+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:03.155032+0000","last_undegraded":"2024-04-26T12:35:03.155032+0000","last_fullsized":"2024-04-26T12:35:03.155032+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186724+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:05.186724+0000","last_peered":"2024-04-26T12:35:05.186724+0000","last_clean":"2024-04-26T12:35:05.186724+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:05.186724+0000","last_undegraded":"2024-04-26T12:35:05.186724+0000","last_fullsized":"2024-04-26T12:35:05.186724+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":67,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158127+0000","last_change":"2024-04-26T12:32:16.106958+0000","last_active":"2024-04-26T12:35:03.158127+0000","last_peered":"2024-04-26T12:35:03.158127+0000","last_clean":"2024-04-26T12:35:03.158127+0000","last_became_active":"2024-04-26T12:32:16.106262+0000","last_became_peered":"2024-04-26T12:32:16.106262+0000","last_unstale":"2024-04-26T12:35:03.158127+0000","last_undegraded":"2024-04-26T12:35:03.158127+0000","last_fullsized":"2024-04-26T12:35:03.158127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:33.467447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155192+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:03.155192+0000","last_peered":"2024-04-26T12:35:03.155192+0000","last_clean":"2024-04-26T12:35:03.155192+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:03.155192+0000","last_undegraded":"2024-04-26T12:35:03.155192+0000","last_fullsized":"2024-04-26T12:35:03.155192+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186747+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:05.186747+0000","last_peered":"2024-04-26T12:35:05.186747+0000","last_clean":"2024-04-26T12:35:05.186747+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:05.186747+0000","last_undegraded":"2024-04-26T12:35:05.186747+0000","last_fullsized":"2024-04-26T12:35:05.186747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8076,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-26T12:35:05.451340+0000","last_change":"2024-04-26T12:35:05.891484+0000","last_active":"2024-04-26T12:35:05.891484+0000","last_peered":"2024-04-26T12:35:05.451340+0000","last_clean":"2024-04-26T12:32:36.002439+0000","last_became_active":"2024-04-26T12:35:04.912946+0000","last_became_peered":"2024-04-26T12:35:04.912946+0000","last_unstale":"2024-04-26T12:35:05.451340+0000","last_undegraded":"2024-04-26T12:35:05.451340+0000","last_fullsized":"2024-04-26T12:35:04.157946+0000","mapping_epoch":89,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:59.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186967+0000","last_change":"2024-04-26T12:35:03.179164+0000","last_active":"2024-04-26T12:35:05.186967+0000","last_peered":"2024-04-26T12:35:05.186967+0000","last_clean":"2024-04-26T12:35:05.186967+0000","last_became_active":"2024-04-26T12:35:03.176940+0000","last_became_peered":"2024-04-26T12:35:03.176940+0000","last_unstale":"2024-04-26T12:35:05.186967+0000","last_undegraded":"2024-04-26T12:35:05.186967+0000","last_fullsized":"2024-04-26T12:35:05.186967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:29.707002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.189056+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:05.189056+0000","last_peered":"2024-04-26T12:35:05.189056+0000","last_clean":"2024-04-26T12:35:05.189056+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:05.189056+0000","last_undegraded":"2024-04-26T12:35:05.189056+0000","last_fullsized":"2024-04-26T12:35:05.189056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2099,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155135+0000","last_change":"2024-04-26T12:32:16.109669+0000","last_active":"2024-04-26T12:35:03.155135+0000","last_peered":"2024-04-26T12:35:03.155135+0000","last_clean":"2024-04-26T12:35:03.155135+0000","last_became_active":"2024-04-26T12:32:16.109328+0000","last_became_peered":"2024-04-26T12:32:16.109328+0000","last_unstale":"2024-04-26T12:35:03.155135+0000","last_undegraded":"2024-04-26T12:35:03.155135+0000","last_fullsized":"2024-04-26T12:35:03.155135+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:32.967100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187210+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:05.187210+0000","last_peered":"2024-04-26T12:35:05.187210+0000","last_clean":"2024-04-26T12:35:05.187210+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:05.187210+0000","last_undegraded":"2024-04-26T12:35:05.187210+0000","last_fullsized":"2024-04-26T12:35:05.187210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187396+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:05.187396+0000","last_peered":"2024-04-26T12:35:05.187396+0000","last_clean":"2024-04-26T12:35:05.187396+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:05.187396+0000","last_undegraded":"2024-04-26T12:35:05.187396+0000","last_fullsized":"2024-04-26T12:35:05.187396+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.185945+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:05.185945+0000","last_peered":"2024-04-26T12:35:05.185945+0000","last_clean":"2024-04-26T12:35:05.185945+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:05.185945+0000","last_undegraded":"2024-04-26T12:35:05.185945+0000","last_fullsized":"2024-04-26T12:35:05.185945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155312+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:03.155312+0000","last_peered":"2024-04-26T12:35:03.155312+0000","last_clean":"2024-04-26T12:35:03.155312+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:03.155312+0000","last_undegraded":"2024-04-26T12:35:03.155312+0000","last_fullsized":"2024-04-26T12:35:03.155312+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188428+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:05.188428+0000","last_peered":"2024-04-26T12:35:05.188428+0000","last_clean":"2024-04-26T12:35:05.188428+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:05.188428+0000","last_undegraded":"2024-04-26T12:35:05.188428+0000","last_fullsized":"2024-04-26T12:35:05.188428+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":87,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.149820+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:03.149820+0000","last_peered":"2024-04-26T12:35:03.149820+0000","last_clean":"2024-04-26T12:35:03.149820+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:03.149820+0000","last_undegraded":"2024-04-26T12:35:03.149820+0000","last_fullsized":"2024-04-26T12:35:03.149820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.155320+0000","last_change":"2024-04-26T12:32:16.110117+0000","last_active":"2024-04-26T12:35:03.155320+0000","last_peered":"2024-04-26T12:35:03.155320+0000","last_clean":"2024-04-26T12:35:03.155320+0000","last_became_active":"2024-04-26T12:32:16.109893+0000","last_became_peered":"2024-04-26T12:32:16.109893+0000","last_unstale":"2024-04-26T12:35:03.155320+0000","last_undegraded":"2024-04-26T12:35:03.155320+0000","last_fullsized":"2024-04-26T12:35:03.155320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:18.025832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2099,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.891098+0000","last_change":"2024-04-26T12:35:05.891098+0000","last_active":"2024-04-26T12:35:03.152192+0000","last_peered":"2024-04-26T12:35:01.140160+0000","last_clean":"2024-04-26T12:32:35.963478+0000","last_became_active":"2024-04-26T12:32:37.142589+0000","last_became_peered":"2024-04-26T12:32:37.142589+0000","last_unstale":"2024-04-26T12:35:05.891098+0000","last_undegraded":"2024-04-26T12:35:05.891098+0000","last_fullsized":"2024-04-26T12:35:05.891098+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.164659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.190006+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:03.190006+0000","last_peered":"2024-04-26T12:35:03.190006+0000","last_clean":"2024-04-26T12:35:03.190006+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:03.190006+0000","last_undegraded":"2024-04-26T12:35:03.190006+0000","last_fullsized":"2024-04-26T12:35:03.190006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2138,"reported_epoch":87,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:35:04.948895+0000","last_change":"2024-04-26T12:35:04.949075+0000","last_active":"2024-04-26T12:35:04.948895+0000","last_peered":"2024-04-26T12:35:04.948895+0000","last_clean":"2024-04-26T12:32:36.098926+0000","last_became_active":"2024-04-26T12:35:04.855031+0000","last_became_peered":"2024-04-26T12:35:04.855031+0000","last_unstale":"2024-04-26T12:35:04.948895+0000","last_undegraded":"2024-04-26T12:35:04.948895+0000","last_fullsized":"2024-04-26T12:35:04.157899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154108+0000","last_change":"2024-04-26T12:32:16.110008+0000","last_active":"2024-04-26T12:35:03.154108+0000","last_peered":"2024-04-26T12:35:03.154108+0000","last_clean":"2024-04-26T12:35:03.154108+0000","last_became_active":"2024-04-26T12:32:16.109548+0000","last_became_peered":"2024-04-26T12:32:16.109548+0000","last_unstale":"2024-04-26T12:35:03.154108+0000","last_undegraded":"2024-04-26T12:35:03.154108+0000","last_fullsized":"2024-04-26T12:35:03.154108+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:54.045578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":103,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183117+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:03.183117+0000","last_peered":"2024-04-26T12:35:03.183117+0000","last_clean":"2024-04-26T12:35:03.183117+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:03.183117+0000","last_undegraded":"2024-04-26T12:35:03.183117+0000","last_fullsized":"2024-04-26T12:35:03.183117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":66,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188093+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:05.188093+0000","last_peered":"2024-04-26T12:35:05.188093+0000","last_clean":"2024-04-26T12:35:05.188093+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:05.188093+0000","last_undegraded":"2024-04-26T12:35:05.188093+0000","last_fullsized":"2024-04-26T12:35:05.188093+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4166,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895130+0000","last_change":"2024-04-26T12:35:05.895130+0000","last_active":"2024-04-26T12:35:05.895130+0000","last_peered":"2024-04-26T12:35:05.895130+0000","last_clean":"2024-04-26T12:35:05.895130+0000","last_became_active":"2024-04-26T12:35:05.893689+0000","last_became_peered":"2024-04-26T12:35:05.893689+0000","last_unstale":"2024-04-26T12:35:05.895130+0000","last_undegraded":"2024-04-26T12:35:05.895130+0000","last_fullsized":"2024-04-26T12:35:05.895130+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:15.086674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188548+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:05.188548+0000","last_peered":"2024-04-26T12:35:05.188548+0000","last_clean":"2024-04-26T12:35:05.188548+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:05.188548+0000","last_undegraded":"2024-04-26T12:35:05.188548+0000","last_fullsized":"2024-04-26T12:35:05.188548+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2169,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.158416+0000","last_change":"2024-04-26T12:32:26.265982+0000","last_active":"2024-04-26T12:35:03.158416+0000","last_peered":"2024-04-26T12:35:03.158416+0000","last_clean":"2024-04-26T12:35:03.158416+0000","last_became_active":"2024-04-26T12:32:26.264296+0000","last_became_peered":"2024-04-26T12:32:26.264296+0000","last_unstale":"2024-04-26T12:35:03.158416+0000","last_undegraded":"2024-04-26T12:35:03.158416+0000","last_fullsized":"2024-04-26T12:35:03.158416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:25.897269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.183050+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:03.183050+0000","last_peered":"2024-04-26T12:35:03.183050+0000","last_clean":"2024-04-26T12:35:03.183050+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:03.183050+0000","last_undegraded":"2024-04-26T12:35:03.183050+0000","last_fullsized":"2024-04-26T12:35:03.183050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186653+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:05.186653+0000","last_peered":"2024-04-26T12:35:05.186653+0000","last_clean":"2024-04-26T12:35:05.186653+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:05.186653+0000","last_undegraded":"2024-04-26T12:35:05.186653+0000","last_fullsized":"2024-04-26T12:35:05.186653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2032,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.154382+0000","last_change":"2024-04-26T12:32:16.107224+0000","last_active":"2024-04-26T12:35:03.154382+0000","last_peered":"2024-04-26T12:35:03.154382+0000","last_clean":"2024-04-26T12:35:03.154382+0000","last_became_active":"2024-04-26T12:32:16.106255+0000","last_became_peered":"2024-04-26T12:32:16.106255+0000","last_unstale":"2024-04-26T12:35:03.154382+0000","last_undegraded":"2024-04-26T12:35:03.154382+0000","last_fullsized":"2024-04-26T12:35:03.154382+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:01.140990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898005+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:05.898005+0000","last_peered":"2024-04-26T12:35:05.898005+0000","last_clean":"2024-04-26T12:35:05.898005+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:05.898005+0000","last_undegraded":"2024-04-26T12:35:05.898005+0000","last_fullsized":"2024-04-26T12:35:05.898005+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T12:35:03.152280+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:03.152280+0000","last_peered":"2024-04-26T12:35:03.152280+0000","last_clean":"2024-04-26T12:35:03.152280+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:03.152280+0000","last_undegraded":"2024-04-26T12:35:03.152280+0000","last_fullsized":"2024-04-26T12:35:03.152280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120717,"ondisk_log_size":120717,"up":128,"acting":123,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738426,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142900,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228940,"statfs":{"total":96636764160,"available":95466434560,"internally_reserved":0,"allocated":1081344,"data_stored":1231353,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.46899999999999997}]}]},{"osd":0,"up_from":85,"seq":365072220162,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52588,"kb_used_data":732,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319252,"statfs":{"total":96636764160,"available":96582914048,"internally_reserved":0,"allocated":749568,"data_stored":362669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738427,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511084,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860756,"statfs":{"total":96636764160,"available":95089414144,"internally_reserved":0,"allocated":1073152,"data_stored":1232244,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.152},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.19}]},{"osd":2,"last update":"Fri Apr 26 12:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.436},"min":{"1min":0.33900000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.372,"5min":0.188,"15min":0.188},"max":{"1min":0.70199999999999996,"5min":1.137,"15min":1.137},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:11.043 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T12:35:11.534 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:11.534 INFO:teuthology.orchestra.run.smithi038.stdout:{"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":295,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":90,"num_osds":3,"num_up_osds":3,"osd_up_since":1714134902,"num_in_osds":3,"osd_in_since":1714134617,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"peering","count":13}],"num_pgs":105,"num_pools":4,"num_objects":25,"data_bytes":875808,"bytes_used":2771587072,"bytes_avail":287138705408,"bytes_total":289910292480,"inactive_pgs_ratio":0.12380952388048172,"recovering_objects_per_sec":3,"recovering_bytes_per_sec":100,"recovering_keys_per_sec":0,"num_objects_recovered":20,"num_bytes_recovered":606,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4190}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T12:31:38.983635+0000","services":{}},"progress_events":{}} 2024-04-26T12:35:11.551 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T12:35:11.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:11.919 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:11.921 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:11.933 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-04-26T12:35:11.044856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121021,"ondisk_log_size":121021,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706628,"kb_used_data":2892,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408892,"statfs":{"total":289910292480,"available":287138705408,"internally_reserved":0,"allocated":2961408,"data_stored":2853762,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001193"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2063,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.893468+0000","last_change":"2024-04-26T12:35:05.893468+0000","last_active":"2024-04-26T12:35:03.151885+0000","last_peered":"2024-04-26T12:35:01.140467+0000","last_clean":"2024-04-26T12:32:35.991566+0000","last_became_active":"2024-04-26T12:32:37.140332+0000","last_became_peered":"2024-04-26T12:32:37.140332+0000","last_unstale":"2024-04-26T12:35:05.893468+0000","last_undegraded":"2024-04-26T12:35:05.893468+0000","last_fullsized":"2024-04-26T12:35:05.893468+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:23.680548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188195+0000","last_change":"2024-04-26T12:35:03.176728+0000","last_active":"2024-04-26T12:35:05.188195+0000","last_peered":"2024-04-26T12:35:05.188195+0000","last_clean":"2024-04-26T12:35:05.188195+0000","last_became_active":"2024-04-26T12:35:03.165372+0000","last_became_peered":"2024-04-26T12:35:03.165372+0000","last_unstale":"2024-04-26T12:35:05.188195+0000","last_undegraded":"2024-04-26T12:35:05.188195+0000","last_fullsized":"2024-04-26T12:35:05.188195+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:18.088107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895695+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:05.895695+0000","last_peered":"2024-04-26T12:35:05.895695+0000","last_clean":"2024-04-26T12:35:05.895695+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:05.895695+0000","last_undegraded":"2024-04-26T12:35:05.895695+0000","last_fullsized":"2024-04-26T12:35:05.895695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895473+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:05.895473+0000","last_peered":"2024-04-26T12:35:05.895473+0000","last_clean":"2024-04-26T12:35:05.895473+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:05.895473+0000","last_undegraded":"2024-04-26T12:35:05.895473+0000","last_fullsized":"2024-04-26T12:35:05.895473+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898378+0000","last_change":"2024-04-26T12:35:05.898378+0000","last_active":"2024-04-26T12:35:05.898378+0000","last_peered":"2024-04-26T12:35:05.898378+0000","last_clean":"2024-04-26T12:35:05.898378+0000","last_became_active":"2024-04-26T12:35:05.897932+0000","last_became_peered":"2024-04-26T12:35:05.897932+0000","last_unstale":"2024-04-26T12:35:05.898378+0000","last_undegraded":"2024-04-26T12:35:05.898378+0000","last_fullsized":"2024-04-26T12:35:05.898378+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:20.346496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186732+0000","last_change":"2024-04-26T12:35:03.180071+0000","last_active":"2024-04-26T12:35:05.186732+0000","last_peered":"2024-04-26T12:35:05.186732+0000","last_clean":"2024-04-26T12:35:05.186732+0000","last_became_active":"2024-04-26T12:35:03.175460+0000","last_became_peered":"2024-04-26T12:35:03.175460+0000","last_unstale":"2024-04-26T12:35:05.186732+0000","last_undegraded":"2024-04-26T12:35:05.186732+0000","last_fullsized":"2024-04-26T12:35:05.186732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:21.916488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186232+0000","last_change":"2024-04-26T12:35:03.188701+0000","last_active":"2024-04-26T12:35:05.186232+0000","last_peered":"2024-04-26T12:35:05.186232+0000","last_clean":"2024-04-26T12:35:05.186232+0000","last_became_active":"2024-04-26T12:35:03.183610+0000","last_became_peered":"2024-04-26T12:35:03.183610+0000","last_unstale":"2024-04-26T12:35:05.186232+0000","last_undegraded":"2024-04-26T12:35:05.186232+0000","last_fullsized":"2024-04-26T12:35:05.186232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:10.730025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8196,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.903708+0000","last_change":"2024-04-26T12:35:06.903708+0000","last_active":"2024-04-26T12:35:06.903708+0000","last_peered":"2024-04-26T12:35:06.903708+0000","last_clean":"2024-04-26T12:35:06.903708+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:06.903708+0000","last_undegraded":"2024-04-26T12:35:06.903708+0000","last_fullsized":"2024-04-26T12:35:06.903708+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6163,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.891874+0000","last_change":"2024-04-26T12:35:05.891874+0000","last_active":"2024-04-26T12:35:03.152078+0000","last_peered":"2024-04-26T12:35:01.140500+0000","last_clean":"2024-04-26T12:32:36.097694+0000","last_became_active":"2024-04-26T12:32:37.139385+0000","last_became_peered":"2024-04-26T12:32:37.139385+0000","last_unstale":"2024-04-26T12:35:05.891874+0000","last_undegraded":"2024-04-26T12:35:05.891874+0000","last_fullsized":"2024-04-26T12:35:05.891874+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:56.575745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6210,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.895234+0000","last_change":"2024-04-26T12:35:05.895234+0000","last_active":"2024-04-26T12:35:03.150974+0000","last_peered":"2024-04-26T12:35:01.140536+0000","last_clean":"2024-04-26T12:32:36.054632+0000","last_became_active":"2024-04-26T12:32:37.140156+0000","last_became_peered":"2024-04-26T12:32:37.140156+0000","last_unstale":"2024-04-26T12:35:05.895234+0000","last_undegraded":"2024-04-26T12:35:05.895234+0000","last_fullsized":"2024-04-26T12:35:05.895234+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6120,"log_dups_size":0,"ondisk_log_size":6120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:10.422122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4067,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.900074+0000","last_change":"2024-04-26T12:35:05.900074+0000","last_active":"2024-04-26T12:35:05.900074+0000","last_peered":"2024-04-26T12:35:05.900074+0000","last_clean":"2024-04-26T12:35:05.900074+0000","last_became_active":"2024-04-26T12:35:05.899482+0000","last_became_peered":"2024-04-26T12:35:05.899482+0000","last_unstale":"2024-04-26T12:35:05.900074+0000","last_undegraded":"2024-04-26T12:35:05.900074+0000","last_fullsized":"2024-04-26T12:35:05.900074+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:52.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2100,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895128+0000","last_change":"2024-04-26T12:32:16.107668+0000","last_active":"2024-04-26T12:35:05.895128+0000","last_peered":"2024-04-26T12:35:05.895128+0000","last_clean":"2024-04-26T12:35:05.895128+0000","last_became_active":"2024-04-26T12:32:16.107458+0000","last_became_peered":"2024-04-26T12:32:16.107458+0000","last_unstale":"2024-04-26T12:35:05.895128+0000","last_undegraded":"2024-04-26T12:35:05.895128+0000","last_fullsized":"2024-04-26T12:35:05.895128+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.458028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2126,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.896349+0000","last_change":"2024-04-26T12:35:05.896349+0000","last_active":"2024-04-26T12:35:05.896349+0000","last_peered":"2024-04-26T12:35:05.896349+0000","last_clean":"2024-04-26T12:35:05.896349+0000","last_became_active":"2024-04-26T12:35:05.895047+0000","last_became_peered":"2024-04-26T12:35:05.895047+0000","last_unstale":"2024-04-26T12:35:05.896349+0000","last_undegraded":"2024-04-26T12:35:05.896349+0000","last_fullsized":"2024-04-26T12:35:05.896349+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:43.511788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2138,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895220+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:05.895220+0000","last_peered":"2024-04-26T12:35:05.895220+0000","last_clean":"2024-04-26T12:35:05.895220+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:05.895220+0000","last_undegraded":"2024-04-26T12:35:05.895220+0000","last_fullsized":"2024-04-26T12:35:05.895220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894632+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:05.894632+0000","last_peered":"2024-04-26T12:35:05.894632+0000","last_clean":"2024-04-26T12:35:05.894632+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:05.894632+0000","last_undegraded":"2024-04-26T12:35:05.894632+0000","last_fullsized":"2024-04-26T12:35:05.894632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2100,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897209+0000","last_change":"2024-04-26T12:35:05.897209+0000","last_active":"2024-04-26T12:35:05.897209+0000","last_peered":"2024-04-26T12:35:05.897209+0000","last_clean":"2024-04-26T12:35:05.897209+0000","last_became_active":"2024-04-26T12:35:05.896312+0000","last_became_peered":"2024-04-26T12:35:05.896312+0000","last_unstale":"2024-04-26T12:35:05.897209+0000","last_undegraded":"2024-04-26T12:35:05.897209+0000","last_fullsized":"2024-04-26T12:35:05.897209+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:34.224468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2102,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.894963+0000","last_change":"2024-04-26T12:35:05.894963+0000","last_active":"2024-04-26T12:35:03.154215+0000","last_peered":"2024-04-26T12:35:01.140981+0000","last_clean":"2024-04-26T12:32:35.945501+0000","last_became_active":"2024-04-26T12:32:37.156603+0000","last_became_peered":"2024-04-26T12:32:37.156603+0000","last_unstale":"2024-04-26T12:35:05.894963+0000","last_undegraded":"2024-04-26T12:35:05.894963+0000","last_fullsized":"2024-04-26T12:35:05.894963+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:57:32.001613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2119,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.892007+0000","last_change":"2024-04-26T12:35:05.892007+0000","last_active":"2024-04-26T12:35:03.152777+0000","last_peered":"2024-04-26T12:35:01.140831+0000","last_clean":"2024-04-26T12:32:36.044461+0000","last_became_active":"2024-04-26T12:32:37.143785+0000","last_became_peered":"2024-04-26T12:32:37.143785+0000","last_unstale":"2024-04-26T12:35:05.892007+0000","last_undegraded":"2024-04-26T12:35:05.892007+0000","last_fullsized":"2024-04-26T12:35:05.892007+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:09.951622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4082,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.893680+0000","last_change":"2024-04-26T12:35:05.893680+0000","last_active":"2024-04-26T12:35:03.151902+0000","last_peered":"2024-04-26T12:35:01.140123+0000","last_clean":"2024-04-26T12:32:36.045736+0000","last_became_active":"2024-04-26T12:32:37.139277+0000","last_became_peered":"2024-04-26T12:32:37.139277+0000","last_unstale":"2024-04-26T12:35:05.893680+0000","last_undegraded":"2024-04-26T12:35:05.893680+0000","last_fullsized":"2024-04-26T12:35:05.893680+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:49.499643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4214,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.904425+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:05.904425+0000","last_peered":"2024-04-26T12:35:05.904425+0000","last_clean":"2024-04-26T12:35:05.904425+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:05.904425+0000","last_undegraded":"2024-04-26T12:35:05.904425+0000","last_fullsized":"2024-04-26T12:35:05.904425+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:03.877816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":111,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894788+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:05.894788+0000","last_peered":"2024-04-26T12:35:05.894788+0000","last_clean":"2024-04-26T12:35:05.894788+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:05.894788+0000","last_undegraded":"2024-04-26T12:35:05.894788+0000","last_fullsized":"2024-04-26T12:35:05.894788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.888997+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:05.888997+0000","last_peered":"2024-04-26T12:35:05.888997+0000","last_clean":"2024-04-26T12:35:05.888997+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:05.888997+0000","last_undegraded":"2024-04-26T12:35:05.888997+0000","last_fullsized":"2024-04-26T12:35:05.888997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2090,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897472+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:05.897472+0000","last_peered":"2024-04-26T12:35:05.897472+0000","last_clean":"2024-04-26T12:35:05.897472+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:05.897472+0000","last_undegraded":"2024-04-26T12:35:05.897472+0000","last_fullsized":"2024-04-26T12:35:05.897472+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4117,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.890872+0000","last_change":"2024-04-26T12:35:05.890872+0000","last_active":"2024-04-26T12:35:03.150075+0000","last_peered":"2024-04-26T12:35:01.139535+0000","last_clean":"2024-04-26T12:32:36.098162+0000","last_became_active":"2024-04-26T12:32:37.139435+0000","last_became_peered":"2024-04-26T12:32:37.139435+0000","last_unstale":"2024-04-26T12:35:05.890872+0000","last_undegraded":"2024-04-26T12:35:05.890872+0000","last_fullsized":"2024-04-26T12:35:05.890872+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:06.533277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895675+0000","last_change":"2024-04-26T12:32:16.109558+0000","last_active":"2024-04-26T12:35:05.895675+0000","last_peered":"2024-04-26T12:35:05.895675+0000","last_clean":"2024-04-26T12:35:05.895675+0000","last_became_active":"2024-04-26T12:32:16.109196+0000","last_became_peered":"2024-04-26T12:32:16.109196+0000","last_unstale":"2024-04-26T12:35:05.895675+0000","last_undegraded":"2024-04-26T12:35:05.895675+0000","last_fullsized":"2024-04-26T12:35:05.895675+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:25.423545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188611+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:05.188611+0000","last_peered":"2024-04-26T12:35:05.188611+0000","last_clean":"2024-04-26T12:35:05.188611+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:05.188611+0000","last_undegraded":"2024-04-26T12:35:05.188611+0000","last_fullsized":"2024-04-26T12:35:05.188611+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2093,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895594+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:05.895594+0000","last_peered":"2024-04-26T12:35:05.895594+0000","last_clean":"2024-04-26T12:35:05.895594+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:05.895594+0000","last_undegraded":"2024-04-26T12:35:05.895594+0000","last_fullsized":"2024-04-26T12:35:05.895594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188099+0000","last_change":"2024-04-26T12:35:03.178830+0000","last_active":"2024-04-26T12:35:05.188099+0000","last_peered":"2024-04-26T12:35:05.188099+0000","last_clean":"2024-04-26T12:35:05.188099+0000","last_became_active":"2024-04-26T12:35:03.166452+0000","last_became_peered":"2024-04-26T12:35:03.166452+0000","last_unstale":"2024-04-26T12:35:05.188099+0000","last_undegraded":"2024-04-26T12:35:05.188099+0000","last_fullsized":"2024-04-26T12:35:05.188099+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:03.037906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":64,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895060+0000","last_change":"2024-04-26T12:32:16.110135+0000","last_active":"2024-04-26T12:35:05.895060+0000","last_peered":"2024-04-26T12:35:05.895060+0000","last_clean":"2024-04-26T12:35:05.895060+0000","last_became_active":"2024-04-26T12:32:16.109837+0000","last_became_peered":"2024-04-26T12:32:16.109837+0000","last_unstale":"2024-04-26T12:35:05.895060+0000","last_undegraded":"2024-04-26T12:35:05.895060+0000","last_fullsized":"2024-04-26T12:35:05.895060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:19.898367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186022+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:05.186022+0000","last_peered":"2024-04-26T12:35:05.186022+0000","last_clean":"2024-04-26T12:35:05.186022+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:05.186022+0000","last_undegraded":"2024-04-26T12:35:05.186022+0000","last_fullsized":"2024-04-26T12:35:05.186022+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188243+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:05.188243+0000","last_peered":"2024-04-26T12:35:05.188243+0000","last_clean":"2024-04-26T12:35:05.188243+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:05.188243+0000","last_undegraded":"2024-04-26T12:35:05.188243+0000","last_fullsized":"2024-04-26T12:35:05.188243+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.185766+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:05.185766+0000","last_peered":"2024-04-26T12:35:05.185766+0000","last_clean":"2024-04-26T12:35:05.185766+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:05.185766+0000","last_undegraded":"2024-04-26T12:35:05.185766+0000","last_fullsized":"2024-04-26T12:35:05.185766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.896180+0000","last_change":"2024-04-26T12:32:16.109433+0000","last_active":"2024-04-26T12:35:05.896180+0000","last_peered":"2024-04-26T12:35:05.896180+0000","last_clean":"2024-04-26T12:35:05.896180+0000","last_became_active":"2024-04-26T12:32:16.109171+0000","last_became_peered":"2024-04-26T12:32:16.109171+0000","last_unstale":"2024-04-26T12:35:05.896180+0000","last_undegraded":"2024-04-26T12:35:05.896180+0000","last_fullsized":"2024-04-26T12:35:05.896180+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188356+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:05.188356+0000","last_peered":"2024-04-26T12:35:05.188356+0000","last_clean":"2024-04-26T12:35:05.188356+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:05.188356+0000","last_undegraded":"2024-04-26T12:35:05.188356+0000","last_fullsized":"2024-04-26T12:35:05.188356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186233+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:05.186233+0000","last_peered":"2024-04-26T12:35:05.186233+0000","last_clean":"2024-04-26T12:35:05.186233+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:05.186233+0000","last_undegraded":"2024-04-26T12:35:05.186233+0000","last_fullsized":"2024-04-26T12:35:05.186233+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187289+0000","last_change":"2024-04-26T12:35:03.190889+0000","last_active":"2024-04-26T12:35:05.187289+0000","last_peered":"2024-04-26T12:35:05.187289+0000","last_clean":"2024-04-26T12:35:05.187289+0000","last_became_active":"2024-04-26T12:35:03.189699+0000","last_became_peered":"2024-04-26T12:35:03.189699+0000","last_unstale":"2024-04-26T12:35:05.187289+0000","last_undegraded":"2024-04-26T12:35:05.187289+0000","last_fullsized":"2024-04-26T12:35:05.187289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:58.599512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6166,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-26T12:35:05.405934+0000","last_change":"2024-04-26T12:35:05.891229+0000","last_active":"2024-04-26T12:35:05.891229+0000","last_peered":"2024-04-26T12:35:05.405934+0000","last_clean":"2024-04-26T12:32:36.090113+0000","last_became_active":"2024-04-26T12:35:04.864319+0000","last_became_peered":"2024-04-26T12:35:04.864319+0000","last_unstale":"2024-04-26T12:35:05.405934+0000","last_undegraded":"2024-04-26T12:35:05.405934+0000","last_fullsized":"2024-04-26T12:35:04.157028+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:14:09.983277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895471+0000","last_change":"2024-04-26T12:32:16.109604+0000","last_active":"2024-04-26T12:35:05.895471+0000","last_peered":"2024-04-26T12:35:05.895471+0000","last_clean":"2024-04-26T12:35:05.895471+0000","last_became_active":"2024-04-26T12:32:16.109232+0000","last_became_peered":"2024-04-26T12:32:16.109232+0000","last_unstale":"2024-04-26T12:35:05.895471+0000","last_undegraded":"2024-04-26T12:35:05.895471+0000","last_fullsized":"2024-04-26T12:35:05.895471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:08.819922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898374+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:05.898374+0000","last_peered":"2024-04-26T12:35:05.898374+0000","last_clean":"2024-04-26T12:35:05.898374+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:05.898374+0000","last_undegraded":"2024-04-26T12:35:05.898374+0000","last_fullsized":"2024-04-26T12:35:05.898374+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":183,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895408+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:05.895408+0000","last_peered":"2024-04-26T12:35:05.895408+0000","last_clean":"2024-04-26T12:35:05.895408+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:05.895408+0000","last_undegraded":"2024-04-26T12:35:05.895408+0000","last_fullsized":"2024-04-26T12:35:05.895408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895338+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:05.895338+0000","last_peered":"2024-04-26T12:35:05.895338+0000","last_clean":"2024-04-26T12:35:05.895338+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:05.895338+0000","last_undegraded":"2024-04-26T12:35:05.895338+0000","last_fullsized":"2024-04-26T12:35:05.895338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":102,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895203+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:05.895203+0000","last_peered":"2024-04-26T12:35:05.895203+0000","last_clean":"2024-04-26T12:35:05.895203+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:05.895203+0000","last_undegraded":"2024-04-26T12:35:05.895203+0000","last_fullsized":"2024-04-26T12:35:05.895203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2060,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.891467+0000","last_change":"2024-04-26T12:35:05.891467+0000","last_active":"2024-04-26T12:35:03.151921+0000","last_peered":"2024-04-26T12:35:01.139783+0000","last_clean":"2024-04-26T12:32:35.952933+0000","last_became_active":"2024-04-26T12:32:37.141807+0000","last_became_peered":"2024-04-26T12:32:37.141807+0000","last_unstale":"2024-04-26T12:35:05.891467+0000","last_undegraded":"2024-04-26T12:35:05.891467+0000","last_fullsized":"2024-04-26T12:35:05.891467+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:36.967055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186045+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:05.186045+0000","last_peered":"2024-04-26T12:35:05.186045+0000","last_clean":"2024-04-26T12:35:05.186045+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:05.186045+0000","last_undegraded":"2024-04-26T12:35:05.186045+0000","last_fullsized":"2024-04-26T12:35:05.186045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2066,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897734+0000","last_change":"2024-04-26T12:35:05.897734+0000","last_active":"2024-04-26T12:35:05.897734+0000","last_peered":"2024-04-26T12:35:05.897734+0000","last_clean":"2024-04-26T12:35:05.897734+0000","last_became_active":"2024-04-26T12:35:05.897297+0000","last_became_peered":"2024-04-26T12:35:05.897297+0000","last_unstale":"2024-04-26T12:35:05.897734+0000","last_undegraded":"2024-04-26T12:35:05.897734+0000","last_fullsized":"2024-04-26T12:35:05.897734+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:22.684365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894511+0000","last_change":"2024-04-26T12:32:16.107025+0000","last_active":"2024-04-26T12:35:05.894511+0000","last_peered":"2024-04-26T12:35:05.894511+0000","last_clean":"2024-04-26T12:35:05.894511+0000","last_became_active":"2024-04-26T12:32:16.106307+0000","last_became_peered":"2024-04-26T12:32:16.106307+0000","last_unstale":"2024-04-26T12:35:05.894511+0000","last_undegraded":"2024-04-26T12:35:05.894511+0000","last_fullsized":"2024-04-26T12:35:05.894511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:31.214495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188548+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:05.188548+0000","last_peered":"2024-04-26T12:35:05.188548+0000","last_clean":"2024-04-26T12:35:05.188548+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:05.188548+0000","last_undegraded":"2024-04-26T12:35:05.188548+0000","last_fullsized":"2024-04-26T12:35:05.188548+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":96,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895262+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:05.895262+0000","last_peered":"2024-04-26T12:35:05.895262+0000","last_clean":"2024-04-26T12:35:05.895262+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:05.895262+0000","last_undegraded":"2024-04-26T12:35:05.895262+0000","last_fullsized":"2024-04-26T12:35:05.895262+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2153,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.896130+0000","last_change":"2024-04-26T12:35:05.896130+0000","last_active":"2024-04-26T12:35:03.157039+0000","last_peered":"2024-04-26T12:35:01.143823+0000","last_clean":"2024-04-26T12:32:35.940778+0000","last_became_active":"2024-04-26T12:32:37.144911+0000","last_became_peered":"2024-04-26T12:32:37.144911+0000","last_unstale":"2024-04-26T12:35:05.896130+0000","last_undegraded":"2024-04-26T12:35:05.896130+0000","last_fullsized":"2024-04-26T12:35:05.896130+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:24.704812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":89,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895714+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:05.895714+0000","last_peered":"2024-04-26T12:35:05.895714+0000","last_clean":"2024-04-26T12:35:05.895714+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:05.895714+0000","last_undegraded":"2024-04-26T12:35:05.895714+0000","last_fullsized":"2024-04-26T12:35:05.895714+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894052+0000","last_change":"2024-04-26T12:32:16.109694+0000","last_active":"2024-04-26T12:35:05.894052+0000","last_peered":"2024-04-26T12:35:05.894052+0000","last_clean":"2024-04-26T12:35:05.894052+0000","last_became_active":"2024-04-26T12:32:16.109070+0000","last_became_peered":"2024-04-26T12:32:16.109070+0000","last_unstale":"2024-04-26T12:35:05.894052+0000","last_undegraded":"2024-04-26T12:35:05.894052+0000","last_fullsized":"2024-04-26T12:35:05.894052+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:54.733914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":88,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.890067+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:05.890067+0000","last_peered":"2024-04-26T12:35:05.890067+0000","last_clean":"2024-04-26T12:35:05.890067+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:05.890067+0000","last_undegraded":"2024-04-26T12:35:05.890067+0000","last_fullsized":"2024-04-26T12:35:05.890067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.185775+0000","last_change":"2024-04-26T12:35:03.186376+0000","last_active":"2024-04-26T12:35:05.185775+0000","last_peered":"2024-04-26T12:35:05.185775+0000","last_clean":"2024-04-26T12:35:05.185775+0000","last_became_active":"2024-04-26T12:35:03.168583+0000","last_became_peered":"2024-04-26T12:35:03.168583+0000","last_unstale":"2024-04-26T12:35:05.185775+0000","last_undegraded":"2024-04-26T12:35:05.185775+0000","last_fullsized":"2024-04-26T12:35:05.185775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:20.154397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.889611+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:35:05.889611+0000","last_peered":"2024-04-26T12:35:05.889611+0000","last_clean":"2024-04-26T12:35:05.889611+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:35:05.889611+0000","last_undegraded":"2024-04-26T12:35:05.889611+0000","last_fullsized":"2024-04-26T12:35:05.889611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2103,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.904382+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:05.904382+0000","last_peered":"2024-04-26T12:35:05.904382+0000","last_clean":"2024-04-26T12:35:05.904382+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:05.904382+0000","last_undegraded":"2024-04-26T12:35:05.904382+0000","last_fullsized":"2024-04-26T12:35:05.904382+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895284+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:05.895284+0000","last_peered":"2024-04-26T12:35:05.895284+0000","last_clean":"2024-04-26T12:35:05.895284+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:05.895284+0000","last_undegraded":"2024-04-26T12:35:05.895284+0000","last_fullsized":"2024-04-26T12:35:05.895284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.189069+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:05.189069+0000","last_peered":"2024-04-26T12:35:05.189069+0000","last_clean":"2024-04-26T12:35:05.189069+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:05.189069+0000","last_undegraded":"2024-04-26T12:35:05.189069+0000","last_fullsized":"2024-04-26T12:35:05.189069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187136+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:05.187136+0000","last_peered":"2024-04-26T12:35:05.187136+0000","last_clean":"2024-04-26T12:35:05.187136+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:05.187136+0000","last_undegraded":"2024-04-26T12:35:05.187136+0000","last_fullsized":"2024-04-26T12:35:05.187136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2091,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.907225+0000","last_change":"2024-04-26T12:35:05.902297+0000","last_active":"2024-04-26T12:35:05.907225+0000","last_peered":"2024-04-26T12:35:05.907225+0000","last_clean":"2024-04-26T12:35:05.907225+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:05.907225+0000","last_undegraded":"2024-04-26T12:35:05.907225+0000","last_fullsized":"2024-04-26T12:35:05.907225+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:37.434819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894659+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:05.894659+0000","last_peered":"2024-04-26T12:35:05.894659+0000","last_clean":"2024-04-26T12:35:05.894659+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:05.894659+0000","last_undegraded":"2024-04-26T12:35:05.894659+0000","last_fullsized":"2024-04-26T12:35:05.894659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2126,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895926+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:05.895926+0000","last_peered":"2024-04-26T12:35:05.895926+0000","last_clean":"2024-04-26T12:35:05.895926+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:05.895926+0000","last_undegraded":"2024-04-26T12:35:05.895926+0000","last_fullsized":"2024-04-26T12:35:05.895926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894778+0000","last_change":"2024-04-26T12:32:16.109449+0000","last_active":"2024-04-26T12:35:05.894778+0000","last_peered":"2024-04-26T12:35:05.894778+0000","last_clean":"2024-04-26T12:35:05.894778+0000","last_became_active":"2024-04-26T12:32:16.109131+0000","last_became_peered":"2024-04-26T12:32:16.109131+0000","last_unstale":"2024-04-26T12:35:05.894778+0000","last_undegraded":"2024-04-26T12:35:05.894778+0000","last_fullsized":"2024-04-26T12:35:05.894778+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:47.757728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895678+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:05.895678+0000","last_peered":"2024-04-26T12:35:05.895678+0000","last_clean":"2024-04-26T12:35:05.895678+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:05.895678+0000","last_undegraded":"2024-04-26T12:35:05.895678+0000","last_fullsized":"2024-04-26T12:35:05.895678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186034+0000","last_change":"2024-04-26T12:35:03.171996+0000","last_active":"2024-04-26T12:35:05.186034+0000","last_peered":"2024-04-26T12:35:05.186034+0000","last_clean":"2024-04-26T12:35:05.186034+0000","last_became_active":"2024-04-26T12:35:03.163038+0000","last_became_peered":"2024-04-26T12:35:03.163038+0000","last_unstale":"2024-04-26T12:35:05.186034+0000","last_undegraded":"2024-04-26T12:35:05.186034+0000","last_fullsized":"2024-04-26T12:35:05.186034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:29.580246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6168,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.894905+0000","last_change":"2024-04-26T12:35:05.894905+0000","last_active":"2024-04-26T12:35:03.153778+0000","last_peered":"2024-04-26T12:35:01.140789+0000","last_clean":"2024-04-26T12:32:36.042703+0000","last_became_active":"2024-04-26T12:32:37.155816+0000","last_became_peered":"2024-04-26T12:32:37.155816+0000","last_unstale":"2024-04-26T12:35:05.894905+0000","last_undegraded":"2024-04-26T12:35:05.894905+0000","last_fullsized":"2024-04-26T12:35:05.894905+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:58.465619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188216+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:05.188216+0000","last_peered":"2024-04-26T12:35:05.188216+0000","last_clean":"2024-04-26T12:35:05.188216+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:05.188216+0000","last_undegraded":"2024-04-26T12:35:05.188216+0000","last_fullsized":"2024-04-26T12:35:05.188216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895716+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:05.895716+0000","last_peered":"2024-04-26T12:35:05.895716+0000","last_clean":"2024-04-26T12:35:05.895716+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:05.895716+0000","last_undegraded":"2024-04-26T12:35:05.895716+0000","last_fullsized":"2024-04-26T12:35:05.895716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":57,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894447+0000","last_change":"2024-04-26T12:32:16.107013+0000","last_active":"2024-04-26T12:35:05.894447+0000","last_peered":"2024-04-26T12:35:05.894447+0000","last_clean":"2024-04-26T12:35:05.894447+0000","last_became_active":"2024-04-26T12:32:16.106306+0000","last_became_peered":"2024-04-26T12:32:16.106306+0000","last_unstale":"2024-04-26T12:35:05.894447+0000","last_undegraded":"2024-04-26T12:35:05.894447+0000","last_fullsized":"2024-04-26T12:35:05.894447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:34.079328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895095+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:05.895095+0000","last_peered":"2024-04-26T12:35:05.895095+0000","last_clean":"2024-04-26T12:35:05.895095+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:05.895095+0000","last_undegraded":"2024-04-26T12:35:05.895095+0000","last_fullsized":"2024-04-26T12:35:05.895095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894899+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:05.894899+0000","last_peered":"2024-04-26T12:35:05.894899+0000","last_clean":"2024-04-26T12:35:05.894899+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:05.894899+0000","last_undegraded":"2024-04-26T12:35:05.894899+0000","last_fullsized":"2024-04-26T12:35:05.894899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187109+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:05.187109+0000","last_peered":"2024-04-26T12:35:05.187109+0000","last_clean":"2024-04-26T12:35:05.187109+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:05.187109+0000","last_undegraded":"2024-04-26T12:35:05.187109+0000","last_fullsized":"2024-04-26T12:35:05.187109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186587+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:05.186587+0000","last_peered":"2024-04-26T12:35:05.186587+0000","last_clean":"2024-04-26T12:35:05.186587+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:05.186587+0000","last_undegraded":"2024-04-26T12:35:05.186587+0000","last_fullsized":"2024-04-26T12:35:05.186587+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":86,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.889030+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:05.889030+0000","last_peered":"2024-04-26T12:35:05.889030+0000","last_clean":"2024-04-26T12:35:05.889030+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:05.889030+0000","last_undegraded":"2024-04-26T12:35:05.889030+0000","last_fullsized":"2024-04-26T12:35:05.889030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188456+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:05.188456+0000","last_peered":"2024-04-26T12:35:05.188456+0000","last_clean":"2024-04-26T12:35:05.188456+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:05.188456+0000","last_undegraded":"2024-04-26T12:35:05.188456+0000","last_fullsized":"2024-04-26T12:35:05.188456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895066+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:05.895066+0000","last_peered":"2024-04-26T12:35:05.895066+0000","last_clean":"2024-04-26T12:35:05.895066+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:05.895066+0000","last_undegraded":"2024-04-26T12:35:05.895066+0000","last_fullsized":"2024-04-26T12:35:05.895066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":287,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895406+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:05.895406+0000","last_peered":"2024-04-26T12:35:05.895406+0000","last_clean":"2024-04-26T12:35:05.895406+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:05.895406+0000","last_undegraded":"2024-04-26T12:35:05.895406+0000","last_fullsized":"2024-04-26T12:35:05.895406+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186724+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:05.186724+0000","last_peered":"2024-04-26T12:35:05.186724+0000","last_clean":"2024-04-26T12:35:05.186724+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:05.186724+0000","last_undegraded":"2024-04-26T12:35:05.186724+0000","last_fullsized":"2024-04-26T12:35:05.186724+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895908+0000","last_change":"2024-04-26T12:32:16.106958+0000","last_active":"2024-04-26T12:35:05.895908+0000","last_peered":"2024-04-26T12:35:05.895908+0000","last_clean":"2024-04-26T12:35:05.895908+0000","last_became_active":"2024-04-26T12:32:16.106262+0000","last_became_peered":"2024-04-26T12:32:16.106262+0000","last_unstale":"2024-04-26T12:35:05.895908+0000","last_undegraded":"2024-04-26T12:35:05.895908+0000","last_fullsized":"2024-04-26T12:35:05.895908+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:33.467447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895024+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:05.895024+0000","last_peered":"2024-04-26T12:35:05.895024+0000","last_clean":"2024-04-26T12:35:05.895024+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:05.895024+0000","last_undegraded":"2024-04-26T12:35:05.895024+0000","last_fullsized":"2024-04-26T12:35:05.895024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":68,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186747+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:05.186747+0000","last_peered":"2024-04-26T12:35:05.186747+0000","last_clean":"2024-04-26T12:35:05.186747+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:05.186747+0000","last_undegraded":"2024-04-26T12:35:05.186747+0000","last_fullsized":"2024-04-26T12:35:05.186747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8076,"reported_epoch":88,"state":"peering","last_fresh":"2024-04-26T12:35:05.451340+0000","last_change":"2024-04-26T12:35:05.891484+0000","last_active":"2024-04-26T12:35:05.891484+0000","last_peered":"2024-04-26T12:35:05.451340+0000","last_clean":"2024-04-26T12:32:36.002439+0000","last_became_active":"2024-04-26T12:35:04.912946+0000","last_became_peered":"2024-04-26T12:35:04.912946+0000","last_unstale":"2024-04-26T12:35:05.451340+0000","last_undegraded":"2024-04-26T12:35:05.451340+0000","last_fullsized":"2024-04-26T12:35:04.157946+0000","mapping_epoch":89,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:59.468162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186967+0000","last_change":"2024-04-26T12:35:03.179164+0000","last_active":"2024-04-26T12:35:05.186967+0000","last_peered":"2024-04-26T12:35:05.186967+0000","last_clean":"2024-04-26T12:35:05.186967+0000","last_became_active":"2024-04-26T12:35:03.176940+0000","last_became_peered":"2024-04-26T12:35:03.176940+0000","last_unstale":"2024-04-26T12:35:05.186967+0000","last_undegraded":"2024-04-26T12:35:05.186967+0000","last_fullsized":"2024-04-26T12:35:05.186967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:29.707002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.189056+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:05.189056+0000","last_peered":"2024-04-26T12:35:05.189056+0000","last_clean":"2024-04-26T12:35:05.189056+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:05.189056+0000","last_undegraded":"2024-04-26T12:35:05.189056+0000","last_fullsized":"2024-04-26T12:35:05.189056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2102,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894479+0000","last_change":"2024-04-26T12:32:16.109669+0000","last_active":"2024-04-26T12:35:05.894479+0000","last_peered":"2024-04-26T12:35:05.894479+0000","last_clean":"2024-04-26T12:35:05.894479+0000","last_became_active":"2024-04-26T12:32:16.109328+0000","last_became_peered":"2024-04-26T12:32:16.109328+0000","last_unstale":"2024-04-26T12:35:05.894479+0000","last_undegraded":"2024-04-26T12:35:05.894479+0000","last_fullsized":"2024-04-26T12:35:05.894479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:32.967100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":67,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187210+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:05.187210+0000","last_peered":"2024-04-26T12:35:05.187210+0000","last_clean":"2024-04-26T12:35:05.187210+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:05.187210+0000","last_undegraded":"2024-04-26T12:35:05.187210+0000","last_fullsized":"2024-04-26T12:35:05.187210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.187396+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:05.187396+0000","last_peered":"2024-04-26T12:35:05.187396+0000","last_clean":"2024-04-26T12:35:05.187396+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:05.187396+0000","last_undegraded":"2024-04-26T12:35:05.187396+0000","last_fullsized":"2024-04-26T12:35:05.187396+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.185945+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:05.185945+0000","last_peered":"2024-04-26T12:35:05.185945+0000","last_clean":"2024-04-26T12:35:05.185945+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:05.185945+0000","last_undegraded":"2024-04-26T12:35:05.185945+0000","last_fullsized":"2024-04-26T12:35:05.185945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895913+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:05.895913+0000","last_peered":"2024-04-26T12:35:05.895913+0000","last_clean":"2024-04-26T12:35:05.895913+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:05.895913+0000","last_undegraded":"2024-04-26T12:35:05.895913+0000","last_fullsized":"2024-04-26T12:35:05.895913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":73,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188428+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:05.188428+0000","last_peered":"2024-04-26T12:35:05.188428+0000","last_clean":"2024-04-26T12:35:05.188428+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:05.188428+0000","last_undegraded":"2024-04-26T12:35:05.188428+0000","last_fullsized":"2024-04-26T12:35:05.188428+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":90,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.889216+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:05.889216+0000","last_peered":"2024-04-26T12:35:05.889216+0000","last_clean":"2024-04-26T12:35:05.889216+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:05.889216+0000","last_undegraded":"2024-04-26T12:35:05.889216+0000","last_fullsized":"2024-04-26T12:35:05.889216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894606+0000","last_change":"2024-04-26T12:32:16.110117+0000","last_active":"2024-04-26T12:35:05.894606+0000","last_peered":"2024-04-26T12:35:05.894606+0000","last_clean":"2024-04-26T12:35:05.894606+0000","last_became_active":"2024-04-26T12:32:16.109893+0000","last_became_peered":"2024-04-26T12:32:16.109893+0000","last_unstale":"2024-04-26T12:35:05.894606+0000","last_undegraded":"2024-04-26T12:35:05.894606+0000","last_fullsized":"2024-04-26T12:35:05.894606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:18.025832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2099,"reported_epoch":89,"state":"peering","last_fresh":"2024-04-26T12:35:05.891098+0000","last_change":"2024-04-26T12:35:05.891098+0000","last_active":"2024-04-26T12:35:03.152192+0000","last_peered":"2024-04-26T12:35:01.140160+0000","last_clean":"2024-04-26T12:32:35.963478+0000","last_became_active":"2024-04-26T12:32:37.142589+0000","last_became_peered":"2024-04-26T12:32:37.142589+0000","last_unstale":"2024-04-26T12:35:05.891098+0000","last_undegraded":"2024-04-26T12:35:05.891098+0000","last_fullsized":"2024-04-26T12:35:05.891098+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:20.164659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":102,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895251+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:05.895251+0000","last_peered":"2024-04-26T12:35:05.895251+0000","last_clean":"2024-04-26T12:35:05.895251+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:05.895251+0000","last_undegraded":"2024-04-26T12:35:05.895251+0000","last_fullsized":"2024-04-26T12:35:05.895251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.904402+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:05.904402+0000","last_peered":"2024-04-26T12:35:05.904402+0000","last_clean":"2024-04-26T12:35:05.904402+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:05.904402+0000","last_undegraded":"2024-04-26T12:35:05.904402+0000","last_fullsized":"2024-04-26T12:35:05.904402+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:50.285275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895446+0000","last_change":"2024-04-26T12:32:16.110008+0000","last_active":"2024-04-26T12:35:05.895446+0000","last_peered":"2024-04-26T12:35:05.895446+0000","last_clean":"2024-04-26T12:35:05.895446+0000","last_became_active":"2024-04-26T12:32:16.109548+0000","last_became_peered":"2024-04-26T12:32:16.109548+0000","last_unstale":"2024-04-26T12:35:05.895446+0000","last_undegraded":"2024-04-26T12:35:05.895446+0000","last_fullsized":"2024-04-26T12:35:05.895446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:54.045578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":106,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894770+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:05.894770+0000","last_peered":"2024-04-26T12:35:05.894770+0000","last_clean":"2024-04-26T12:35:05.894770+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:05.894770+0000","last_undegraded":"2024-04-26T12:35:05.894770+0000","last_fullsized":"2024-04-26T12:35:05.894770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":66,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188093+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:05.188093+0000","last_peered":"2024-04-26T12:35:05.188093+0000","last_clean":"2024-04-26T12:35:05.188093+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:05.188093+0000","last_undegraded":"2024-04-26T12:35:05.188093+0000","last_fullsized":"2024-04-26T12:35:05.188093+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4166,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895130+0000","last_change":"2024-04-26T12:35:05.895130+0000","last_active":"2024-04-26T12:35:05.895130+0000","last_peered":"2024-04-26T12:35:05.895130+0000","last_clean":"2024-04-26T12:35:05.895130+0000","last_became_active":"2024-04-26T12:35:05.893689+0000","last_became_peered":"2024-04-26T12:35:05.893689+0000","last_unstale":"2024-04-26T12:35:05.895130+0000","last_undegraded":"2024-04-26T12:35:05.895130+0000","last_fullsized":"2024-04-26T12:35:05.895130+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:15.086674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":69,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.188548+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:05.188548+0000","last_peered":"2024-04-26T12:35:05.188548+0000","last_clean":"2024-04-26T12:35:05.188548+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:05.188548+0000","last_undegraded":"2024-04-26T12:35:05.188548+0000","last_fullsized":"2024-04-26T12:35:05.188548+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2172,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895363+0000","last_change":"2024-04-26T12:32:26.265982+0000","last_active":"2024-04-26T12:35:05.895363+0000","last_peered":"2024-04-26T12:35:05.895363+0000","last_clean":"2024-04-26T12:35:05.895363+0000","last_became_active":"2024-04-26T12:32:26.264296+0000","last_became_peered":"2024-04-26T12:32:26.264296+0000","last_unstale":"2024-04-26T12:35:05.895363+0000","last_undegraded":"2024-04-26T12:35:05.895363+0000","last_fullsized":"2024-04-26T12:35:05.895363+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:25.897269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":109,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895144+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:05.895144+0000","last_peered":"2024-04-26T12:35:05.895144+0000","last_clean":"2024-04-26T12:35:05.895144+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:05.895144+0000","last_undegraded":"2024-04-26T12:35:05.895144+0000","last_fullsized":"2024-04-26T12:35:05.895144+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.186653+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:05.186653+0000","last_peered":"2024-04-26T12:35:05.186653+0000","last_clean":"2024-04-26T12:35:05.186653+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:05.186653+0000","last_undegraded":"2024-04-26T12:35:05.186653+0000","last_fullsized":"2024-04-26T12:35:05.186653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2035,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894312+0000","last_change":"2024-04-26T12:32:16.107224+0000","last_active":"2024-04-26T12:35:05.894312+0000","last_peered":"2024-04-26T12:35:05.894312+0000","last_clean":"2024-04-26T12:35:05.894312+0000","last_became_active":"2024-04-26T12:32:16.106255+0000","last_became_peered":"2024-04-26T12:32:16.106255+0000","last_unstale":"2024-04-26T12:35:05.894312+0000","last_undegraded":"2024-04-26T12:35:05.894312+0000","last_fullsized":"2024-04-26T12:35:05.894312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:01.140990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898005+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:05.898005+0000","last_peered":"2024-04-26T12:35:05.898005+0000","last_clean":"2024-04-26T12:35:05.898005+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:05.898005+0000","last_undegraded":"2024-04-26T12:35:05.898005+0000","last_fullsized":"2024-04-26T12:35:05.898005+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2129,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.890439+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:05.890439+0000","last_peered":"2024-04-26T12:35:05.890439+0000","last_clean":"2024-04-26T12:35:05.890439+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:05.890439+0000","last_undegraded":"2024-04-26T12:35:05.890439+0000","last_fullsized":"2024-04-26T12:35:05.890439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120717,"ondisk_log_size":120717,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142928,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228912,"statfs":{"total":96636764160,"available":95466405888,"internally_reserved":0,"allocated":1110016,"data_stored":1245101,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.432},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.38}]}]},{"osd":0,"up_from":85,"seq":365072220162,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52588,"kb_used_data":732,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319252,"statfs":{"total":96636764160,"available":96582914048,"internally_reserved":0,"allocated":749568,"data_stored":362669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511112,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860728,"statfs":{"total":96636764160,"available":95089385472,"internally_reserved":0,"allocated":1101824,"data_stored":1245992,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.443},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.436},"min":{"1min":0.33900000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.372,"5min":0.188,"15min":0.188},"max":{"1min":0.70199999999999996,"5min":1.137,"15min":1.137},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:14.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:15.320 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:15.322 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:15.334 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-04-26T12:35:15.046013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121021,"ondisk_log_size":121021,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706640,"kb_used_data":2908,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408880,"statfs":{"total":289910292480,"available":287138693120,"internally_reserved":0,"allocated":2977792,"data_stored":2862610,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-26,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.149070"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2071,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.902891+0000","last_change":"2024-04-26T12:35:06.902891+0000","last_active":"2024-04-26T12:35:06.902891+0000","last_peered":"2024-04-26T12:35:06.902891+0000","last_clean":"2024-04-26T12:35:06.902891+0000","last_became_active":"2024-04-26T12:35:06.901964+0000","last_became_peered":"2024-04-26T12:35:06.901964+0000","last_unstale":"2024-04-26T12:35:06.902891+0000","last_undegraded":"2024-04-26T12:35:06.902891+0000","last_fullsized":"2024-04-26T12:35:06.902891+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:41.452849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892209+0000","last_change":"2024-04-26T12:35:03.176728+0000","last_active":"2024-04-26T12:35:05.892209+0000","last_peered":"2024-04-26T12:35:05.892209+0000","last_clean":"2024-04-26T12:35:05.892209+0000","last_became_active":"2024-04-26T12:35:03.165372+0000","last_became_peered":"2024-04-26T12:35:03.165372+0000","last_unstale":"2024-04-26T12:35:05.892209+0000","last_undegraded":"2024-04-26T12:35:05.892209+0000","last_fullsized":"2024-04-26T12:35:05.892209+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:18.088107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895695+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:05.895695+0000","last_peered":"2024-04-26T12:35:05.895695+0000","last_clean":"2024-04-26T12:35:05.895695+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:05.895695+0000","last_undegraded":"2024-04-26T12:35:05.895695+0000","last_fullsized":"2024-04-26T12:35:05.895695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895473+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:05.895473+0000","last_peered":"2024-04-26T12:35:05.895473+0000","last_clean":"2024-04-26T12:35:05.895473+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:05.895473+0000","last_undegraded":"2024-04-26T12:35:05.895473+0000","last_fullsized":"2024-04-26T12:35:05.895473+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898769+0000","last_change":"2024-04-26T12:35:05.898378+0000","last_active":"2024-04-26T12:35:05.898769+0000","last_peered":"2024-04-26T12:35:05.898769+0000","last_clean":"2024-04-26T12:35:05.898769+0000","last_became_active":"2024-04-26T12:35:05.897932+0000","last_became_peered":"2024-04-26T12:35:05.897932+0000","last_unstale":"2024-04-26T12:35:05.898769+0000","last_undegraded":"2024-04-26T12:35:05.898769+0000","last_fullsized":"2024-04-26T12:35:05.898769+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:20.346496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892320+0000","last_change":"2024-04-26T12:35:03.180071+0000","last_active":"2024-04-26T12:35:05.892320+0000","last_peered":"2024-04-26T12:35:05.892320+0000","last_clean":"2024-04-26T12:35:05.892320+0000","last_became_active":"2024-04-26T12:35:03.175460+0000","last_became_peered":"2024-04-26T12:35:03.175460+0000","last_unstale":"2024-04-26T12:35:05.892320+0000","last_undegraded":"2024-04-26T12:35:05.892320+0000","last_fullsized":"2024-04-26T12:35:05.892320+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:21.916488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.891432+0000","last_change":"2024-04-26T12:35:03.188701+0000","last_active":"2024-04-26T12:35:05.891432+0000","last_peered":"2024-04-26T12:35:05.891432+0000","last_clean":"2024-04-26T12:35:05.891432+0000","last_became_active":"2024-04-26T12:35:03.183610+0000","last_became_peered":"2024-04-26T12:35:03.183610+0000","last_unstale":"2024-04-26T12:35:05.891432+0000","last_undegraded":"2024-04-26T12:35:05.891432+0000","last_fullsized":"2024-04-26T12:35:05.891432+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:10.730025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8196,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.903708+0000","last_change":"2024-04-26T12:35:06.903708+0000","last_active":"2024-04-26T12:35:06.903708+0000","last_peered":"2024-04-26T12:35:06.903708+0000","last_clean":"2024-04-26T12:35:06.903708+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:06.903708+0000","last_undegraded":"2024-04-26T12:35:06.903708+0000","last_fullsized":"2024-04-26T12:35:06.903708+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6171,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.902705+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:06.902705+0000","last_peered":"2024-04-26T12:35:06.902705+0000","last_clean":"2024-04-26T12:35:06.902705+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:06.902705+0000","last_undegraded":"2024-04-26T12:35:06.902705+0000","last_fullsized":"2024-04-26T12:35:06.902705+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:49.537738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6218,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.904325+0000","last_change":"2024-04-26T12:35:06.904325+0000","last_active":"2024-04-26T12:35:06.904325+0000","last_peered":"2024-04-26T12:35:06.904325+0000","last_clean":"2024-04-26T12:35:06.904325+0000","last_became_active":"2024-04-26T12:35:06.902735+0000","last_became_peered":"2024-04-26T12:35:06.902735+0000","last_unstale":"2024-04-26T12:35:06.904325+0000","last_undegraded":"2024-04-26T12:35:06.904325+0000","last_fullsized":"2024-04-26T12:35:06.904325+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6120,"log_dups_size":0,"ondisk_log_size":6120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:58:58.911332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4068,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.900319+0000","last_change":"2024-04-26T12:35:05.900074+0000","last_active":"2024-04-26T12:35:05.900319+0000","last_peered":"2024-04-26T12:35:05.900319+0000","last_clean":"2024-04-26T12:35:05.900319+0000","last_became_active":"2024-04-26T12:35:05.899482+0000","last_became_peered":"2024-04-26T12:35:05.899482+0000","last_unstale":"2024-04-26T12:35:05.900319+0000","last_undegraded":"2024-04-26T12:35:05.900319+0000","last_fullsized":"2024-04-26T12:35:05.900319+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:52.630713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2100,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895128+0000","last_change":"2024-04-26T12:32:16.107668+0000","last_active":"2024-04-26T12:35:05.895128+0000","last_peered":"2024-04-26T12:35:05.895128+0000","last_clean":"2024-04-26T12:35:05.895128+0000","last_became_active":"2024-04-26T12:32:16.107458+0000","last_became_peered":"2024-04-26T12:32:16.107458+0000","last_unstale":"2024-04-26T12:35:05.895128+0000","last_undegraded":"2024-04-26T12:35:05.895128+0000","last_fullsized":"2024-04-26T12:35:05.895128+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:15.458028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2127,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.896672+0000","last_change":"2024-04-26T12:35:05.896349+0000","last_active":"2024-04-26T12:35:05.896672+0000","last_peered":"2024-04-26T12:35:05.896672+0000","last_clean":"2024-04-26T12:35:05.896672+0000","last_became_active":"2024-04-26T12:35:05.895047+0000","last_became_peered":"2024-04-26T12:35:05.895047+0000","last_unstale":"2024-04-26T12:35:05.896672+0000","last_undegraded":"2024-04-26T12:35:05.896672+0000","last_fullsized":"2024-04-26T12:35:05.896672+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:43.511788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2138,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895220+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:05.895220+0000","last_peered":"2024-04-26T12:35:05.895220+0000","last_clean":"2024-04-26T12:35:05.895220+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:05.895220+0000","last_undegraded":"2024-04-26T12:35:05.895220+0000","last_fullsized":"2024-04-26T12:35:05.895220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894632+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:05.894632+0000","last_peered":"2024-04-26T12:35:05.894632+0000","last_clean":"2024-04-26T12:35:05.894632+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:05.894632+0000","last_undegraded":"2024-04-26T12:35:05.894632+0000","last_fullsized":"2024-04-26T12:35:05.894632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897659+0000","last_change":"2024-04-26T12:35:05.897209+0000","last_active":"2024-04-26T12:35:05.897659+0000","last_peered":"2024-04-26T12:35:05.897659+0000","last_clean":"2024-04-26T12:35:05.897659+0000","last_became_active":"2024-04-26T12:35:05.896312+0000","last_became_peered":"2024-04-26T12:35:05.896312+0000","last_unstale":"2024-04-26T12:35:05.897659+0000","last_undegraded":"2024-04-26T12:35:05.897659+0000","last_fullsized":"2024-04-26T12:35:05.897659+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:34.224468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2110,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.901285+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:06.901285+0000","last_peered":"2024-04-26T12:35:06.901285+0000","last_clean":"2024-04-26T12:35:06.901285+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:06.901285+0000","last_undegraded":"2024-04-26T12:35:06.901285+0000","last_fullsized":"2024-04-26T12:35:06.901285+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:52.856014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2127,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.901399+0000","last_change":"2024-04-26T12:35:06.901399+0000","last_active":"2024-04-26T12:35:06.901399+0000","last_peered":"2024-04-26T12:35:06.901399+0000","last_clean":"2024-04-26T12:35:06.901399+0000","last_became_active":"2024-04-26T12:35:06.900534+0000","last_became_peered":"2024-04-26T12:35:06.900534+0000","last_unstale":"2024-04-26T12:35:06.901399+0000","last_undegraded":"2024-04-26T12:35:06.901399+0000","last_fullsized":"2024-04-26T12:35:06.901399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:50.270512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4090,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.899173+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:06.899173+0000","last_peered":"2024-04-26T12:35:06.899173+0000","last_clean":"2024-04-26T12:35:06.899173+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:06.899173+0000","last_undegraded":"2024-04-26T12:35:06.899173+0000","last_fullsized":"2024-04-26T12:35:06.899173+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.866275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4214,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.904425+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:05.904425+0000","last_peered":"2024-04-26T12:35:05.904425+0000","last_clean":"2024-04-26T12:35:05.904425+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:05.904425+0000","last_undegraded":"2024-04-26T12:35:05.904425+0000","last_fullsized":"2024-04-26T12:35:05.904425+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:03.877816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":111,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894788+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:05.894788+0000","last_peered":"2024-04-26T12:35:05.894788+0000","last_clean":"2024-04-26T12:35:05.894788+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:05.894788+0000","last_undegraded":"2024-04-26T12:35:05.894788+0000","last_fullsized":"2024-04-26T12:35:05.894788+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.888997+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:05.888997+0000","last_peered":"2024-04-26T12:35:05.888997+0000","last_clean":"2024-04-26T12:35:05.888997+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:05.888997+0000","last_undegraded":"2024-04-26T12:35:05.888997+0000","last_fullsized":"2024-04-26T12:35:05.888997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2091,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.897833+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:05.897833+0000","last_peered":"2024-04-26T12:35:05.897833+0000","last_clean":"2024-04-26T12:35:05.897833+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:05.897833+0000","last_undegraded":"2024-04-26T12:35:05.897833+0000","last_fullsized":"2024-04-26T12:35:05.897833+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4125,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.901537+0000","last_change":"2024-04-26T12:35:06.901537+0000","last_active":"2024-04-26T12:35:06.901537+0000","last_peered":"2024-04-26T12:35:06.901537+0000","last_clean":"2024-04-26T12:35:06.901537+0000","last_became_active":"2024-04-26T12:35:06.900537+0000","last_became_peered":"2024-04-26T12:35:06.900537+0000","last_unstale":"2024-04-26T12:35:06.901537+0000","last_undegraded":"2024-04-26T12:35:06.901537+0000","last_fullsized":"2024-04-26T12:35:06.901537+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:22.625923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895675+0000","last_change":"2024-04-26T12:32:16.109558+0000","last_active":"2024-04-26T12:35:05.895675+0000","last_peered":"2024-04-26T12:35:05.895675+0000","last_clean":"2024-04-26T12:35:05.895675+0000","last_became_active":"2024-04-26T12:32:16.109196+0000","last_became_peered":"2024-04-26T12:32:16.109196+0000","last_unstale":"2024-04-26T12:35:05.895675+0000","last_undegraded":"2024-04-26T12:35:05.895675+0000","last_fullsized":"2024-04-26T12:35:05.895675+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:25.423545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893465+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:05.893465+0000","last_peered":"2024-04-26T12:35:05.893465+0000","last_clean":"2024-04-26T12:35:05.893465+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:05.893465+0000","last_undegraded":"2024-04-26T12:35:05.893465+0000","last_fullsized":"2024-04-26T12:35:05.893465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2093,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895594+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:05.895594+0000","last_peered":"2024-04-26T12:35:05.895594+0000","last_clean":"2024-04-26T12:35:05.895594+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:05.895594+0000","last_undegraded":"2024-04-26T12:35:05.895594+0000","last_fullsized":"2024-04-26T12:35:05.895594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892356+0000","last_change":"2024-04-26T12:35:03.178830+0000","last_active":"2024-04-26T12:35:05.892356+0000","last_peered":"2024-04-26T12:35:05.892356+0000","last_clean":"2024-04-26T12:35:05.892356+0000","last_became_active":"2024-04-26T12:35:03.166452+0000","last_became_peered":"2024-04-26T12:35:03.166452+0000","last_unstale":"2024-04-26T12:35:05.892356+0000","last_undegraded":"2024-04-26T12:35:05.892356+0000","last_fullsized":"2024-04-26T12:35:05.892356+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:03.037906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":64,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895060+0000","last_change":"2024-04-26T12:32:16.110135+0000","last_active":"2024-04-26T12:35:05.895060+0000","last_peered":"2024-04-26T12:35:05.895060+0000","last_clean":"2024-04-26T12:35:05.895060+0000","last_became_active":"2024-04-26T12:32:16.109837+0000","last_became_peered":"2024-04-26T12:32:16.109837+0000","last_unstale":"2024-04-26T12:35:05.895060+0000","last_undegraded":"2024-04-26T12:35:05.895060+0000","last_fullsized":"2024-04-26T12:35:05.895060+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:19.898367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.890623+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:05.890623+0000","last_peered":"2024-04-26T12:35:05.890623+0000","last_clean":"2024-04-26T12:35:05.890623+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:05.890623+0000","last_undegraded":"2024-04-26T12:35:05.890623+0000","last_fullsized":"2024-04-26T12:35:05.890623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892316+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:05.892316+0000","last_peered":"2024-04-26T12:35:05.892316+0000","last_clean":"2024-04-26T12:35:05.892316+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:05.892316+0000","last_undegraded":"2024-04-26T12:35:05.892316+0000","last_fullsized":"2024-04-26T12:35:05.892316+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.890404+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:05.890404+0000","last_peered":"2024-04-26T12:35:05.890404+0000","last_clean":"2024-04-26T12:35:05.890404+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:05.890404+0000","last_undegraded":"2024-04-26T12:35:05.890404+0000","last_fullsized":"2024-04-26T12:35:05.890404+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.896180+0000","last_change":"2024-04-26T12:32:16.109433+0000","last_active":"2024-04-26T12:35:05.896180+0000","last_peered":"2024-04-26T12:35:05.896180+0000","last_clean":"2024-04-26T12:35:05.896180+0000","last_became_active":"2024-04-26T12:32:16.109171+0000","last_became_peered":"2024-04-26T12:32:16.109171+0000","last_unstale":"2024-04-26T12:35:05.896180+0000","last_undegraded":"2024-04-26T12:35:05.896180+0000","last_fullsized":"2024-04-26T12:35:05.896180+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:30.013002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893915+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:05.893915+0000","last_peered":"2024-04-26T12:35:05.893915+0000","last_clean":"2024-04-26T12:35:05.893915+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:05.893915+0000","last_undegraded":"2024-04-26T12:35:05.893915+0000","last_fullsized":"2024-04-26T12:35:05.893915+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893401+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:05.893401+0000","last_peered":"2024-04-26T12:35:05.893401+0000","last_clean":"2024-04-26T12:35:05.893401+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:05.893401+0000","last_undegraded":"2024-04-26T12:35:05.893401+0000","last_fullsized":"2024-04-26T12:35:05.893401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.891869+0000","last_change":"2024-04-26T12:35:03.190889+0000","last_active":"2024-04-26T12:35:05.891869+0000","last_peered":"2024-04-26T12:35:05.891869+0000","last_clean":"2024-04-26T12:35:05.891869+0000","last_became_active":"2024-04-26T12:35:03.189699+0000","last_became_peered":"2024-04-26T12:35:03.189699+0000","last_unstale":"2024-04-26T12:35:05.891869+0000","last_undegraded":"2024-04-26T12:35:05.891869+0000","last_fullsized":"2024-04-26T12:35:05.891869+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:58.599512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6174,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.901985+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:06.901985+0000","last_peered":"2024-04-26T12:35:06.901985+0000","last_clean":"2024-04-26T12:35:06.901985+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:06.901985+0000","last_undegraded":"2024-04-26T12:35:06.901985+0000","last_fullsized":"2024-04-26T12:35:06.901985+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:50.387270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895471+0000","last_change":"2024-04-26T12:32:16.109604+0000","last_active":"2024-04-26T12:35:05.895471+0000","last_peered":"2024-04-26T12:35:05.895471+0000","last_clean":"2024-04-26T12:35:05.895471+0000","last_became_active":"2024-04-26T12:32:16.109232+0000","last_became_peered":"2024-04-26T12:32:16.109232+0000","last_unstale":"2024-04-26T12:35:05.895471+0000","last_undegraded":"2024-04-26T12:35:05.895471+0000","last_fullsized":"2024-04-26T12:35:05.895471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:08.819922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898768+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:05.898768+0000","last_peered":"2024-04-26T12:35:05.898768+0000","last_clean":"2024-04-26T12:35:05.898768+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:05.898768+0000","last_undegraded":"2024-04-26T12:35:05.898768+0000","last_fullsized":"2024-04-26T12:35:05.898768+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":183,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895408+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:05.895408+0000","last_peered":"2024-04-26T12:35:05.895408+0000","last_clean":"2024-04-26T12:35:05.895408+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:05.895408+0000","last_undegraded":"2024-04-26T12:35:05.895408+0000","last_fullsized":"2024-04-26T12:35:05.895408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895338+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:05.895338+0000","last_peered":"2024-04-26T12:35:05.895338+0000","last_clean":"2024-04-26T12:35:05.895338+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:05.895338+0000","last_undegraded":"2024-04-26T12:35:05.895338+0000","last_fullsized":"2024-04-26T12:35:05.895338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":102,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895203+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:05.895203+0000","last_peered":"2024-04-26T12:35:05.895203+0000","last_clean":"2024-04-26T12:35:05.895203+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:05.895203+0000","last_undegraded":"2024-04-26T12:35:05.895203+0000","last_fullsized":"2024-04-26T12:35:05.895203+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2068,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.901287+0000","last_change":"2024-04-26T12:35:06.901287+0000","last_active":"2024-04-26T12:35:06.901287+0000","last_peered":"2024-04-26T12:35:06.901287+0000","last_clean":"2024-04-26T12:35:06.901287+0000","last_became_active":"2024-04-26T12:35:06.900482+0000","last_became_peered":"2024-04-26T12:35:06.900482+0000","last_unstale":"2024-04-26T12:35:06.901287+0000","last_undegraded":"2024-04-26T12:35:06.901287+0000","last_fullsized":"2024-04-26T12:35:06.901287+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:29.552035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.891157+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:05.891157+0000","last_peered":"2024-04-26T12:35:05.891157+0000","last_clean":"2024-04-26T12:35:05.891157+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:05.891157+0000","last_undegraded":"2024-04-26T12:35:05.891157+0000","last_fullsized":"2024-04-26T12:35:05.891157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2067,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898263+0000","last_change":"2024-04-26T12:35:05.897734+0000","last_active":"2024-04-26T12:35:05.898263+0000","last_peered":"2024-04-26T12:35:05.898263+0000","last_clean":"2024-04-26T12:35:05.898263+0000","last_became_active":"2024-04-26T12:35:05.897297+0000","last_became_peered":"2024-04-26T12:35:05.897297+0000","last_unstale":"2024-04-26T12:35:05.898263+0000","last_undegraded":"2024-04-26T12:35:05.898263+0000","last_fullsized":"2024-04-26T12:35:05.898263+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:22.684365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894511+0000","last_change":"2024-04-26T12:32:16.107025+0000","last_active":"2024-04-26T12:35:05.894511+0000","last_peered":"2024-04-26T12:35:05.894511+0000","last_clean":"2024-04-26T12:35:05.894511+0000","last_became_active":"2024-04-26T12:32:16.106307+0000","last_became_peered":"2024-04-26T12:32:16.106307+0000","last_unstale":"2024-04-26T12:35:05.894511+0000","last_undegraded":"2024-04-26T12:35:05.894511+0000","last_fullsized":"2024-04-26T12:35:05.894511+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:31.214495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893380+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:05.893380+0000","last_peered":"2024-04-26T12:35:05.893380+0000","last_clean":"2024-04-26T12:35:05.893380+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:05.893380+0000","last_undegraded":"2024-04-26T12:35:05.893380+0000","last_fullsized":"2024-04-26T12:35:05.893380+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":96,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895262+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:05.895262+0000","last_peered":"2024-04-26T12:35:05.895262+0000","last_clean":"2024-04-26T12:35:05.895262+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:05.895262+0000","last_undegraded":"2024-04-26T12:35:05.895262+0000","last_fullsized":"2024-04-26T12:35:05.895262+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2161,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.903189+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:06.903189+0000","last_peered":"2024-04-26T12:35:06.903189+0000","last_clean":"2024-04-26T12:35:06.903189+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:06.903189+0000","last_undegraded":"2024-04-26T12:35:06.903189+0000","last_fullsized":"2024-04-26T12:35:06.903189+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:50.006267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":89,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895714+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:05.895714+0000","last_peered":"2024-04-26T12:35:05.895714+0000","last_clean":"2024-04-26T12:35:05.895714+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:05.895714+0000","last_undegraded":"2024-04-26T12:35:05.895714+0000","last_fullsized":"2024-04-26T12:35:05.895714+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894052+0000","last_change":"2024-04-26T12:32:16.109694+0000","last_active":"2024-04-26T12:35:05.894052+0000","last_peered":"2024-04-26T12:35:05.894052+0000","last_clean":"2024-04-26T12:35:05.894052+0000","last_became_active":"2024-04-26T12:32:16.109070+0000","last_became_peered":"2024-04-26T12:32:16.109070+0000","last_unstale":"2024-04-26T12:35:05.894052+0000","last_undegraded":"2024-04-26T12:35:05.894052+0000","last_fullsized":"2024-04-26T12:35:05.894052+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:54.733914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":88,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.890067+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:05.890067+0000","last_peered":"2024-04-26T12:35:05.890067+0000","last_clean":"2024-04-26T12:35:05.890067+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:05.890067+0000","last_undegraded":"2024-04-26T12:35:05.890067+0000","last_fullsized":"2024-04-26T12:35:05.890067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.890507+0000","last_change":"2024-04-26T12:35:03.186376+0000","last_active":"2024-04-26T12:35:05.890507+0000","last_peered":"2024-04-26T12:35:05.890507+0000","last_clean":"2024-04-26T12:35:05.890507+0000","last_became_active":"2024-04-26T12:35:03.168583+0000","last_became_peered":"2024-04-26T12:35:03.168583+0000","last_unstale":"2024-04-26T12:35:05.890507+0000","last_undegraded":"2024-04-26T12:35:05.890507+0000","last_fullsized":"2024-04-26T12:35:05.890507+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:20.154397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.889611+0000","last_change":"2024-04-26T12:31:07.233438+0000","last_active":"2024-04-26T12:35:05.889611+0000","last_peered":"2024-04-26T12:35:05.889611+0000","last_clean":"2024-04-26T12:35:05.889611+0000","last_became_active":"2024-04-26T12:31:07.233207+0000","last_became_peered":"2024-04-26T12:31:07.233207+0000","last_unstale":"2024-04-26T12:35:05.889611+0000","last_undegraded":"2024-04-26T12:35:05.889611+0000","last_fullsized":"2024-04-26T12:35:05.889611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:25.561874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2103,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.904382+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:05.904382+0000","last_peered":"2024-04-26T12:35:05.904382+0000","last_clean":"2024-04-26T12:35:05.904382+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:05.904382+0000","last_undegraded":"2024-04-26T12:35:05.904382+0000","last_fullsized":"2024-04-26T12:35:05.904382+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895284+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:05.895284+0000","last_peered":"2024-04-26T12:35:05.895284+0000","last_clean":"2024-04-26T12:35:05.895284+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:05.895284+0000","last_undegraded":"2024-04-26T12:35:05.895284+0000","last_fullsized":"2024-04-26T12:35:05.895284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894812+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:05.894812+0000","last_peered":"2024-04-26T12:35:05.894812+0000","last_clean":"2024-04-26T12:35:05.894812+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:05.894812+0000","last_undegraded":"2024-04-26T12:35:05.894812+0000","last_fullsized":"2024-04-26T12:35:05.894812+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892320+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:05.892320+0000","last_peered":"2024-04-26T12:35:05.892320+0000","last_clean":"2024-04-26T12:35:05.892320+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:05.892320+0000","last_undegraded":"2024-04-26T12:35:05.892320+0000","last_fullsized":"2024-04-26T12:35:05.892320+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2091,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.907225+0000","last_change":"2024-04-26T12:35:05.902297+0000","last_active":"2024-04-26T12:35:05.907225+0000","last_peered":"2024-04-26T12:35:05.907225+0000","last_clean":"2024-04-26T12:35:05.907225+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:05.907225+0000","last_undegraded":"2024-04-26T12:35:05.907225+0000","last_fullsized":"2024-04-26T12:35:05.907225+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:37.434819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894659+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:05.894659+0000","last_peered":"2024-04-26T12:35:05.894659+0000","last_clean":"2024-04-26T12:35:05.894659+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:05.894659+0000","last_undegraded":"2024-04-26T12:35:05.894659+0000","last_fullsized":"2024-04-26T12:35:05.894659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2126,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895926+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:05.895926+0000","last_peered":"2024-04-26T12:35:05.895926+0000","last_clean":"2024-04-26T12:35:05.895926+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:05.895926+0000","last_undegraded":"2024-04-26T12:35:05.895926+0000","last_fullsized":"2024-04-26T12:35:05.895926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894778+0000","last_change":"2024-04-26T12:32:16.109449+0000","last_active":"2024-04-26T12:35:05.894778+0000","last_peered":"2024-04-26T12:35:05.894778+0000","last_clean":"2024-04-26T12:35:05.894778+0000","last_became_active":"2024-04-26T12:32:16.109131+0000","last_became_peered":"2024-04-26T12:32:16.109131+0000","last_unstale":"2024-04-26T12:35:05.894778+0000","last_undegraded":"2024-04-26T12:35:05.894778+0000","last_fullsized":"2024-04-26T12:35:05.894778+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:47.757728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895678+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:05.895678+0000","last_peered":"2024-04-26T12:35:05.895678+0000","last_clean":"2024-04-26T12:35:05.895678+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:05.895678+0000","last_undegraded":"2024-04-26T12:35:05.895678+0000","last_fullsized":"2024-04-26T12:35:05.895678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893200+0000","last_change":"2024-04-26T12:35:03.171996+0000","last_active":"2024-04-26T12:35:05.893200+0000","last_peered":"2024-04-26T12:35:05.893200+0000","last_clean":"2024-04-26T12:35:05.893200+0000","last_became_active":"2024-04-26T12:35:03.163038+0000","last_became_peered":"2024-04-26T12:35:03.163038+0000","last_unstale":"2024-04-26T12:35:05.893200+0000","last_undegraded":"2024-04-26T12:35:05.893200+0000","last_fullsized":"2024-04-26T12:35:05.893200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:29.580246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6176,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.903035+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:06.903035+0000","last_peered":"2024-04-26T12:35:06.903035+0000","last_clean":"2024-04-26T12:35:06.903035+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:06.903035+0000","last_undegraded":"2024-04-26T12:35:06.903035+0000","last_fullsized":"2024-04-26T12:35:06.903035+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:41.098435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893573+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:05.893573+0000","last_peered":"2024-04-26T12:35:05.893573+0000","last_clean":"2024-04-26T12:35:05.893573+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:05.893573+0000","last_undegraded":"2024-04-26T12:35:05.893573+0000","last_fullsized":"2024-04-26T12:35:05.893573+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895716+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:05.895716+0000","last_peered":"2024-04-26T12:35:05.895716+0000","last_clean":"2024-04-26T12:35:05.895716+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:05.895716+0000","last_undegraded":"2024-04-26T12:35:05.895716+0000","last_fullsized":"2024-04-26T12:35:05.895716+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":57,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894447+0000","last_change":"2024-04-26T12:32:16.107013+0000","last_active":"2024-04-26T12:35:05.894447+0000","last_peered":"2024-04-26T12:35:05.894447+0000","last_clean":"2024-04-26T12:35:05.894447+0000","last_became_active":"2024-04-26T12:32:16.106306+0000","last_became_peered":"2024-04-26T12:32:16.106306+0000","last_unstale":"2024-04-26T12:35:05.894447+0000","last_undegraded":"2024-04-26T12:35:05.894447+0000","last_fullsized":"2024-04-26T12:35:05.894447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:34.079328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895095+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:05.895095+0000","last_peered":"2024-04-26T12:35:05.895095+0000","last_clean":"2024-04-26T12:35:05.895095+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:05.895095+0000","last_undegraded":"2024-04-26T12:35:05.895095+0000","last_fullsized":"2024-04-26T12:35:05.895095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894899+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:05.894899+0000","last_peered":"2024-04-26T12:35:05.894899+0000","last_clean":"2024-04-26T12:35:05.894899+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:05.894899+0000","last_undegraded":"2024-04-26T12:35:05.894899+0000","last_fullsized":"2024-04-26T12:35:05.894899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892116+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:05.892116+0000","last_peered":"2024-04-26T12:35:05.892116+0000","last_clean":"2024-04-26T12:35:05.892116+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:05.892116+0000","last_undegraded":"2024-04-26T12:35:05.892116+0000","last_fullsized":"2024-04-26T12:35:05.892116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.891522+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:05.891522+0000","last_peered":"2024-04-26T12:35:05.891522+0000","last_clean":"2024-04-26T12:35:05.891522+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:05.891522+0000","last_undegraded":"2024-04-26T12:35:05.891522+0000","last_fullsized":"2024-04-26T12:35:05.891522+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":86,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.889030+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:05.889030+0000","last_peered":"2024-04-26T12:35:05.889030+0000","last_clean":"2024-04-26T12:35:05.889030+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:05.889030+0000","last_undegraded":"2024-04-26T12:35:05.889030+0000","last_fullsized":"2024-04-26T12:35:05.889030+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893880+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:05.893880+0000","last_peered":"2024-04-26T12:35:05.893880+0000","last_clean":"2024-04-26T12:35:05.893880+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:05.893880+0000","last_undegraded":"2024-04-26T12:35:05.893880+0000","last_fullsized":"2024-04-26T12:35:05.893880+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895066+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:05.895066+0000","last_peered":"2024-04-26T12:35:05.895066+0000","last_clean":"2024-04-26T12:35:05.895066+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:05.895066+0000","last_undegraded":"2024-04-26T12:35:05.895066+0000","last_fullsized":"2024-04-26T12:35:05.895066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":287,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895406+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:05.895406+0000","last_peered":"2024-04-26T12:35:05.895406+0000","last_clean":"2024-04-26T12:35:05.895406+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:05.895406+0000","last_undegraded":"2024-04-26T12:35:05.895406+0000","last_fullsized":"2024-04-26T12:35:05.895406+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892264+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:05.892264+0000","last_peered":"2024-04-26T12:35:05.892264+0000","last_clean":"2024-04-26T12:35:05.892264+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:05.892264+0000","last_undegraded":"2024-04-26T12:35:05.892264+0000","last_fullsized":"2024-04-26T12:35:05.892264+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895908+0000","last_change":"2024-04-26T12:32:16.106958+0000","last_active":"2024-04-26T12:35:05.895908+0000","last_peered":"2024-04-26T12:35:05.895908+0000","last_clean":"2024-04-26T12:35:05.895908+0000","last_became_active":"2024-04-26T12:32:16.106262+0000","last_became_peered":"2024-04-26T12:32:16.106262+0000","last_unstale":"2024-04-26T12:35:05.895908+0000","last_undegraded":"2024-04-26T12:35:05.895908+0000","last_fullsized":"2024-04-26T12:35:05.895908+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:33.467447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895024+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:05.895024+0000","last_peered":"2024-04-26T12:35:05.895024+0000","last_clean":"2024-04-26T12:35:05.895024+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:05.895024+0000","last_undegraded":"2024-04-26T12:35:05.895024+0000","last_fullsized":"2024-04-26T12:35:05.895024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892005+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:05.892005+0000","last_peered":"2024-04-26T12:35:05.892005+0000","last_clean":"2024-04-26T12:35:05.892005+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:05.892005+0000","last_undegraded":"2024-04-26T12:35:05.892005+0000","last_fullsized":"2024-04-26T12:35:05.892005+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8084,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.904117+0000","last_change":"2024-04-26T12:35:06.904117+0000","last_active":"2024-04-26T12:35:06.904117+0000","last_peered":"2024-04-26T12:35:06.904117+0000","last_clean":"2024-04-26T12:35:06.904117+0000","last_became_active":"2024-04-26T12:35:06.901646+0000","last_became_peered":"2024-04-26T12:35:06.901646+0000","last_unstale":"2024-04-26T12:35:06.904117+0000","last_undegraded":"2024-04-26T12:35:06.904117+0000","last_fullsized":"2024-04-26T12:35:06.904117+0000","mapping_epoch":89,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:09.109551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893583+0000","last_change":"2024-04-26T12:35:03.179164+0000","last_active":"2024-04-26T12:35:05.893583+0000","last_peered":"2024-04-26T12:35:05.893583+0000","last_clean":"2024-04-26T12:35:05.893583+0000","last_became_active":"2024-04-26T12:35:03.176940+0000","last_became_peered":"2024-04-26T12:35:03.176940+0000","last_unstale":"2024-04-26T12:35:05.893583+0000","last_undegraded":"2024-04-26T12:35:05.893583+0000","last_fullsized":"2024-04-26T12:35:05.893583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:29.707002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893361+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:05.893361+0000","last_peered":"2024-04-26T12:35:05.893361+0000","last_clean":"2024-04-26T12:35:05.893361+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:05.893361+0000","last_undegraded":"2024-04-26T12:35:05.893361+0000","last_fullsized":"2024-04-26T12:35:05.893361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2102,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894479+0000","last_change":"2024-04-26T12:32:16.109669+0000","last_active":"2024-04-26T12:35:05.894479+0000","last_peered":"2024-04-26T12:35:05.894479+0000","last_clean":"2024-04-26T12:35:05.894479+0000","last_became_active":"2024-04-26T12:32:16.109328+0000","last_became_peered":"2024-04-26T12:32:16.109328+0000","last_unstale":"2024-04-26T12:35:05.894479+0000","last_undegraded":"2024-04-26T12:35:05.894479+0000","last_fullsized":"2024-04-26T12:35:05.894479+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:32.967100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892257+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:05.892257+0000","last_peered":"2024-04-26T12:35:05.892257+0000","last_clean":"2024-04-26T12:35:05.892257+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:05.892257+0000","last_undegraded":"2024-04-26T12:35:05.892257+0000","last_fullsized":"2024-04-26T12:35:05.892257+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.891952+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:05.891952+0000","last_peered":"2024-04-26T12:35:05.891952+0000","last_clean":"2024-04-26T12:35:05.891952+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:05.891952+0000","last_undegraded":"2024-04-26T12:35:05.891952+0000","last_fullsized":"2024-04-26T12:35:05.891952+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.891957+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:05.891957+0000","last_peered":"2024-04-26T12:35:05.891957+0000","last_clean":"2024-04-26T12:35:05.891957+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:05.891957+0000","last_undegraded":"2024-04-26T12:35:05.891957+0000","last_fullsized":"2024-04-26T12:35:05.891957+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895913+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:05.895913+0000","last_peered":"2024-04-26T12:35:05.895913+0000","last_clean":"2024-04-26T12:35:05.895913+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:05.895913+0000","last_undegraded":"2024-04-26T12:35:05.895913+0000","last_fullsized":"2024-04-26T12:35:05.895913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":74,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892428+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:05.892428+0000","last_peered":"2024-04-26T12:35:05.892428+0000","last_clean":"2024-04-26T12:35:05.892428+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:05.892428+0000","last_undegraded":"2024-04-26T12:35:05.892428+0000","last_fullsized":"2024-04-26T12:35:05.892428+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":90,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.889216+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:05.889216+0000","last_peered":"2024-04-26T12:35:05.889216+0000","last_clean":"2024-04-26T12:35:05.889216+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:05.889216+0000","last_undegraded":"2024-04-26T12:35:05.889216+0000","last_fullsized":"2024-04-26T12:35:05.889216+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894606+0000","last_change":"2024-04-26T12:32:16.110117+0000","last_active":"2024-04-26T12:35:05.894606+0000","last_peered":"2024-04-26T12:35:05.894606+0000","last_clean":"2024-04-26T12:35:05.894606+0000","last_became_active":"2024-04-26T12:32:16.109893+0000","last_became_peered":"2024-04-26T12:32:16.109893+0000","last_unstale":"2024-04-26T12:35:05.894606+0000","last_undegraded":"2024-04-26T12:35:05.894606+0000","last_fullsized":"2024-04-26T12:35:05.894606+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:18.025832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2107,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T12:35:06.899177+0000","last_change":"2024-04-26T12:35:06.899177+0000","last_active":"2024-04-26T12:35:06.899177+0000","last_peered":"2024-04-26T12:35:06.899177+0000","last_clean":"2024-04-26T12:35:06.899177+0000","last_became_active":"2024-04-26T12:35:06.898181+0000","last_became_peered":"2024-04-26T12:35:06.898181+0000","last_unstale":"2024-04-26T12:35:06.899177+0000","last_undegraded":"2024-04-26T12:35:06.899177+0000","last_fullsized":"2024-04-26T12:35:06.899177+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:25.814599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":102,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895251+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:05.895251+0000","last_peered":"2024-04-26T12:35:05.895251+0000","last_clean":"2024-04-26T12:35:05.895251+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:05.895251+0000","last_undegraded":"2024-04-26T12:35:05.895251+0000","last_fullsized":"2024-04-26T12:35:05.895251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.904402+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:05.904402+0000","last_peered":"2024-04-26T12:35:05.904402+0000","last_clean":"2024-04-26T12:35:05.904402+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:05.904402+0000","last_undegraded":"2024-04-26T12:35:05.904402+0000","last_fullsized":"2024-04-26T12:35:05.904402+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:50.285275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895446+0000","last_change":"2024-04-26T12:32:16.110008+0000","last_active":"2024-04-26T12:35:05.895446+0000","last_peered":"2024-04-26T12:35:05.895446+0000","last_clean":"2024-04-26T12:35:05.895446+0000","last_became_active":"2024-04-26T12:32:16.109548+0000","last_became_peered":"2024-04-26T12:32:16.109548+0000","last_unstale":"2024-04-26T12:35:05.895446+0000","last_undegraded":"2024-04-26T12:35:05.895446+0000","last_fullsized":"2024-04-26T12:35:05.895446+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:54.045578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":106,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894770+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:05.894770+0000","last_peered":"2024-04-26T12:35:05.894770+0000","last_clean":"2024-04-26T12:35:05.894770+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:05.894770+0000","last_undegraded":"2024-04-26T12:35:05.894770+0000","last_fullsized":"2024-04-26T12:35:05.894770+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":67,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892042+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:05.892042+0000","last_peered":"2024-04-26T12:35:05.892042+0000","last_clean":"2024-04-26T12:35:05.892042+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:05.892042+0000","last_undegraded":"2024-04-26T12:35:05.892042+0000","last_fullsized":"2024-04-26T12:35:05.892042+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.896180+0000","last_change":"2024-04-26T12:35:05.895130+0000","last_active":"2024-04-26T12:35:05.896180+0000","last_peered":"2024-04-26T12:35:05.896180+0000","last_clean":"2024-04-26T12:35:05.896180+0000","last_became_active":"2024-04-26T12:35:05.893689+0000","last_became_peered":"2024-04-26T12:35:05.893689+0000","last_unstale":"2024-04-26T12:35:05.896180+0000","last_undegraded":"2024-04-26T12:35:05.896180+0000","last_fullsized":"2024-04-26T12:35:05.896180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:15.086674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.893973+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:05.893973+0000","last_peered":"2024-04-26T12:35:05.893973+0000","last_clean":"2024-04-26T12:35:05.893973+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:05.893973+0000","last_undegraded":"2024-04-26T12:35:05.893973+0000","last_fullsized":"2024-04-26T12:35:05.893973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2172,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895363+0000","last_change":"2024-04-26T12:32:26.265982+0000","last_active":"2024-04-26T12:35:05.895363+0000","last_peered":"2024-04-26T12:35:05.895363+0000","last_clean":"2024-04-26T12:35:05.895363+0000","last_became_active":"2024-04-26T12:32:26.264296+0000","last_became_peered":"2024-04-26T12:32:26.264296+0000","last_unstale":"2024-04-26T12:35:05.895363+0000","last_undegraded":"2024-04-26T12:35:05.895363+0000","last_fullsized":"2024-04-26T12:35:05.895363+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:25.897269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":109,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.895144+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:05.895144+0000","last_peered":"2024-04-26T12:35:05.895144+0000","last_clean":"2024-04-26T12:35:05.895144+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:05.895144+0000","last_undegraded":"2024-04-26T12:35:05.895144+0000","last_fullsized":"2024-04-26T12:35:05.895144+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":65,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.892148+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:05.892148+0000","last_peered":"2024-04-26T12:35:05.892148+0000","last_clean":"2024-04-26T12:35:05.892148+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:05.892148+0000","last_undegraded":"2024-04-26T12:35:05.892148+0000","last_fullsized":"2024-04-26T12:35:05.892148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2035,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.894312+0000","last_change":"2024-04-26T12:32:16.107224+0000","last_active":"2024-04-26T12:35:05.894312+0000","last_peered":"2024-04-26T12:35:05.894312+0000","last_clean":"2024-04-26T12:35:05.894312+0000","last_became_active":"2024-04-26T12:32:16.106255+0000","last_became_peered":"2024-04-26T12:32:16.106255+0000","last_unstale":"2024-04-26T12:35:05.894312+0000","last_undegraded":"2024-04-26T12:35:05.894312+0000","last_fullsized":"2024-04-26T12:35:05.894312+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:01.140990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.898460+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:05.898460+0000","last_peered":"2024-04-26T12:35:05.898460+0000","last_clean":"2024-04-26T12:35:05.898460+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:05.898460+0000","last_undegraded":"2024-04-26T12:35:05.898460+0000","last_fullsized":"2024-04-26T12:35:05.898460+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2129,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T12:35:05.890439+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:05.890439+0000","last_peered":"2024-04-26T12:35:05.890439+0000","last_clean":"2024-04-26T12:35:05.890439+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:05.890439+0000","last_undegraded":"2024-04-26T12:35:05.890439+0000","last_fullsized":"2024-04-26T12:35:05.890439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120717,"ondisk_log_size":120717,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738427,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142928,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228912,"statfs":{"total":96636764160,"available":95466405888,"internally_reserved":0,"allocated":1110016,"data_stored":1245101,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.432},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.38}]}]},{"osd":0,"up_from":85,"seq":365072220163,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52600,"kb_used_data":748,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319240,"statfs":{"total":96636764160,"available":96582901760,"internally_reserved":0,"allocated":765952,"data_stored":371517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511112,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860728,"statfs":{"total":96636764160,"available":95089385472,"internally_reserved":0,"allocated":1101824,"data_stored":1245992,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.443},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:34:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.436},"min":{"1min":0.33900000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.372,"5min":0.188,"15min":0.188},"max":{"1min":0.70199999999999996,"5min":1.137,"15min":1.137},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:15.338 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:35:15.338 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:35:15.339 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-04-26T12:35:15.339 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-04-26T12:35:16.159 INFO:tasks.ceph.mon.a.smithi038.stderr:2024-04-26T12:35:16.158+0000 7f350f93e700 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-04-26T12:35:16.174 INFO:teuthology.orchestra.run.smithi038.stderr:osd set-full-ratio 0.001 2024-04-26T12:35:17.191 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-04-26T12:35:17.191 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-04-26T12:35:18.196 INFO:teuthology.orchestra.run.smithi038.stderr:osd set-full-ratio 0.95 2024-04-26T12:35:23.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T12:35:23.372 INFO:teuthology.orchestra.run.smithi038.stdout:mon.a: {} 2024-04-26T12:35:23.382 INFO:teuthology.orchestra.run.smithi038.stdout:mon.b: {} 2024-04-26T12:35:23.392 INFO:teuthology.orchestra.run.smithi038.stdout:mon.c: {} 2024-04-26T12:35:23.394 INFO:teuthology.orchestra.run.smithi038.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:35:23.394 INFO:teuthology.orchestra.run.smithi038.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:35:23.394 INFO:teuthology.orchestra.run.smithi038.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:35:23.407 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:35:24.135 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:35:24.151 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T12:35:25.160 INFO:teuthology.orchestra.run.smithi038.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T12:35:25.175 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:35:26.161 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:35:26.176 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T12:35:27.184 INFO:teuthology.orchestra.run.smithi038.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T12:35:27.200 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:35:28.213 INFO:teuthology.orchestra.run.smithi038.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:35:28.230 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T12:35:29.229 INFO:teuthology.orchestra.run.smithi038.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T12:35:29.246 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T12:35:29.246 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T12:35:29.246 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T12:35:29.246 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T12:35:29.247 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:35:29.247 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:35:29.616 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:29.616 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":98,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:35:29.214507+0000","last_up_change":"2024-04-26T12:35:02.136525+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":63,"up_from":85,"up_thru":89,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":5978},{"type":"v1","addr":"172.21.15.98:6801","nonce":5978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":5978},{"type":"v1","addr":"172.21.15.98:6803","nonce":5978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":5978},{"type":"v1","addr":"172.21.15.98:6807","nonce":5978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":5978},{"type":"v1","addr":"172.21.15.98:6805","nonce":5978}]},"public_addr":"172.21.15.98:6801/5978","cluster_addr":"172.21.15.98:6803/5978","heartbeat_back_addr":"172.21.15.98:6807/5978","heartbeat_front_addr":"172.21.15.98:6805/5978","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":63},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.18","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:35:29.635 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:35:29.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:35:29.999 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:29.999 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":98,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:35:29.214507+0000","last_up_change":"2024-04-26T12:35:02.136525+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":63,"up_from":85,"up_thru":89,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":5978},{"type":"v1","addr":"172.21.15.98:6801","nonce":5978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":5978},{"type":"v1","addr":"172.21.15.98:6803","nonce":5978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":5978},{"type":"v1","addr":"172.21.15.98:6807","nonce":5978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":5978},{"type":"v1","addr":"172.21.15.98:6805","nonce":5978}]},"public_addr":"172.21.15.98:6801/5978","cluster_addr":"172.21.15.98:6803/5978","heartbeat_back_addr":"172.21.15.98:6807/5978","heartbeat_front_addr":"172.21.15.98:6805/5978","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":63},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.18","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:35:30.015 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:35:30.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:35:30.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:35:30.205 INFO:teuthology.orchestra.run.smithi038.stdout:34359738433 2024-04-26T12:35:30.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:35:30.210 INFO:teuthology.orchestra.run.smithi038.stdout:34359738432 2024-04-26T12:35:30.210 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:35:30.211 INFO:teuthology.orchestra.run.smithi038.stdout:365072220167 2024-04-26T12:35:30.211 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:35:30.588 INFO:teuthology.orchestra.run.smithi038.stdout:34359738431 2024-04-26T12:35:30.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738433 got 34359738431 for osd.1 2024-04-26T12:35:30.627 INFO:teuthology.orchestra.run.smithi038.stdout:365072220166 2024-04-26T12:35:30.634 INFO:teuthology.orchestra.run.smithi038.stdout:34359738430 2024-04-26T12:35:30.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 365072220167 got 365072220166 for osd.0 2024-04-26T12:35:30.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738432 got 34359738430 for osd.2 2024-04-26T12:35:31.607 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:35:31.652 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:35:31.659 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:35:32.023 INFO:teuthology.orchestra.run.smithi038.stdout:34359738433 2024-04-26T12:35:32.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738433 got 34359738433 for osd.1 2024-04-26T12:35:32.040 DEBUG:teuthology.parallel:result is None 2024-04-26T12:35:32.041 INFO:teuthology.orchestra.run.smithi038.stdout:365072220167 2024-04-26T12:35:32.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 365072220167 got 365072220167 for osd.0 2024-04-26T12:35:32.058 DEBUG:teuthology.parallel:result is None 2024-04-26T12:35:32.107 INFO:teuthology.orchestra.run.smithi038.stdout:34359738432 2024-04-26T12:35:32.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738432 got 34359738432 for osd.2 2024-04-26T12:35:32.124 DEBUG:teuthology.parallel:result is None 2024-04-26T12:35:32.124 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:35:32.125 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:32.497 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:32.499 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:32.510 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-04-26T12:35:31.049812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119321,"ondisk_log_size":119321,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706820,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408700,"statfs":{"total":289910292480,"available":287138508800,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.894262"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2083,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208960+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:28.208960+0000","last_peered":"2024-04-26T12:35:28.208960+0000","last_clean":"2024-04-26T12:35:28.208960+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:28.208960+0000","last_undegraded":"2024-04-26T12:35:28.208960+0000","last_fullsized":"2024-04-26T12:35:28.208960+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:30.341356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208831+0000","last_change":"2024-04-26T12:35:26.170471+0000","last_active":"2024-04-26T12:35:28.208831+0000","last_peered":"2024-04-26T12:35:28.208831+0000","last_clean":"2024-04-26T12:35:28.208831+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:28.208831+0000","last_undegraded":"2024-04-26T12:35:28.208831+0000","last_fullsized":"2024-04-26T12:35:28.208831+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4131,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213004+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:28.213004+0000","last_peered":"2024-04-26T12:35:28.213004+0000","last_clean":"2024-04-26T12:35:28.213004+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:28.213004+0000","last_undegraded":"2024-04-26T12:35:28.213004+0000","last_fullsized":"2024-04-26T12:35:28.213004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212620+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:28.212620+0000","last_peered":"2024-04-26T12:35:28.212620+0000","last_clean":"2024-04-26T12:35:28.212620+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:28.212620+0000","last_undegraded":"2024-04-26T12:35:28.212620+0000","last_fullsized":"2024-04-26T12:35:28.212620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2154,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208571+0000","last_change":"2024-04-26T12:35:26.167949+0000","last_active":"2024-04-26T12:35:28.208571+0000","last_peered":"2024-04-26T12:35:28.208571+0000","last_clean":"2024-04-26T12:35:28.208571+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:35:28.208571+0000","last_undegraded":"2024-04-26T12:35:28.208571+0000","last_fullsized":"2024-04-26T12:35:28.208571+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:10.256259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214572+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:28.214572+0000","last_peered":"2024-04-26T12:35:28.214572+0000","last_clean":"2024-04-26T12:35:28.214572+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:28.214572+0000","last_undegraded":"2024-04-26T12:35:28.214572+0000","last_fullsized":"2024-04-26T12:35:28.214572+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:22.116087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214925+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:28.214925+0000","last_peered":"2024-04-26T12:35:28.214925+0000","last_clean":"2024-04-26T12:35:28.214925+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:28.214925+0000","last_undegraded":"2024-04-26T12:35:28.214925+0000","last_fullsized":"2024-04-26T12:35:28.214925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:19.062004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8204,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211343+0000","last_change":"2024-04-26T12:35:06.903708+0000","last_active":"2024-04-26T12:35:28.211343+0000","last_peered":"2024-04-26T12:35:28.211343+0000","last_clean":"2024-04-26T12:35:28.211343+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:28.211343+0000","last_undegraded":"2024-04-26T12:35:28.211343+0000","last_fullsized":"2024-04-26T12:35:28.211343+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211204+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:28.211204+0000","last_peered":"2024-04-26T12:35:28.211204+0000","last_clean":"2024-04-26T12:35:28.211204+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:28.211204+0000","last_undegraded":"2024-04-26T12:35:28.211204+0000","last_fullsized":"2024-04-26T12:35:28.211204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:49.537738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6240,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208908+0000","last_change":"2024-04-26T12:35:26.170653+0000","last_active":"2024-04-26T12:35:28.208908+0000","last_peered":"2024-04-26T12:35:28.208908+0000","last_clean":"2024-04-26T12:35:28.208908+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:28.208908+0000","last_undegraded":"2024-04-26T12:35:28.208908+0000","last_fullsized":"2024-04-26T12:35:28.208908+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:48.807860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240430+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:29.240430+0000","last_peered":"2024-04-26T12:35:29.240430+0000","last_clean":"2024-04-26T12:35:29.240430+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:29.240430+0000","last_undegraded":"2024-04-26T12:35:29.240430+0000","last_fullsized":"2024-04-26T12:35:29.240430+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:03.142930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2093,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208562+0000","last_change":"2024-04-26T12:35:26.168307+0000","last_active":"2024-04-26T12:35:28.208562+0000","last_peered":"2024-04-26T12:35:28.208562+0000","last_clean":"2024-04-26T12:35:28.208562+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:28.208562+0000","last_undegraded":"2024-04-26T12:35:28.208562+0000","last_fullsized":"2024-04-26T12:35:28.208562+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:10.743574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2138,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208382+0000","last_change":"2024-04-26T12:35:26.167308+0000","last_active":"2024-04-26T12:35:28.208382+0000","last_peered":"2024-04-26T12:35:28.208382+0000","last_clean":"2024-04-26T12:35:28.208382+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:35:28.208382+0000","last_undegraded":"2024-04-26T12:35:28.208382+0000","last_fullsized":"2024-04-26T12:35:28.208382+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:55.062566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2147,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212441+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:28.212441+0000","last_peered":"2024-04-26T12:35:28.212441+0000","last_clean":"2024-04-26T12:35:28.212441+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:28.212441+0000","last_undegraded":"2024-04-26T12:35:28.212441+0000","last_fullsized":"2024-04-26T12:35:28.212441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2166,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211989+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:28.211989+0000","last_peered":"2024-04-26T12:35:28.211989+0000","last_clean":"2024-04-26T12:35:28.211989+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:28.211989+0000","last_undegraded":"2024-04-26T12:35:28.211989+0000","last_fullsized":"2024-04-26T12:35:28.211989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239840+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:29.239840+0000","last_peered":"2024-04-26T12:35:29.239840+0000","last_clean":"2024-04-26T12:35:29.239840+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:29.239840+0000","last_undegraded":"2024-04-26T12:35:29.239840+0000","last_fullsized":"2024-04-26T12:35:29.239840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:42.219006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2118,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211167+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:28.211167+0000","last_peered":"2024-04-26T12:35:28.211167+0000","last_clean":"2024-04-26T12:35:28.211167+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:28.211167+0000","last_undegraded":"2024-04-26T12:35:28.211167+0000","last_fullsized":"2024-04-26T12:35:28.211167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:52.856014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2140,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209159+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:28.209159+0000","last_peered":"2024-04-26T12:35:28.209159+0000","last_clean":"2024-04-26T12:35:28.209159+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:28.209159+0000","last_undegraded":"2024-04-26T12:35:28.209159+0000","last_fullsized":"2024-04-26T12:35:28.209159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4098,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210794+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:28.210794+0000","last_peered":"2024-04-26T12:35:28.210794+0000","last_clean":"2024-04-26T12:35:28.210794+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:28.210794+0000","last_undegraded":"2024-04-26T12:35:28.210794+0000","last_fullsized":"2024-04-26T12:35:28.210794+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.866275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4222,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212532+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:28.212532+0000","last_peered":"2024-04-26T12:35:28.212532+0000","last_clean":"2024-04-26T12:35:28.212532+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:28.212532+0000","last_undegraded":"2024-04-26T12:35:28.212532+0000","last_fullsized":"2024-04-26T12:35:28.212532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:03.877816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211555+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:28.211555+0000","last_peered":"2024-04-26T12:35:28.211555+0000","last_clean":"2024-04-26T12:35:28.211555+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:28.211555+0000","last_undegraded":"2024-04-26T12:35:28.211555+0000","last_fullsized":"2024-04-26T12:35:28.211555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208329+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:28.208329+0000","last_peered":"2024-04-26T12:35:28.208329+0000","last_clean":"2024-04-26T12:35:28.208329+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:28.208329+0000","last_undegraded":"2024-04-26T12:35:28.208329+0000","last_fullsized":"2024-04-26T12:35:28.208329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210072+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:28.210072+0000","last_peered":"2024-04-26T12:35:28.210072+0000","last_clean":"2024-04-26T12:35:28.210072+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:28.210072+0000","last_undegraded":"2024-04-26T12:35:28.210072+0000","last_fullsized":"2024-04-26T12:35:28.210072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4139,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208389+0000","last_change":"2024-04-26T12:35:26.165413+0000","last_active":"2024-04-26T12:35:28.208389+0000","last_peered":"2024-04-26T12:35:28.208389+0000","last_clean":"2024-04-26T12:35:28.208389+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:35:28.208389+0000","last_undegraded":"2024-04-26T12:35:28.208389+0000","last_fullsized":"2024-04-26T12:35:28.208389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.367083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2141,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209087+0000","last_change":"2024-04-26T12:35:26.170324+0000","last_active":"2024-04-26T12:35:28.209087+0000","last_peered":"2024-04-26T12:35:28.209087+0000","last_clean":"2024-04-26T12:35:28.209087+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:28.209087+0000","last_undegraded":"2024-04-26T12:35:28.209087+0000","last_fullsized":"2024-04-26T12:35:28.209087+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:58.838513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211224+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:28.211224+0000","last_peered":"2024-04-26T12:35:28.211224+0000","last_clean":"2024-04-26T12:35:28.211224+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:28.211224+0000","last_undegraded":"2024-04-26T12:35:28.211224+0000","last_fullsized":"2024-04-26T12:35:28.211224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2101,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212916+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:28.212916+0000","last_peered":"2024-04-26T12:35:28.212916+0000","last_clean":"2024-04-26T12:35:28.212916+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:28.212916+0000","last_undegraded":"2024-04-26T12:35:28.212916+0000","last_fullsized":"2024-04-26T12:35:28.212916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208583+0000","last_change":"2024-04-26T12:35:26.165397+0000","last_active":"2024-04-26T12:35:28.208583+0000","last_peered":"2024-04-26T12:35:28.208583+0000","last_clean":"2024-04-26T12:35:28.208583+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:35:28.208583+0000","last_undegraded":"2024-04-26T12:35:28.208583+0000","last_fullsized":"2024-04-26T12:35:28.208583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:11.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209095+0000","last_change":"2024-04-26T12:35:26.166754+0000","last_active":"2024-04-26T12:35:28.209095+0000","last_peered":"2024-04-26T12:35:28.209095+0000","last_clean":"2024-04-26T12:35:28.209095+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:28.209095+0000","last_undegraded":"2024-04-26T12:35:28.209095+0000","last_fullsized":"2024-04-26T12:35:28.209095+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:52.222681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209874+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:28.209874+0000","last_peered":"2024-04-26T12:35:28.209874+0000","last_clean":"2024-04-26T12:35:28.209874+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:28.209874+0000","last_undegraded":"2024-04-26T12:35:28.209874+0000","last_fullsized":"2024-04-26T12:35:28.209874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211032+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:28.211032+0000","last_peered":"2024-04-26T12:35:28.211032+0000","last_clean":"2024-04-26T12:35:28.211032+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:28.211032+0000","last_undegraded":"2024-04-26T12:35:28.211032+0000","last_fullsized":"2024-04-26T12:35:28.211032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209808+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:28.209808+0000","last_peered":"2024-04-26T12:35:28.209808+0000","last_clean":"2024-04-26T12:35:28.209808+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:28.209808+0000","last_undegraded":"2024-04-26T12:35:28.209808+0000","last_fullsized":"2024-04-26T12:35:28.209808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209274+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:28.209274+0000","last_peered":"2024-04-26T12:35:28.209274+0000","last_clean":"2024-04-26T12:35:28.209274+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:28.209274+0000","last_undegraded":"2024-04-26T12:35:28.209274+0000","last_fullsized":"2024-04-26T12:35:28.209274+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:19.816252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210919+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:28.210919+0000","last_peered":"2024-04-26T12:35:28.210919+0000","last_clean":"2024-04-26T12:35:28.210919+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:28.210919+0000","last_undegraded":"2024-04-26T12:35:28.210919+0000","last_fullsized":"2024-04-26T12:35:28.210919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210388+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:28.210388+0000","last_peered":"2024-04-26T12:35:28.210388+0000","last_clean":"2024-04-26T12:35:28.210388+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:28.210388+0000","last_undegraded":"2024-04-26T12:35:28.210388+0000","last_fullsized":"2024-04-26T12:35:28.210388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240723+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:29.240723+0000","last_peered":"2024-04-26T12:35:29.240723+0000","last_clean":"2024-04-26T12:35:29.240723+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:29.240723+0000","last_undegraded":"2024-04-26T12:35:29.240723+0000","last_fullsized":"2024-04-26T12:35:29.240723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:38.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6182,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209958+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:28.209958+0000","last_peered":"2024-04-26T12:35:28.209958+0000","last_clean":"2024-04-26T12:35:28.209958+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:28.209958+0000","last_undegraded":"2024-04-26T12:35:28.209958+0000","last_fullsized":"2024-04-26T12:35:28.209958+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:50.387270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209285+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:28.209285+0000","last_peered":"2024-04-26T12:35:28.209285+0000","last_clean":"2024-04-26T12:35:28.209285+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:28.209285+0000","last_undegraded":"2024-04-26T12:35:28.209285+0000","last_fullsized":"2024-04-26T12:35:28.209285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:53.309649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4162,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210081+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:28.210081+0000","last_peered":"2024-04-26T12:35:28.210081+0000","last_clean":"2024-04-26T12:35:28.210081+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:28.210081+0000","last_undegraded":"2024-04-26T12:35:28.210081+0000","last_fullsized":"2024-04-26T12:35:28.210081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":192,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212508+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:28.212508+0000","last_peered":"2024-04-26T12:35:28.212508+0000","last_clean":"2024-04-26T12:35:28.212508+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:28.212508+0000","last_undegraded":"2024-04-26T12:35:28.212508+0000","last_fullsized":"2024-04-26T12:35:28.212508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4189,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212280+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:28.212280+0000","last_peered":"2024-04-26T12:35:28.212280+0000","last_clean":"2024-04-26T12:35:28.212280+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:28.212280+0000","last_undegraded":"2024-04-26T12:35:28.212280+0000","last_fullsized":"2024-04-26T12:35:28.212280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212311+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:28.212311+0000","last_peered":"2024-04-26T12:35:28.212311+0000","last_clean":"2024-04-26T12:35:28.212311+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:28.212311+0000","last_undegraded":"2024-04-26T12:35:28.212311+0000","last_fullsized":"2024-04-26T12:35:28.212311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2081,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208726+0000","last_change":"2024-04-26T12:35:26.166921+0000","last_active":"2024-04-26T12:35:28.208726+0000","last_peered":"2024-04-26T12:35:28.208726+0000","last_clean":"2024-04-26T12:35:28.208726+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:35:28.208726+0000","last_undegraded":"2024-04-26T12:35:28.208726+0000","last_fullsized":"2024-04-26T12:35:28.208726+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2078,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209347+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:28.209347+0000","last_peered":"2024-04-26T12:35:28.209347+0000","last_clean":"2024-04-26T12:35:28.209347+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:28.209347+0000","last_undegraded":"2024-04-26T12:35:28.209347+0000","last_fullsized":"2024-04-26T12:35:28.209347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:37.025987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208419+0000","last_change":"2024-04-26T12:35:26.163714+0000","last_active":"2024-04-26T12:35:28.208419+0000","last_peered":"2024-04-26T12:35:28.208419+0000","last_clean":"2024-04-26T12:35:28.208419+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:35:28.208419+0000","last_undegraded":"2024-04-26T12:35:28.208419+0000","last_fullsized":"2024-04-26T12:35:28.208419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:56.750192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211123+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:28.211123+0000","last_peered":"2024-04-26T12:35:28.211123+0000","last_clean":"2024-04-26T12:35:28.211123+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:28.211123+0000","last_undegraded":"2024-04-26T12:35:28.211123+0000","last_fullsized":"2024-04-26T12:35:28.211123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":105,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211774+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:28.211774+0000","last_peered":"2024-04-26T12:35:28.211774+0000","last_clean":"2024-04-26T12:35:28.211774+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:28.211774+0000","last_undegraded":"2024-04-26T12:35:28.211774+0000","last_fullsized":"2024-04-26T12:35:28.211774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2169,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211139+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:28.211139+0000","last_peered":"2024-04-26T12:35:28.211139+0000","last_clean":"2024-04-26T12:35:28.211139+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:28.211139+0000","last_undegraded":"2024-04-26T12:35:28.211139+0000","last_fullsized":"2024-04-26T12:35:28.211139+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:50.006267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":97,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212429+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:28.212429+0000","last_peered":"2024-04-26T12:35:28.212429+0000","last_clean":"2024-04-26T12:35:28.212429+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:28.212429+0000","last_undegraded":"2024-04-26T12:35:28.212429+0000","last_fullsized":"2024-04-26T12:35:28.212429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208506+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:28.208506+0000","last_peered":"2024-04-26T12:35:28.208506+0000","last_clean":"2024-04-26T12:35:28.208506+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:28.208506+0000","last_undegraded":"2024-04-26T12:35:28.208506+0000","last_fullsized":"2024-04-26T12:35:28.208506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:14.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208961+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:28.208961+0000","last_peered":"2024-04-26T12:35:28.208961+0000","last_clean":"2024-04-26T12:35:28.208961+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:28.208961+0000","last_undegraded":"2024-04-26T12:35:28.208961+0000","last_fullsized":"2024-04-26T12:35:28.208961+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208600+0000","last_change":"2024-04-26T12:35:26.165209+0000","last_active":"2024-04-26T12:35:28.208600+0000","last_peered":"2024-04-26T12:35:28.208600+0000","last_clean":"2024-04-26T12:35:28.208600+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:28.208600+0000","last_undegraded":"2024-04-26T12:35:28.208600+0000","last_fullsized":"2024-04-26T12:35:28.208600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:19.522824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":30,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240548+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:29.240548+0000","last_peered":"2024-04-26T12:35:29.240548+0000","last_clean":"2024-04-26T12:35:29.240548+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:29.240548+0000","last_undegraded":"2024-04-26T12:35:29.240548+0000","last_fullsized":"2024-04-26T12:35:29.240548+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:42.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211821+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:28.211821+0000","last_peered":"2024-04-26T12:35:28.211821+0000","last_clean":"2024-04-26T12:35:28.211821+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:28.211821+0000","last_undegraded":"2024-04-26T12:35:28.211821+0000","last_fullsized":"2024-04-26T12:35:28.211821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211859+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:28.211859+0000","last_peered":"2024-04-26T12:35:28.211859+0000","last_clean":"2024-04-26T12:35:28.211859+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:28.211859+0000","last_undegraded":"2024-04-26T12:35:28.211859+0000","last_fullsized":"2024-04-26T12:35:28.211859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210318+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:28.210318+0000","last_peered":"2024-04-26T12:35:28.210318+0000","last_clean":"2024-04-26T12:35:28.210318+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:28.210318+0000","last_undegraded":"2024-04-26T12:35:28.210318+0000","last_fullsized":"2024-04-26T12:35:28.210318+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212057+0000","last_change":"2024-04-26T12:35:05.902297+0000","last_active":"2024-04-26T12:35:28.212057+0000","last_peered":"2024-04-26T12:35:28.212057+0000","last_clean":"2024-04-26T12:35:28.212057+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:28.212057+0000","last_undegraded":"2024-04-26T12:35:28.212057+0000","last_fullsized":"2024-04-26T12:35:28.212057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:37.434819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211660+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:28.211660+0000","last_peered":"2024-04-26T12:35:28.211660+0000","last_clean":"2024-04-26T12:35:28.211660+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:28.211660+0000","last_undegraded":"2024-04-26T12:35:28.211660+0000","last_fullsized":"2024-04-26T12:35:28.211660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2134,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213133+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:28.213133+0000","last_peered":"2024-04-26T12:35:28.213133+0000","last_clean":"2024-04-26T12:35:28.213133+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:28.213133+0000","last_undegraded":"2024-04-26T12:35:28.213133+0000","last_fullsized":"2024-04-26T12:35:28.213133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208228+0000","last_change":"2024-04-26T12:35:26.161621+0000","last_active":"2024-04-26T12:35:28.208228+0000","last_peered":"2024-04-26T12:35:28.208228+0000","last_clean":"2024-04-26T12:35:28.208228+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:35:28.208228+0000","last_undegraded":"2024-04-26T12:35:28.208228+0000","last_fullsized":"2024-04-26T12:35:28.208228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:44.708029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212154+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:28.212154+0000","last_peered":"2024-04-26T12:35:28.212154+0000","last_clean":"2024-04-26T12:35:28.212154+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:28.212154+0000","last_undegraded":"2024-04-26T12:35:28.212154+0000","last_fullsized":"2024-04-26T12:35:28.212154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208344+0000","last_change":"2024-04-26T12:35:26.163568+0000","last_active":"2024-04-26T12:35:28.208344+0000","last_peered":"2024-04-26T12:35:28.208344+0000","last_clean":"2024-04-26T12:35:28.208344+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:35:28.208344+0000","last_undegraded":"2024-04-26T12:35:28.208344+0000","last_fullsized":"2024-04-26T12:35:28.208344+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:01.190879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211076+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:28.211076+0000","last_peered":"2024-04-26T12:35:28.211076+0000","last_clean":"2024-04-26T12:35:28.211076+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:28.211076+0000","last_undegraded":"2024-04-26T12:35:28.211076+0000","last_fullsized":"2024-04-26T12:35:28.211076+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:41.098435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210635+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:28.210635+0000","last_peered":"2024-04-26T12:35:28.210635+0000","last_clean":"2024-04-26T12:35:28.210635+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:28.210635+0000","last_undegraded":"2024-04-26T12:35:28.210635+0000","last_fullsized":"2024-04-26T12:35:28.210635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212994+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:28.212994+0000","last_peered":"2024-04-26T12:35:28.212994+0000","last_clean":"2024-04-26T12:35:28.212994+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:28.212994+0000","last_undegraded":"2024-04-26T12:35:28.212994+0000","last_fullsized":"2024-04-26T12:35:28.212994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208687+0000","last_change":"2024-04-26T12:35:26.163875+0000","last_active":"2024-04-26T12:35:28.208687+0000","last_peered":"2024-04-26T12:35:28.208687+0000","last_clean":"2024-04-26T12:35:28.208687+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:35:28.208687+0000","last_undegraded":"2024-04-26T12:35:28.208687+0000","last_fullsized":"2024-04-26T12:35:28.208687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:05.697046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212247+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:28.212247+0000","last_peered":"2024-04-26T12:35:28.212247+0000","last_clean":"2024-04-26T12:35:28.212247+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:28.212247+0000","last_undegraded":"2024-04-26T12:35:28.212247+0000","last_fullsized":"2024-04-26T12:35:28.212247+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211893+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:28.211893+0000","last_peered":"2024-04-26T12:35:28.211893+0000","last_clean":"2024-04-26T12:35:28.211893+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:28.211893+0000","last_undegraded":"2024-04-26T12:35:28.211893+0000","last_fullsized":"2024-04-26T12:35:28.211893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210480+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:28.210480+0000","last_peered":"2024-04-26T12:35:28.210480+0000","last_clean":"2024-04-26T12:35:28.210480+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:28.210480+0000","last_undegraded":"2024-04-26T12:35:28.210480+0000","last_fullsized":"2024-04-26T12:35:28.210480+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210119+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:28.210119+0000","last_peered":"2024-04-26T12:35:28.210119+0000","last_clean":"2024-04-26T12:35:28.210119+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:28.210119+0000","last_undegraded":"2024-04-26T12:35:28.210119+0000","last_fullsized":"2024-04-26T12:35:28.210119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210995+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:28.210995+0000","last_peered":"2024-04-26T12:35:28.210995+0000","last_clean":"2024-04-26T12:35:28.210995+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:28.210995+0000","last_undegraded":"2024-04-26T12:35:28.210995+0000","last_fullsized":"2024-04-26T12:35:28.210995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212150+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:28.212150+0000","last_peered":"2024-04-26T12:35:28.212150+0000","last_clean":"2024-04-26T12:35:28.212150+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:28.212150+0000","last_undegraded":"2024-04-26T12:35:28.212150+0000","last_fullsized":"2024-04-26T12:35:28.212150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211472+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:28.211472+0000","last_peered":"2024-04-26T12:35:28.211472+0000","last_clean":"2024-04-26T12:35:28.211472+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:28.211472+0000","last_undegraded":"2024-04-26T12:35:28.211472+0000","last_fullsized":"2024-04-26T12:35:28.211472+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210224+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:28.210224+0000","last_peered":"2024-04-26T12:35:28.210224+0000","last_clean":"2024-04-26T12:35:28.210224+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:28.210224+0000","last_undegraded":"2024-04-26T12:35:28.210224+0000","last_fullsized":"2024-04-26T12:35:28.210224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.216208+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:28.216208+0000","last_peered":"2024-04-26T12:35:28.216208+0000","last_clean":"2024-04-26T12:35:28.216208+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:28.216208+0000","last_undegraded":"2024-04-26T12:35:28.216208+0000","last_fullsized":"2024-04-26T12:35:28.216208+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:21.559371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211736+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:28.211736+0000","last_peered":"2024-04-26T12:35:28.211736+0000","last_clean":"2024-04-26T12:35:28.211736+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:28.211736+0000","last_undegraded":"2024-04-26T12:35:28.211736+0000","last_fullsized":"2024-04-26T12:35:28.211736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210256+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:28.210256+0000","last_peered":"2024-04-26T12:35:28.210256+0000","last_clean":"2024-04-26T12:35:28.210256+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:28.210256+0000","last_undegraded":"2024-04-26T12:35:28.210256+0000","last_fullsized":"2024-04-26T12:35:28.210256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8089,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209089+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:28.209089+0000","last_peered":"2024-04-26T12:35:28.209089+0000","last_clean":"2024-04-26T12:35:28.209089+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:28.209089+0000","last_undegraded":"2024-04-26T12:35:28.209089+0000","last_fullsized":"2024-04-26T12:35:28.209089+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:57.436637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209248+0000","last_change":"2024-04-26T12:35:26.163739+0000","last_active":"2024-04-26T12:35:28.209248+0000","last_peered":"2024-04-26T12:35:28.209248+0000","last_clean":"2024-04-26T12:35:28.209248+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:28.209248+0000","last_undegraded":"2024-04-26T12:35:28.209248+0000","last_fullsized":"2024-04-26T12:35:28.209248+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:31.079482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210697+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:28.210697+0000","last_peered":"2024-04-26T12:35:28.210697+0000","last_clean":"2024-04-26T12:35:28.210697+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:28.210697+0000","last_undegraded":"2024-04-26T12:35:28.210697+0000","last_fullsized":"2024-04-26T12:35:28.210697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208545+0000","last_change":"2024-04-26T12:35:26.168819+0000","last_active":"2024-04-26T12:35:28.208545+0000","last_peered":"2024-04-26T12:35:28.208545+0000","last_clean":"2024-04-26T12:35:28.208545+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:28.208545+0000","last_undegraded":"2024-04-26T12:35:28.208545+0000","last_fullsized":"2024-04-26T12:35:28.208545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:49.140618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210842+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:28.210842+0000","last_peered":"2024-04-26T12:35:28.210842+0000","last_clean":"2024-04-26T12:35:28.210842+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:28.210842+0000","last_undegraded":"2024-04-26T12:35:28.210842+0000","last_fullsized":"2024-04-26T12:35:28.210842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210820+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:28.210820+0000","last_peered":"2024-04-26T12:35:28.210820+0000","last_clean":"2024-04-26T12:35:28.210820+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:28.210820+0000","last_undegraded":"2024-04-26T12:35:28.210820+0000","last_fullsized":"2024-04-26T12:35:28.210820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210121+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:28.210121+0000","last_peered":"2024-04-26T12:35:28.210121+0000","last_clean":"2024-04-26T12:35:28.210121+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:28.210121+0000","last_undegraded":"2024-04-26T12:35:28.210121+0000","last_fullsized":"2024-04-26T12:35:28.210121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212129+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:28.212129+0000","last_peered":"2024-04-26T12:35:28.212129+0000","last_clean":"2024-04-26T12:35:28.212129+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:28.212129+0000","last_undegraded":"2024-04-26T12:35:28.212129+0000","last_fullsized":"2024-04-26T12:35:28.212129+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":82,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211118+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:28.211118+0000","last_peered":"2024-04-26T12:35:28.211118+0000","last_clean":"2024-04-26T12:35:28.211118+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:28.211118+0000","last_undegraded":"2024-04-26T12:35:28.211118+0000","last_fullsized":"2024-04-26T12:35:28.211118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":98,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208544+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:28.208544+0000","last_peered":"2024-04-26T12:35:28.208544+0000","last_clean":"2024-04-26T12:35:28.208544+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:28.208544+0000","last_undegraded":"2024-04-26T12:35:28.208544+0000","last_fullsized":"2024-04-26T12:35:28.208544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208669+0000","last_change":"2024-04-26T12:35:26.164494+0000","last_active":"2024-04-26T12:35:28.208669+0000","last_peered":"2024-04-26T12:35:28.208669+0000","last_clean":"2024-04-26T12:35:28.208669+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:35:28.208669+0000","last_undegraded":"2024-04-26T12:35:28.208669+0000","last_fullsized":"2024-04-26T12:35:28.208669+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:10.400059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208829+0000","last_change":"2024-04-26T12:35:26.167507+0000","last_active":"2024-04-26T12:35:28.208829+0000","last_peered":"2024-04-26T12:35:28.208829+0000","last_clean":"2024-04-26T12:35:28.208829+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:35:28.208829+0000","last_undegraded":"2024-04-26T12:35:28.208829+0000","last_fullsized":"2024-04-26T12:35:28.208829+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:47.316526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":110,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212348+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:28.212348+0000","last_peered":"2024-04-26T12:35:28.212348+0000","last_clean":"2024-04-26T12:35:28.212348+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:28.212348+0000","last_undegraded":"2024-04-26T12:35:28.212348+0000","last_fullsized":"2024-04-26T12:35:28.212348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2157,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211789+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:28.211789+0000","last_peered":"2024-04-26T12:35:28.211789+0000","last_clean":"2024-04-26T12:35:28.211789+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:28.211789+0000","last_undegraded":"2024-04-26T12:35:28.211789+0000","last_fullsized":"2024-04-26T12:35:28.211789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:50.285275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":60,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209350+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:28.209350+0000","last_peered":"2024-04-26T12:35:28.209350+0000","last_clean":"2024-04-26T12:35:28.209350+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:28.209350+0000","last_undegraded":"2024-04-26T12:35:28.209350+0000","last_fullsized":"2024-04-26T12:35:28.209350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:37.674963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":114,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211631+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:28.211631+0000","last_peered":"2024-04-26T12:35:28.211631+0000","last_clean":"2024-04-26T12:35:28.211631+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:28.211631+0000","last_undegraded":"2024-04-26T12:35:28.211631+0000","last_fullsized":"2024-04-26T12:35:28.211631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210937+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:28.210937+0000","last_peered":"2024-04-26T12:35:28.210937+0000","last_clean":"2024-04-26T12:35:28.210937+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:28.210937+0000","last_undegraded":"2024-04-26T12:35:28.210937+0000","last_fullsized":"2024-04-26T12:35:28.210937+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4180,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208145+0000","last_change":"2024-04-26T12:35:26.167799+0000","last_active":"2024-04-26T12:35:28.208145+0000","last_peered":"2024-04-26T12:35:28.208145+0000","last_clean":"2024-04-26T12:35:28.208145+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:35:28.208145+0000","last_undegraded":"2024-04-26T12:35:28.208145+0000","last_fullsized":"2024-04-26T12:35:28.208145+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:35.792155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211036+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:28.211036+0000","last_peered":"2024-04-26T12:35:28.211036+0000","last_clean":"2024-04-26T12:35:28.211036+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:28.211036+0000","last_undegraded":"2024-04-26T12:35:28.211036+0000","last_fullsized":"2024-04-26T12:35:28.211036+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2165,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:35.341488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":117,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211625+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:28.211625+0000","last_peered":"2024-04-26T12:35:28.211625+0000","last_clean":"2024-04-26T12:35:28.211625+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:28.211625+0000","last_undegraded":"2024-04-26T12:35:28.211625+0000","last_fullsized":"2024-04-26T12:35:28.211625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210182+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:28.210182+0000","last_peered":"2024-04-26T12:35:28.210182+0000","last_clean":"2024-04-26T12:35:28.210182+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:28.210182+0000","last_undegraded":"2024-04-26T12:35:28.210182+0000","last_fullsized":"2024-04-26T12:35:28.210182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2027,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208731+0000","last_change":"2024-04-26T12:35:26.169463+0000","last_active":"2024-04-26T12:35:28.208731+0000","last_peered":"2024-04-26T12:35:28.208731+0000","last_clean":"2024-04-26T12:35:28.208731+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:35:28.208731+0000","last_undegraded":"2024-04-26T12:35:28.208731+0000","last_fullsized":"2024-04-26T12:35:28.208731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:48.293346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2132,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210411+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:28.210411+0000","last_peered":"2024-04-26T12:35:28.210411+0000","last_clean":"2024-04-26T12:35:28.210411+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:28.210411+0000","last_undegraded":"2024-04-26T12:35:28.210411+0000","last_fullsized":"2024-04-26T12:35:28.210411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2137,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208869+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:28.208869+0000","last_peered":"2024-04-26T12:35:28.208869+0000","last_clean":"2024-04-26T12:35:28.208869+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:28.208869+0000","last_undegraded":"2024-04-26T12:35:28.208869+0000","last_fullsized":"2024-04-26T12:35:28.208869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142984,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228856,"statfs":{"total":96636764160,"available":95466348544,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.61399999999999999}]}]},{"osd":0,"up_from":85,"seq":365072220167,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52668,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319172,"statfs":{"total":96636764160,"available":96582832128,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860672,"statfs":{"total":96636764160,"available":95089328128,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:35:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.42099999999999999,"15min":0.441},"min":{"1min":0.40699999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.64000000000000001,"5min":1.137,"15min":1.137},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:32.516 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:32.926 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:32.928 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:32.940 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-04-26T12:35:31.049812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119321,"ondisk_log_size":119321,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706820,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408700,"statfs":{"total":289910292480,"available":287138508800,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.894262"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2083,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208960+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:28.208960+0000","last_peered":"2024-04-26T12:35:28.208960+0000","last_clean":"2024-04-26T12:35:28.208960+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:28.208960+0000","last_undegraded":"2024-04-26T12:35:28.208960+0000","last_fullsized":"2024-04-26T12:35:28.208960+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:30.341356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208831+0000","last_change":"2024-04-26T12:35:26.170471+0000","last_active":"2024-04-26T12:35:28.208831+0000","last_peered":"2024-04-26T12:35:28.208831+0000","last_clean":"2024-04-26T12:35:28.208831+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:28.208831+0000","last_undegraded":"2024-04-26T12:35:28.208831+0000","last_fullsized":"2024-04-26T12:35:28.208831+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4131,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213004+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:28.213004+0000","last_peered":"2024-04-26T12:35:28.213004+0000","last_clean":"2024-04-26T12:35:28.213004+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:28.213004+0000","last_undegraded":"2024-04-26T12:35:28.213004+0000","last_fullsized":"2024-04-26T12:35:28.213004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212620+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:28.212620+0000","last_peered":"2024-04-26T12:35:28.212620+0000","last_clean":"2024-04-26T12:35:28.212620+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:28.212620+0000","last_undegraded":"2024-04-26T12:35:28.212620+0000","last_fullsized":"2024-04-26T12:35:28.212620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2154,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208571+0000","last_change":"2024-04-26T12:35:26.167949+0000","last_active":"2024-04-26T12:35:28.208571+0000","last_peered":"2024-04-26T12:35:28.208571+0000","last_clean":"2024-04-26T12:35:28.208571+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:35:28.208571+0000","last_undegraded":"2024-04-26T12:35:28.208571+0000","last_fullsized":"2024-04-26T12:35:28.208571+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:10.256259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214572+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:28.214572+0000","last_peered":"2024-04-26T12:35:28.214572+0000","last_clean":"2024-04-26T12:35:28.214572+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:28.214572+0000","last_undegraded":"2024-04-26T12:35:28.214572+0000","last_fullsized":"2024-04-26T12:35:28.214572+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:22.116087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214925+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:28.214925+0000","last_peered":"2024-04-26T12:35:28.214925+0000","last_clean":"2024-04-26T12:35:28.214925+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:28.214925+0000","last_undegraded":"2024-04-26T12:35:28.214925+0000","last_fullsized":"2024-04-26T12:35:28.214925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:19.062004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8204,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211343+0000","last_change":"2024-04-26T12:35:06.903708+0000","last_active":"2024-04-26T12:35:28.211343+0000","last_peered":"2024-04-26T12:35:28.211343+0000","last_clean":"2024-04-26T12:35:28.211343+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:28.211343+0000","last_undegraded":"2024-04-26T12:35:28.211343+0000","last_fullsized":"2024-04-26T12:35:28.211343+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211204+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:28.211204+0000","last_peered":"2024-04-26T12:35:28.211204+0000","last_clean":"2024-04-26T12:35:28.211204+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:28.211204+0000","last_undegraded":"2024-04-26T12:35:28.211204+0000","last_fullsized":"2024-04-26T12:35:28.211204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:49.537738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6240,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208908+0000","last_change":"2024-04-26T12:35:26.170653+0000","last_active":"2024-04-26T12:35:28.208908+0000","last_peered":"2024-04-26T12:35:28.208908+0000","last_clean":"2024-04-26T12:35:28.208908+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:28.208908+0000","last_undegraded":"2024-04-26T12:35:28.208908+0000","last_fullsized":"2024-04-26T12:35:28.208908+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:48.807860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240430+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:29.240430+0000","last_peered":"2024-04-26T12:35:29.240430+0000","last_clean":"2024-04-26T12:35:29.240430+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:29.240430+0000","last_undegraded":"2024-04-26T12:35:29.240430+0000","last_fullsized":"2024-04-26T12:35:29.240430+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:03.142930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2093,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208562+0000","last_change":"2024-04-26T12:35:26.168307+0000","last_active":"2024-04-26T12:35:28.208562+0000","last_peered":"2024-04-26T12:35:28.208562+0000","last_clean":"2024-04-26T12:35:28.208562+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:28.208562+0000","last_undegraded":"2024-04-26T12:35:28.208562+0000","last_fullsized":"2024-04-26T12:35:28.208562+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:10.743574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2138,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208382+0000","last_change":"2024-04-26T12:35:26.167308+0000","last_active":"2024-04-26T12:35:28.208382+0000","last_peered":"2024-04-26T12:35:28.208382+0000","last_clean":"2024-04-26T12:35:28.208382+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:35:28.208382+0000","last_undegraded":"2024-04-26T12:35:28.208382+0000","last_fullsized":"2024-04-26T12:35:28.208382+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:55.062566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2147,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212441+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:28.212441+0000","last_peered":"2024-04-26T12:35:28.212441+0000","last_clean":"2024-04-26T12:35:28.212441+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:28.212441+0000","last_undegraded":"2024-04-26T12:35:28.212441+0000","last_fullsized":"2024-04-26T12:35:28.212441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2166,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211989+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:28.211989+0000","last_peered":"2024-04-26T12:35:28.211989+0000","last_clean":"2024-04-26T12:35:28.211989+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:28.211989+0000","last_undegraded":"2024-04-26T12:35:28.211989+0000","last_fullsized":"2024-04-26T12:35:28.211989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239840+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:29.239840+0000","last_peered":"2024-04-26T12:35:29.239840+0000","last_clean":"2024-04-26T12:35:29.239840+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:29.239840+0000","last_undegraded":"2024-04-26T12:35:29.239840+0000","last_fullsized":"2024-04-26T12:35:29.239840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:42.219006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2118,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211167+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:28.211167+0000","last_peered":"2024-04-26T12:35:28.211167+0000","last_clean":"2024-04-26T12:35:28.211167+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:28.211167+0000","last_undegraded":"2024-04-26T12:35:28.211167+0000","last_fullsized":"2024-04-26T12:35:28.211167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:52.856014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2140,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209159+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:28.209159+0000","last_peered":"2024-04-26T12:35:28.209159+0000","last_clean":"2024-04-26T12:35:28.209159+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:28.209159+0000","last_undegraded":"2024-04-26T12:35:28.209159+0000","last_fullsized":"2024-04-26T12:35:28.209159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4098,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210794+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:28.210794+0000","last_peered":"2024-04-26T12:35:28.210794+0000","last_clean":"2024-04-26T12:35:28.210794+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:28.210794+0000","last_undegraded":"2024-04-26T12:35:28.210794+0000","last_fullsized":"2024-04-26T12:35:28.210794+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.866275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4222,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212532+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:28.212532+0000","last_peered":"2024-04-26T12:35:28.212532+0000","last_clean":"2024-04-26T12:35:28.212532+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:28.212532+0000","last_undegraded":"2024-04-26T12:35:28.212532+0000","last_fullsized":"2024-04-26T12:35:28.212532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:03.877816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211555+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:28.211555+0000","last_peered":"2024-04-26T12:35:28.211555+0000","last_clean":"2024-04-26T12:35:28.211555+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:28.211555+0000","last_undegraded":"2024-04-26T12:35:28.211555+0000","last_fullsized":"2024-04-26T12:35:28.211555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208329+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:28.208329+0000","last_peered":"2024-04-26T12:35:28.208329+0000","last_clean":"2024-04-26T12:35:28.208329+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:28.208329+0000","last_undegraded":"2024-04-26T12:35:28.208329+0000","last_fullsized":"2024-04-26T12:35:28.208329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210072+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:28.210072+0000","last_peered":"2024-04-26T12:35:28.210072+0000","last_clean":"2024-04-26T12:35:28.210072+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:28.210072+0000","last_undegraded":"2024-04-26T12:35:28.210072+0000","last_fullsized":"2024-04-26T12:35:28.210072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4139,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208389+0000","last_change":"2024-04-26T12:35:26.165413+0000","last_active":"2024-04-26T12:35:28.208389+0000","last_peered":"2024-04-26T12:35:28.208389+0000","last_clean":"2024-04-26T12:35:28.208389+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:35:28.208389+0000","last_undegraded":"2024-04-26T12:35:28.208389+0000","last_fullsized":"2024-04-26T12:35:28.208389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.367083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2141,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209087+0000","last_change":"2024-04-26T12:35:26.170324+0000","last_active":"2024-04-26T12:35:28.209087+0000","last_peered":"2024-04-26T12:35:28.209087+0000","last_clean":"2024-04-26T12:35:28.209087+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:28.209087+0000","last_undegraded":"2024-04-26T12:35:28.209087+0000","last_fullsized":"2024-04-26T12:35:28.209087+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:58.838513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211224+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:28.211224+0000","last_peered":"2024-04-26T12:35:28.211224+0000","last_clean":"2024-04-26T12:35:28.211224+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:28.211224+0000","last_undegraded":"2024-04-26T12:35:28.211224+0000","last_fullsized":"2024-04-26T12:35:28.211224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2101,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212916+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:28.212916+0000","last_peered":"2024-04-26T12:35:28.212916+0000","last_clean":"2024-04-26T12:35:28.212916+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:28.212916+0000","last_undegraded":"2024-04-26T12:35:28.212916+0000","last_fullsized":"2024-04-26T12:35:28.212916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208583+0000","last_change":"2024-04-26T12:35:26.165397+0000","last_active":"2024-04-26T12:35:28.208583+0000","last_peered":"2024-04-26T12:35:28.208583+0000","last_clean":"2024-04-26T12:35:28.208583+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:35:28.208583+0000","last_undegraded":"2024-04-26T12:35:28.208583+0000","last_fullsized":"2024-04-26T12:35:28.208583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:11.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209095+0000","last_change":"2024-04-26T12:35:26.166754+0000","last_active":"2024-04-26T12:35:28.209095+0000","last_peered":"2024-04-26T12:35:28.209095+0000","last_clean":"2024-04-26T12:35:28.209095+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:28.209095+0000","last_undegraded":"2024-04-26T12:35:28.209095+0000","last_fullsized":"2024-04-26T12:35:28.209095+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:52.222681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209874+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:28.209874+0000","last_peered":"2024-04-26T12:35:28.209874+0000","last_clean":"2024-04-26T12:35:28.209874+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:28.209874+0000","last_undegraded":"2024-04-26T12:35:28.209874+0000","last_fullsized":"2024-04-26T12:35:28.209874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211032+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:28.211032+0000","last_peered":"2024-04-26T12:35:28.211032+0000","last_clean":"2024-04-26T12:35:28.211032+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:28.211032+0000","last_undegraded":"2024-04-26T12:35:28.211032+0000","last_fullsized":"2024-04-26T12:35:28.211032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209808+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:28.209808+0000","last_peered":"2024-04-26T12:35:28.209808+0000","last_clean":"2024-04-26T12:35:28.209808+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:28.209808+0000","last_undegraded":"2024-04-26T12:35:28.209808+0000","last_fullsized":"2024-04-26T12:35:28.209808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209274+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:28.209274+0000","last_peered":"2024-04-26T12:35:28.209274+0000","last_clean":"2024-04-26T12:35:28.209274+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:28.209274+0000","last_undegraded":"2024-04-26T12:35:28.209274+0000","last_fullsized":"2024-04-26T12:35:28.209274+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:19.816252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210919+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:28.210919+0000","last_peered":"2024-04-26T12:35:28.210919+0000","last_clean":"2024-04-26T12:35:28.210919+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:28.210919+0000","last_undegraded":"2024-04-26T12:35:28.210919+0000","last_fullsized":"2024-04-26T12:35:28.210919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210388+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:28.210388+0000","last_peered":"2024-04-26T12:35:28.210388+0000","last_clean":"2024-04-26T12:35:28.210388+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:28.210388+0000","last_undegraded":"2024-04-26T12:35:28.210388+0000","last_fullsized":"2024-04-26T12:35:28.210388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240723+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:29.240723+0000","last_peered":"2024-04-26T12:35:29.240723+0000","last_clean":"2024-04-26T12:35:29.240723+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:29.240723+0000","last_undegraded":"2024-04-26T12:35:29.240723+0000","last_fullsized":"2024-04-26T12:35:29.240723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:38.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6182,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209958+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:28.209958+0000","last_peered":"2024-04-26T12:35:28.209958+0000","last_clean":"2024-04-26T12:35:28.209958+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:28.209958+0000","last_undegraded":"2024-04-26T12:35:28.209958+0000","last_fullsized":"2024-04-26T12:35:28.209958+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:50.387270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209285+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:28.209285+0000","last_peered":"2024-04-26T12:35:28.209285+0000","last_clean":"2024-04-26T12:35:28.209285+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:28.209285+0000","last_undegraded":"2024-04-26T12:35:28.209285+0000","last_fullsized":"2024-04-26T12:35:28.209285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:53.309649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4162,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210081+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:28.210081+0000","last_peered":"2024-04-26T12:35:28.210081+0000","last_clean":"2024-04-26T12:35:28.210081+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:28.210081+0000","last_undegraded":"2024-04-26T12:35:28.210081+0000","last_fullsized":"2024-04-26T12:35:28.210081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":192,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212508+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:28.212508+0000","last_peered":"2024-04-26T12:35:28.212508+0000","last_clean":"2024-04-26T12:35:28.212508+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:28.212508+0000","last_undegraded":"2024-04-26T12:35:28.212508+0000","last_fullsized":"2024-04-26T12:35:28.212508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4189,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212280+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:28.212280+0000","last_peered":"2024-04-26T12:35:28.212280+0000","last_clean":"2024-04-26T12:35:28.212280+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:28.212280+0000","last_undegraded":"2024-04-26T12:35:28.212280+0000","last_fullsized":"2024-04-26T12:35:28.212280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212311+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:28.212311+0000","last_peered":"2024-04-26T12:35:28.212311+0000","last_clean":"2024-04-26T12:35:28.212311+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:28.212311+0000","last_undegraded":"2024-04-26T12:35:28.212311+0000","last_fullsized":"2024-04-26T12:35:28.212311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2081,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208726+0000","last_change":"2024-04-26T12:35:26.166921+0000","last_active":"2024-04-26T12:35:28.208726+0000","last_peered":"2024-04-26T12:35:28.208726+0000","last_clean":"2024-04-26T12:35:28.208726+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:35:28.208726+0000","last_undegraded":"2024-04-26T12:35:28.208726+0000","last_fullsized":"2024-04-26T12:35:28.208726+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2078,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209347+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:28.209347+0000","last_peered":"2024-04-26T12:35:28.209347+0000","last_clean":"2024-04-26T12:35:28.209347+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:28.209347+0000","last_undegraded":"2024-04-26T12:35:28.209347+0000","last_fullsized":"2024-04-26T12:35:28.209347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:37.025987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208419+0000","last_change":"2024-04-26T12:35:26.163714+0000","last_active":"2024-04-26T12:35:28.208419+0000","last_peered":"2024-04-26T12:35:28.208419+0000","last_clean":"2024-04-26T12:35:28.208419+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:35:28.208419+0000","last_undegraded":"2024-04-26T12:35:28.208419+0000","last_fullsized":"2024-04-26T12:35:28.208419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:56.750192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211123+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:28.211123+0000","last_peered":"2024-04-26T12:35:28.211123+0000","last_clean":"2024-04-26T12:35:28.211123+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:28.211123+0000","last_undegraded":"2024-04-26T12:35:28.211123+0000","last_fullsized":"2024-04-26T12:35:28.211123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":105,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211774+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:28.211774+0000","last_peered":"2024-04-26T12:35:28.211774+0000","last_clean":"2024-04-26T12:35:28.211774+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:28.211774+0000","last_undegraded":"2024-04-26T12:35:28.211774+0000","last_fullsized":"2024-04-26T12:35:28.211774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2169,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211139+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:28.211139+0000","last_peered":"2024-04-26T12:35:28.211139+0000","last_clean":"2024-04-26T12:35:28.211139+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:28.211139+0000","last_undegraded":"2024-04-26T12:35:28.211139+0000","last_fullsized":"2024-04-26T12:35:28.211139+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:50.006267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":97,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212429+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:28.212429+0000","last_peered":"2024-04-26T12:35:28.212429+0000","last_clean":"2024-04-26T12:35:28.212429+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:28.212429+0000","last_undegraded":"2024-04-26T12:35:28.212429+0000","last_fullsized":"2024-04-26T12:35:28.212429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208506+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:28.208506+0000","last_peered":"2024-04-26T12:35:28.208506+0000","last_clean":"2024-04-26T12:35:28.208506+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:28.208506+0000","last_undegraded":"2024-04-26T12:35:28.208506+0000","last_fullsized":"2024-04-26T12:35:28.208506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:14.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208961+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:28.208961+0000","last_peered":"2024-04-26T12:35:28.208961+0000","last_clean":"2024-04-26T12:35:28.208961+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:28.208961+0000","last_undegraded":"2024-04-26T12:35:28.208961+0000","last_fullsized":"2024-04-26T12:35:28.208961+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208600+0000","last_change":"2024-04-26T12:35:26.165209+0000","last_active":"2024-04-26T12:35:28.208600+0000","last_peered":"2024-04-26T12:35:28.208600+0000","last_clean":"2024-04-26T12:35:28.208600+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:28.208600+0000","last_undegraded":"2024-04-26T12:35:28.208600+0000","last_fullsized":"2024-04-26T12:35:28.208600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:19.522824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":30,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240548+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:29.240548+0000","last_peered":"2024-04-26T12:35:29.240548+0000","last_clean":"2024-04-26T12:35:29.240548+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:29.240548+0000","last_undegraded":"2024-04-26T12:35:29.240548+0000","last_fullsized":"2024-04-26T12:35:29.240548+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:42.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211821+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:28.211821+0000","last_peered":"2024-04-26T12:35:28.211821+0000","last_clean":"2024-04-26T12:35:28.211821+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:28.211821+0000","last_undegraded":"2024-04-26T12:35:28.211821+0000","last_fullsized":"2024-04-26T12:35:28.211821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211859+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:28.211859+0000","last_peered":"2024-04-26T12:35:28.211859+0000","last_clean":"2024-04-26T12:35:28.211859+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:28.211859+0000","last_undegraded":"2024-04-26T12:35:28.211859+0000","last_fullsized":"2024-04-26T12:35:28.211859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210318+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:28.210318+0000","last_peered":"2024-04-26T12:35:28.210318+0000","last_clean":"2024-04-26T12:35:28.210318+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:28.210318+0000","last_undegraded":"2024-04-26T12:35:28.210318+0000","last_fullsized":"2024-04-26T12:35:28.210318+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212057+0000","last_change":"2024-04-26T12:35:05.902297+0000","last_active":"2024-04-26T12:35:28.212057+0000","last_peered":"2024-04-26T12:35:28.212057+0000","last_clean":"2024-04-26T12:35:28.212057+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:28.212057+0000","last_undegraded":"2024-04-26T12:35:28.212057+0000","last_fullsized":"2024-04-26T12:35:28.212057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:37.434819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211660+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:28.211660+0000","last_peered":"2024-04-26T12:35:28.211660+0000","last_clean":"2024-04-26T12:35:28.211660+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:28.211660+0000","last_undegraded":"2024-04-26T12:35:28.211660+0000","last_fullsized":"2024-04-26T12:35:28.211660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2134,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213133+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:28.213133+0000","last_peered":"2024-04-26T12:35:28.213133+0000","last_clean":"2024-04-26T12:35:28.213133+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:28.213133+0000","last_undegraded":"2024-04-26T12:35:28.213133+0000","last_fullsized":"2024-04-26T12:35:28.213133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208228+0000","last_change":"2024-04-26T12:35:26.161621+0000","last_active":"2024-04-26T12:35:28.208228+0000","last_peered":"2024-04-26T12:35:28.208228+0000","last_clean":"2024-04-26T12:35:28.208228+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:35:28.208228+0000","last_undegraded":"2024-04-26T12:35:28.208228+0000","last_fullsized":"2024-04-26T12:35:28.208228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:44.708029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212154+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:28.212154+0000","last_peered":"2024-04-26T12:35:28.212154+0000","last_clean":"2024-04-26T12:35:28.212154+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:28.212154+0000","last_undegraded":"2024-04-26T12:35:28.212154+0000","last_fullsized":"2024-04-26T12:35:28.212154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208344+0000","last_change":"2024-04-26T12:35:26.163568+0000","last_active":"2024-04-26T12:35:28.208344+0000","last_peered":"2024-04-26T12:35:28.208344+0000","last_clean":"2024-04-26T12:35:28.208344+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:35:28.208344+0000","last_undegraded":"2024-04-26T12:35:28.208344+0000","last_fullsized":"2024-04-26T12:35:28.208344+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:01.190879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211076+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:28.211076+0000","last_peered":"2024-04-26T12:35:28.211076+0000","last_clean":"2024-04-26T12:35:28.211076+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:28.211076+0000","last_undegraded":"2024-04-26T12:35:28.211076+0000","last_fullsized":"2024-04-26T12:35:28.211076+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:41.098435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210635+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:28.210635+0000","last_peered":"2024-04-26T12:35:28.210635+0000","last_clean":"2024-04-26T12:35:28.210635+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:28.210635+0000","last_undegraded":"2024-04-26T12:35:28.210635+0000","last_fullsized":"2024-04-26T12:35:28.210635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212994+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:28.212994+0000","last_peered":"2024-04-26T12:35:28.212994+0000","last_clean":"2024-04-26T12:35:28.212994+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:28.212994+0000","last_undegraded":"2024-04-26T12:35:28.212994+0000","last_fullsized":"2024-04-26T12:35:28.212994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208687+0000","last_change":"2024-04-26T12:35:26.163875+0000","last_active":"2024-04-26T12:35:28.208687+0000","last_peered":"2024-04-26T12:35:28.208687+0000","last_clean":"2024-04-26T12:35:28.208687+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:35:28.208687+0000","last_undegraded":"2024-04-26T12:35:28.208687+0000","last_fullsized":"2024-04-26T12:35:28.208687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:05.697046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212247+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:28.212247+0000","last_peered":"2024-04-26T12:35:28.212247+0000","last_clean":"2024-04-26T12:35:28.212247+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:28.212247+0000","last_undegraded":"2024-04-26T12:35:28.212247+0000","last_fullsized":"2024-04-26T12:35:28.212247+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211893+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:28.211893+0000","last_peered":"2024-04-26T12:35:28.211893+0000","last_clean":"2024-04-26T12:35:28.211893+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:28.211893+0000","last_undegraded":"2024-04-26T12:35:28.211893+0000","last_fullsized":"2024-04-26T12:35:28.211893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210480+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:28.210480+0000","last_peered":"2024-04-26T12:35:28.210480+0000","last_clean":"2024-04-26T12:35:28.210480+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:28.210480+0000","last_undegraded":"2024-04-26T12:35:28.210480+0000","last_fullsized":"2024-04-26T12:35:28.210480+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210119+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:28.210119+0000","last_peered":"2024-04-26T12:35:28.210119+0000","last_clean":"2024-04-26T12:35:28.210119+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:28.210119+0000","last_undegraded":"2024-04-26T12:35:28.210119+0000","last_fullsized":"2024-04-26T12:35:28.210119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210995+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:28.210995+0000","last_peered":"2024-04-26T12:35:28.210995+0000","last_clean":"2024-04-26T12:35:28.210995+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:28.210995+0000","last_undegraded":"2024-04-26T12:35:28.210995+0000","last_fullsized":"2024-04-26T12:35:28.210995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212150+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:28.212150+0000","last_peered":"2024-04-26T12:35:28.212150+0000","last_clean":"2024-04-26T12:35:28.212150+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:28.212150+0000","last_undegraded":"2024-04-26T12:35:28.212150+0000","last_fullsized":"2024-04-26T12:35:28.212150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211472+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:28.211472+0000","last_peered":"2024-04-26T12:35:28.211472+0000","last_clean":"2024-04-26T12:35:28.211472+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:28.211472+0000","last_undegraded":"2024-04-26T12:35:28.211472+0000","last_fullsized":"2024-04-26T12:35:28.211472+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210224+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:28.210224+0000","last_peered":"2024-04-26T12:35:28.210224+0000","last_clean":"2024-04-26T12:35:28.210224+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:28.210224+0000","last_undegraded":"2024-04-26T12:35:28.210224+0000","last_fullsized":"2024-04-26T12:35:28.210224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.216208+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:28.216208+0000","last_peered":"2024-04-26T12:35:28.216208+0000","last_clean":"2024-04-26T12:35:28.216208+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:28.216208+0000","last_undegraded":"2024-04-26T12:35:28.216208+0000","last_fullsized":"2024-04-26T12:35:28.216208+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:21.559371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211736+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:28.211736+0000","last_peered":"2024-04-26T12:35:28.211736+0000","last_clean":"2024-04-26T12:35:28.211736+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:28.211736+0000","last_undegraded":"2024-04-26T12:35:28.211736+0000","last_fullsized":"2024-04-26T12:35:28.211736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210256+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:28.210256+0000","last_peered":"2024-04-26T12:35:28.210256+0000","last_clean":"2024-04-26T12:35:28.210256+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:28.210256+0000","last_undegraded":"2024-04-26T12:35:28.210256+0000","last_fullsized":"2024-04-26T12:35:28.210256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8089,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209089+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:28.209089+0000","last_peered":"2024-04-26T12:35:28.209089+0000","last_clean":"2024-04-26T12:35:28.209089+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:28.209089+0000","last_undegraded":"2024-04-26T12:35:28.209089+0000","last_fullsized":"2024-04-26T12:35:28.209089+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:57.436637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209248+0000","last_change":"2024-04-26T12:35:26.163739+0000","last_active":"2024-04-26T12:35:28.209248+0000","last_peered":"2024-04-26T12:35:28.209248+0000","last_clean":"2024-04-26T12:35:28.209248+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:28.209248+0000","last_undegraded":"2024-04-26T12:35:28.209248+0000","last_fullsized":"2024-04-26T12:35:28.209248+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:31.079482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210697+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:28.210697+0000","last_peered":"2024-04-26T12:35:28.210697+0000","last_clean":"2024-04-26T12:35:28.210697+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:28.210697+0000","last_undegraded":"2024-04-26T12:35:28.210697+0000","last_fullsized":"2024-04-26T12:35:28.210697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208545+0000","last_change":"2024-04-26T12:35:26.168819+0000","last_active":"2024-04-26T12:35:28.208545+0000","last_peered":"2024-04-26T12:35:28.208545+0000","last_clean":"2024-04-26T12:35:28.208545+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:28.208545+0000","last_undegraded":"2024-04-26T12:35:28.208545+0000","last_fullsized":"2024-04-26T12:35:28.208545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:49.140618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210842+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:28.210842+0000","last_peered":"2024-04-26T12:35:28.210842+0000","last_clean":"2024-04-26T12:35:28.210842+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:28.210842+0000","last_undegraded":"2024-04-26T12:35:28.210842+0000","last_fullsized":"2024-04-26T12:35:28.210842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210820+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:28.210820+0000","last_peered":"2024-04-26T12:35:28.210820+0000","last_clean":"2024-04-26T12:35:28.210820+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:28.210820+0000","last_undegraded":"2024-04-26T12:35:28.210820+0000","last_fullsized":"2024-04-26T12:35:28.210820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210121+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:28.210121+0000","last_peered":"2024-04-26T12:35:28.210121+0000","last_clean":"2024-04-26T12:35:28.210121+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:28.210121+0000","last_undegraded":"2024-04-26T12:35:28.210121+0000","last_fullsized":"2024-04-26T12:35:28.210121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212129+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:28.212129+0000","last_peered":"2024-04-26T12:35:28.212129+0000","last_clean":"2024-04-26T12:35:28.212129+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:28.212129+0000","last_undegraded":"2024-04-26T12:35:28.212129+0000","last_fullsized":"2024-04-26T12:35:28.212129+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":82,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211118+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:28.211118+0000","last_peered":"2024-04-26T12:35:28.211118+0000","last_clean":"2024-04-26T12:35:28.211118+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:28.211118+0000","last_undegraded":"2024-04-26T12:35:28.211118+0000","last_fullsized":"2024-04-26T12:35:28.211118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":98,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208544+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:28.208544+0000","last_peered":"2024-04-26T12:35:28.208544+0000","last_clean":"2024-04-26T12:35:28.208544+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:28.208544+0000","last_undegraded":"2024-04-26T12:35:28.208544+0000","last_fullsized":"2024-04-26T12:35:28.208544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208669+0000","last_change":"2024-04-26T12:35:26.164494+0000","last_active":"2024-04-26T12:35:28.208669+0000","last_peered":"2024-04-26T12:35:28.208669+0000","last_clean":"2024-04-26T12:35:28.208669+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:35:28.208669+0000","last_undegraded":"2024-04-26T12:35:28.208669+0000","last_fullsized":"2024-04-26T12:35:28.208669+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:10.400059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208829+0000","last_change":"2024-04-26T12:35:26.167507+0000","last_active":"2024-04-26T12:35:28.208829+0000","last_peered":"2024-04-26T12:35:28.208829+0000","last_clean":"2024-04-26T12:35:28.208829+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:35:28.208829+0000","last_undegraded":"2024-04-26T12:35:28.208829+0000","last_fullsized":"2024-04-26T12:35:28.208829+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:47.316526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":110,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212348+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:28.212348+0000","last_peered":"2024-04-26T12:35:28.212348+0000","last_clean":"2024-04-26T12:35:28.212348+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:28.212348+0000","last_undegraded":"2024-04-26T12:35:28.212348+0000","last_fullsized":"2024-04-26T12:35:28.212348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2157,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211789+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:28.211789+0000","last_peered":"2024-04-26T12:35:28.211789+0000","last_clean":"2024-04-26T12:35:28.211789+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:28.211789+0000","last_undegraded":"2024-04-26T12:35:28.211789+0000","last_fullsized":"2024-04-26T12:35:28.211789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:50.285275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":60,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209350+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:28.209350+0000","last_peered":"2024-04-26T12:35:28.209350+0000","last_clean":"2024-04-26T12:35:28.209350+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:28.209350+0000","last_undegraded":"2024-04-26T12:35:28.209350+0000","last_fullsized":"2024-04-26T12:35:28.209350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:37.674963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":114,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211631+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:28.211631+0000","last_peered":"2024-04-26T12:35:28.211631+0000","last_clean":"2024-04-26T12:35:28.211631+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:28.211631+0000","last_undegraded":"2024-04-26T12:35:28.211631+0000","last_fullsized":"2024-04-26T12:35:28.211631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210937+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:28.210937+0000","last_peered":"2024-04-26T12:35:28.210937+0000","last_clean":"2024-04-26T12:35:28.210937+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:28.210937+0000","last_undegraded":"2024-04-26T12:35:28.210937+0000","last_fullsized":"2024-04-26T12:35:28.210937+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4180,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208145+0000","last_change":"2024-04-26T12:35:26.167799+0000","last_active":"2024-04-26T12:35:28.208145+0000","last_peered":"2024-04-26T12:35:28.208145+0000","last_clean":"2024-04-26T12:35:28.208145+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:35:28.208145+0000","last_undegraded":"2024-04-26T12:35:28.208145+0000","last_fullsized":"2024-04-26T12:35:28.208145+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:35.792155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211036+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:28.211036+0000","last_peered":"2024-04-26T12:35:28.211036+0000","last_clean":"2024-04-26T12:35:28.211036+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:28.211036+0000","last_undegraded":"2024-04-26T12:35:28.211036+0000","last_fullsized":"2024-04-26T12:35:28.211036+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2165,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:35.341488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":117,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211625+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:28.211625+0000","last_peered":"2024-04-26T12:35:28.211625+0000","last_clean":"2024-04-26T12:35:28.211625+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:28.211625+0000","last_undegraded":"2024-04-26T12:35:28.211625+0000","last_fullsized":"2024-04-26T12:35:28.211625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210182+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:28.210182+0000","last_peered":"2024-04-26T12:35:28.210182+0000","last_clean":"2024-04-26T12:35:28.210182+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:28.210182+0000","last_undegraded":"2024-04-26T12:35:28.210182+0000","last_fullsized":"2024-04-26T12:35:28.210182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2027,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208731+0000","last_change":"2024-04-26T12:35:26.169463+0000","last_active":"2024-04-26T12:35:28.208731+0000","last_peered":"2024-04-26T12:35:28.208731+0000","last_clean":"2024-04-26T12:35:28.208731+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:35:28.208731+0000","last_undegraded":"2024-04-26T12:35:28.208731+0000","last_fullsized":"2024-04-26T12:35:28.208731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:48.293346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2132,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210411+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:28.210411+0000","last_peered":"2024-04-26T12:35:28.210411+0000","last_clean":"2024-04-26T12:35:28.210411+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:28.210411+0000","last_undegraded":"2024-04-26T12:35:28.210411+0000","last_fullsized":"2024-04-26T12:35:28.210411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2137,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208869+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:28.208869+0000","last_peered":"2024-04-26T12:35:28.208869+0000","last_clean":"2024-04-26T12:35:28.208869+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:28.208869+0000","last_undegraded":"2024-04-26T12:35:28.208869+0000","last_fullsized":"2024-04-26T12:35:28.208869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142984,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228856,"statfs":{"total":96636764160,"available":95466348544,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.61399999999999999}]}]},{"osd":0,"up_from":85,"seq":365072220167,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52668,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319172,"statfs":{"total":96636764160,"available":96582832128,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860672,"statfs":{"total":96636764160,"available":95089328128,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:35:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.42099999999999999,"15min":0.441},"min":{"1min":0.40699999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.64000000000000001,"5min":1.137,"15min":1.137},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:32.944 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:35:32.944 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T12:35:33.385 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T12:35:33.395 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:35:33.395 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:33.765 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:33.766 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:33.779 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-26T12:35:33.050527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119321,"ondisk_log_size":119321,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706820,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408700,"statfs":{"total":289910292480,"available":287138508800,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001754"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2083,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208960+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:28.208960+0000","last_peered":"2024-04-26T12:35:28.208960+0000","last_clean":"2024-04-26T12:35:28.208960+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:28.208960+0000","last_undegraded":"2024-04-26T12:35:28.208960+0000","last_fullsized":"2024-04-26T12:35:28.208960+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:30.341356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208831+0000","last_change":"2024-04-26T12:35:26.170471+0000","last_active":"2024-04-26T12:35:28.208831+0000","last_peered":"2024-04-26T12:35:28.208831+0000","last_clean":"2024-04-26T12:35:28.208831+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:28.208831+0000","last_undegraded":"2024-04-26T12:35:28.208831+0000","last_fullsized":"2024-04-26T12:35:28.208831+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4131,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213004+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:28.213004+0000","last_peered":"2024-04-26T12:35:28.213004+0000","last_clean":"2024-04-26T12:35:28.213004+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:28.213004+0000","last_undegraded":"2024-04-26T12:35:28.213004+0000","last_fullsized":"2024-04-26T12:35:28.213004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212620+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:28.212620+0000","last_peered":"2024-04-26T12:35:28.212620+0000","last_clean":"2024-04-26T12:35:28.212620+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:28.212620+0000","last_undegraded":"2024-04-26T12:35:28.212620+0000","last_fullsized":"2024-04-26T12:35:28.212620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2154,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208571+0000","last_change":"2024-04-26T12:35:26.167949+0000","last_active":"2024-04-26T12:35:28.208571+0000","last_peered":"2024-04-26T12:35:28.208571+0000","last_clean":"2024-04-26T12:35:28.208571+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:35:28.208571+0000","last_undegraded":"2024-04-26T12:35:28.208571+0000","last_fullsized":"2024-04-26T12:35:28.208571+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:10.256259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214572+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:28.214572+0000","last_peered":"2024-04-26T12:35:28.214572+0000","last_clean":"2024-04-26T12:35:28.214572+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:28.214572+0000","last_undegraded":"2024-04-26T12:35:28.214572+0000","last_fullsized":"2024-04-26T12:35:28.214572+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:22.116087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214925+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:28.214925+0000","last_peered":"2024-04-26T12:35:28.214925+0000","last_clean":"2024-04-26T12:35:28.214925+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:28.214925+0000","last_undegraded":"2024-04-26T12:35:28.214925+0000","last_fullsized":"2024-04-26T12:35:28.214925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:19.062004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8204,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211343+0000","last_change":"2024-04-26T12:35:06.903708+0000","last_active":"2024-04-26T12:35:28.211343+0000","last_peered":"2024-04-26T12:35:28.211343+0000","last_clean":"2024-04-26T12:35:28.211343+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:28.211343+0000","last_undegraded":"2024-04-26T12:35:28.211343+0000","last_fullsized":"2024-04-26T12:35:28.211343+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211204+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:28.211204+0000","last_peered":"2024-04-26T12:35:28.211204+0000","last_clean":"2024-04-26T12:35:28.211204+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:28.211204+0000","last_undegraded":"2024-04-26T12:35:28.211204+0000","last_fullsized":"2024-04-26T12:35:28.211204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:49.537738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6240,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208908+0000","last_change":"2024-04-26T12:35:26.170653+0000","last_active":"2024-04-26T12:35:28.208908+0000","last_peered":"2024-04-26T12:35:28.208908+0000","last_clean":"2024-04-26T12:35:28.208908+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:28.208908+0000","last_undegraded":"2024-04-26T12:35:28.208908+0000","last_fullsized":"2024-04-26T12:35:28.208908+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:48.807860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240430+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:29.240430+0000","last_peered":"2024-04-26T12:35:29.240430+0000","last_clean":"2024-04-26T12:35:29.240430+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:29.240430+0000","last_undegraded":"2024-04-26T12:35:29.240430+0000","last_fullsized":"2024-04-26T12:35:29.240430+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:03.142930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2093,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208562+0000","last_change":"2024-04-26T12:35:26.168307+0000","last_active":"2024-04-26T12:35:28.208562+0000","last_peered":"2024-04-26T12:35:28.208562+0000","last_clean":"2024-04-26T12:35:28.208562+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:28.208562+0000","last_undegraded":"2024-04-26T12:35:28.208562+0000","last_fullsized":"2024-04-26T12:35:28.208562+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:10.743574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2138,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208382+0000","last_change":"2024-04-26T12:35:26.167308+0000","last_active":"2024-04-26T12:35:28.208382+0000","last_peered":"2024-04-26T12:35:28.208382+0000","last_clean":"2024-04-26T12:35:28.208382+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:35:28.208382+0000","last_undegraded":"2024-04-26T12:35:28.208382+0000","last_fullsized":"2024-04-26T12:35:28.208382+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:55.062566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2147,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212441+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:28.212441+0000","last_peered":"2024-04-26T12:35:28.212441+0000","last_clean":"2024-04-26T12:35:28.212441+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:28.212441+0000","last_undegraded":"2024-04-26T12:35:28.212441+0000","last_fullsized":"2024-04-26T12:35:28.212441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2166,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211989+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:28.211989+0000","last_peered":"2024-04-26T12:35:28.211989+0000","last_clean":"2024-04-26T12:35:28.211989+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:28.211989+0000","last_undegraded":"2024-04-26T12:35:28.211989+0000","last_fullsized":"2024-04-26T12:35:28.211989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239840+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:29.239840+0000","last_peered":"2024-04-26T12:35:29.239840+0000","last_clean":"2024-04-26T12:35:29.239840+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:29.239840+0000","last_undegraded":"2024-04-26T12:35:29.239840+0000","last_fullsized":"2024-04-26T12:35:29.239840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:42.219006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2118,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211167+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:28.211167+0000","last_peered":"2024-04-26T12:35:28.211167+0000","last_clean":"2024-04-26T12:35:28.211167+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:28.211167+0000","last_undegraded":"2024-04-26T12:35:28.211167+0000","last_fullsized":"2024-04-26T12:35:28.211167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:52.856014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2140,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209159+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:28.209159+0000","last_peered":"2024-04-26T12:35:28.209159+0000","last_clean":"2024-04-26T12:35:28.209159+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:28.209159+0000","last_undegraded":"2024-04-26T12:35:28.209159+0000","last_fullsized":"2024-04-26T12:35:28.209159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4098,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210794+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:28.210794+0000","last_peered":"2024-04-26T12:35:28.210794+0000","last_clean":"2024-04-26T12:35:28.210794+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:28.210794+0000","last_undegraded":"2024-04-26T12:35:28.210794+0000","last_fullsized":"2024-04-26T12:35:28.210794+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.866275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4222,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212532+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:28.212532+0000","last_peered":"2024-04-26T12:35:28.212532+0000","last_clean":"2024-04-26T12:35:28.212532+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:28.212532+0000","last_undegraded":"2024-04-26T12:35:28.212532+0000","last_fullsized":"2024-04-26T12:35:28.212532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:03.877816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211555+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:28.211555+0000","last_peered":"2024-04-26T12:35:28.211555+0000","last_clean":"2024-04-26T12:35:28.211555+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:28.211555+0000","last_undegraded":"2024-04-26T12:35:28.211555+0000","last_fullsized":"2024-04-26T12:35:28.211555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208329+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:28.208329+0000","last_peered":"2024-04-26T12:35:28.208329+0000","last_clean":"2024-04-26T12:35:28.208329+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:28.208329+0000","last_undegraded":"2024-04-26T12:35:28.208329+0000","last_fullsized":"2024-04-26T12:35:28.208329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210072+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:28.210072+0000","last_peered":"2024-04-26T12:35:28.210072+0000","last_clean":"2024-04-26T12:35:28.210072+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:28.210072+0000","last_undegraded":"2024-04-26T12:35:28.210072+0000","last_fullsized":"2024-04-26T12:35:28.210072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4139,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208389+0000","last_change":"2024-04-26T12:35:26.165413+0000","last_active":"2024-04-26T12:35:28.208389+0000","last_peered":"2024-04-26T12:35:28.208389+0000","last_clean":"2024-04-26T12:35:28.208389+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:35:28.208389+0000","last_undegraded":"2024-04-26T12:35:28.208389+0000","last_fullsized":"2024-04-26T12:35:28.208389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.367083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2141,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209087+0000","last_change":"2024-04-26T12:35:26.170324+0000","last_active":"2024-04-26T12:35:28.209087+0000","last_peered":"2024-04-26T12:35:28.209087+0000","last_clean":"2024-04-26T12:35:28.209087+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:28.209087+0000","last_undegraded":"2024-04-26T12:35:28.209087+0000","last_fullsized":"2024-04-26T12:35:28.209087+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:58.838513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211224+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:28.211224+0000","last_peered":"2024-04-26T12:35:28.211224+0000","last_clean":"2024-04-26T12:35:28.211224+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:28.211224+0000","last_undegraded":"2024-04-26T12:35:28.211224+0000","last_fullsized":"2024-04-26T12:35:28.211224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2101,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212916+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:28.212916+0000","last_peered":"2024-04-26T12:35:28.212916+0000","last_clean":"2024-04-26T12:35:28.212916+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:28.212916+0000","last_undegraded":"2024-04-26T12:35:28.212916+0000","last_fullsized":"2024-04-26T12:35:28.212916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208583+0000","last_change":"2024-04-26T12:35:26.165397+0000","last_active":"2024-04-26T12:35:28.208583+0000","last_peered":"2024-04-26T12:35:28.208583+0000","last_clean":"2024-04-26T12:35:28.208583+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:35:28.208583+0000","last_undegraded":"2024-04-26T12:35:28.208583+0000","last_fullsized":"2024-04-26T12:35:28.208583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:11.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209095+0000","last_change":"2024-04-26T12:35:26.166754+0000","last_active":"2024-04-26T12:35:28.209095+0000","last_peered":"2024-04-26T12:35:28.209095+0000","last_clean":"2024-04-26T12:35:28.209095+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:28.209095+0000","last_undegraded":"2024-04-26T12:35:28.209095+0000","last_fullsized":"2024-04-26T12:35:28.209095+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:52.222681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209874+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:28.209874+0000","last_peered":"2024-04-26T12:35:28.209874+0000","last_clean":"2024-04-26T12:35:28.209874+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:28.209874+0000","last_undegraded":"2024-04-26T12:35:28.209874+0000","last_fullsized":"2024-04-26T12:35:28.209874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211032+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:28.211032+0000","last_peered":"2024-04-26T12:35:28.211032+0000","last_clean":"2024-04-26T12:35:28.211032+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:28.211032+0000","last_undegraded":"2024-04-26T12:35:28.211032+0000","last_fullsized":"2024-04-26T12:35:28.211032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209808+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:28.209808+0000","last_peered":"2024-04-26T12:35:28.209808+0000","last_clean":"2024-04-26T12:35:28.209808+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:28.209808+0000","last_undegraded":"2024-04-26T12:35:28.209808+0000","last_fullsized":"2024-04-26T12:35:28.209808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209274+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:28.209274+0000","last_peered":"2024-04-26T12:35:28.209274+0000","last_clean":"2024-04-26T12:35:28.209274+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:28.209274+0000","last_undegraded":"2024-04-26T12:35:28.209274+0000","last_fullsized":"2024-04-26T12:35:28.209274+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:19.816252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210919+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:28.210919+0000","last_peered":"2024-04-26T12:35:28.210919+0000","last_clean":"2024-04-26T12:35:28.210919+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:28.210919+0000","last_undegraded":"2024-04-26T12:35:28.210919+0000","last_fullsized":"2024-04-26T12:35:28.210919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210388+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:28.210388+0000","last_peered":"2024-04-26T12:35:28.210388+0000","last_clean":"2024-04-26T12:35:28.210388+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:28.210388+0000","last_undegraded":"2024-04-26T12:35:28.210388+0000","last_fullsized":"2024-04-26T12:35:28.210388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240723+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:29.240723+0000","last_peered":"2024-04-26T12:35:29.240723+0000","last_clean":"2024-04-26T12:35:29.240723+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:29.240723+0000","last_undegraded":"2024-04-26T12:35:29.240723+0000","last_fullsized":"2024-04-26T12:35:29.240723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:38.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6182,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209958+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:28.209958+0000","last_peered":"2024-04-26T12:35:28.209958+0000","last_clean":"2024-04-26T12:35:28.209958+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:28.209958+0000","last_undegraded":"2024-04-26T12:35:28.209958+0000","last_fullsized":"2024-04-26T12:35:28.209958+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:50.387270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209285+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:28.209285+0000","last_peered":"2024-04-26T12:35:28.209285+0000","last_clean":"2024-04-26T12:35:28.209285+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:28.209285+0000","last_undegraded":"2024-04-26T12:35:28.209285+0000","last_fullsized":"2024-04-26T12:35:28.209285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:53.309649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4162,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210081+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:28.210081+0000","last_peered":"2024-04-26T12:35:28.210081+0000","last_clean":"2024-04-26T12:35:28.210081+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:28.210081+0000","last_undegraded":"2024-04-26T12:35:28.210081+0000","last_fullsized":"2024-04-26T12:35:28.210081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":192,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212508+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:28.212508+0000","last_peered":"2024-04-26T12:35:28.212508+0000","last_clean":"2024-04-26T12:35:28.212508+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:28.212508+0000","last_undegraded":"2024-04-26T12:35:28.212508+0000","last_fullsized":"2024-04-26T12:35:28.212508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4189,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212280+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:28.212280+0000","last_peered":"2024-04-26T12:35:28.212280+0000","last_clean":"2024-04-26T12:35:28.212280+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:28.212280+0000","last_undegraded":"2024-04-26T12:35:28.212280+0000","last_fullsized":"2024-04-26T12:35:28.212280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212311+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:28.212311+0000","last_peered":"2024-04-26T12:35:28.212311+0000","last_clean":"2024-04-26T12:35:28.212311+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:28.212311+0000","last_undegraded":"2024-04-26T12:35:28.212311+0000","last_fullsized":"2024-04-26T12:35:28.212311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2081,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208726+0000","last_change":"2024-04-26T12:35:26.166921+0000","last_active":"2024-04-26T12:35:28.208726+0000","last_peered":"2024-04-26T12:35:28.208726+0000","last_clean":"2024-04-26T12:35:28.208726+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:35:28.208726+0000","last_undegraded":"2024-04-26T12:35:28.208726+0000","last_fullsized":"2024-04-26T12:35:28.208726+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2078,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209347+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:28.209347+0000","last_peered":"2024-04-26T12:35:28.209347+0000","last_clean":"2024-04-26T12:35:28.209347+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:28.209347+0000","last_undegraded":"2024-04-26T12:35:28.209347+0000","last_fullsized":"2024-04-26T12:35:28.209347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:37.025987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208419+0000","last_change":"2024-04-26T12:35:26.163714+0000","last_active":"2024-04-26T12:35:28.208419+0000","last_peered":"2024-04-26T12:35:28.208419+0000","last_clean":"2024-04-26T12:35:28.208419+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:35:28.208419+0000","last_undegraded":"2024-04-26T12:35:28.208419+0000","last_fullsized":"2024-04-26T12:35:28.208419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:56.750192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211123+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:28.211123+0000","last_peered":"2024-04-26T12:35:28.211123+0000","last_clean":"2024-04-26T12:35:28.211123+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:28.211123+0000","last_undegraded":"2024-04-26T12:35:28.211123+0000","last_fullsized":"2024-04-26T12:35:28.211123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":105,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211774+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:28.211774+0000","last_peered":"2024-04-26T12:35:28.211774+0000","last_clean":"2024-04-26T12:35:28.211774+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:28.211774+0000","last_undegraded":"2024-04-26T12:35:28.211774+0000","last_fullsized":"2024-04-26T12:35:28.211774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2169,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211139+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:28.211139+0000","last_peered":"2024-04-26T12:35:28.211139+0000","last_clean":"2024-04-26T12:35:28.211139+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:28.211139+0000","last_undegraded":"2024-04-26T12:35:28.211139+0000","last_fullsized":"2024-04-26T12:35:28.211139+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:50.006267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":97,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212429+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:28.212429+0000","last_peered":"2024-04-26T12:35:28.212429+0000","last_clean":"2024-04-26T12:35:28.212429+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:28.212429+0000","last_undegraded":"2024-04-26T12:35:28.212429+0000","last_fullsized":"2024-04-26T12:35:28.212429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208506+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:28.208506+0000","last_peered":"2024-04-26T12:35:28.208506+0000","last_clean":"2024-04-26T12:35:28.208506+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:28.208506+0000","last_undegraded":"2024-04-26T12:35:28.208506+0000","last_fullsized":"2024-04-26T12:35:28.208506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:14.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208961+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:28.208961+0000","last_peered":"2024-04-26T12:35:28.208961+0000","last_clean":"2024-04-26T12:35:28.208961+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:28.208961+0000","last_undegraded":"2024-04-26T12:35:28.208961+0000","last_fullsized":"2024-04-26T12:35:28.208961+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208600+0000","last_change":"2024-04-26T12:35:26.165209+0000","last_active":"2024-04-26T12:35:28.208600+0000","last_peered":"2024-04-26T12:35:28.208600+0000","last_clean":"2024-04-26T12:35:28.208600+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:28.208600+0000","last_undegraded":"2024-04-26T12:35:28.208600+0000","last_fullsized":"2024-04-26T12:35:28.208600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:19.522824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":30,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240548+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:29.240548+0000","last_peered":"2024-04-26T12:35:29.240548+0000","last_clean":"2024-04-26T12:35:29.240548+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:29.240548+0000","last_undegraded":"2024-04-26T12:35:29.240548+0000","last_fullsized":"2024-04-26T12:35:29.240548+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:42.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211821+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:28.211821+0000","last_peered":"2024-04-26T12:35:28.211821+0000","last_clean":"2024-04-26T12:35:28.211821+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:28.211821+0000","last_undegraded":"2024-04-26T12:35:28.211821+0000","last_fullsized":"2024-04-26T12:35:28.211821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211859+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:28.211859+0000","last_peered":"2024-04-26T12:35:28.211859+0000","last_clean":"2024-04-26T12:35:28.211859+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:28.211859+0000","last_undegraded":"2024-04-26T12:35:28.211859+0000","last_fullsized":"2024-04-26T12:35:28.211859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210318+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:28.210318+0000","last_peered":"2024-04-26T12:35:28.210318+0000","last_clean":"2024-04-26T12:35:28.210318+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:28.210318+0000","last_undegraded":"2024-04-26T12:35:28.210318+0000","last_fullsized":"2024-04-26T12:35:28.210318+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212057+0000","last_change":"2024-04-26T12:35:05.902297+0000","last_active":"2024-04-26T12:35:28.212057+0000","last_peered":"2024-04-26T12:35:28.212057+0000","last_clean":"2024-04-26T12:35:28.212057+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:28.212057+0000","last_undegraded":"2024-04-26T12:35:28.212057+0000","last_fullsized":"2024-04-26T12:35:28.212057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:37.434819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211660+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:28.211660+0000","last_peered":"2024-04-26T12:35:28.211660+0000","last_clean":"2024-04-26T12:35:28.211660+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:28.211660+0000","last_undegraded":"2024-04-26T12:35:28.211660+0000","last_fullsized":"2024-04-26T12:35:28.211660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2134,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213133+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:28.213133+0000","last_peered":"2024-04-26T12:35:28.213133+0000","last_clean":"2024-04-26T12:35:28.213133+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:28.213133+0000","last_undegraded":"2024-04-26T12:35:28.213133+0000","last_fullsized":"2024-04-26T12:35:28.213133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208228+0000","last_change":"2024-04-26T12:35:26.161621+0000","last_active":"2024-04-26T12:35:28.208228+0000","last_peered":"2024-04-26T12:35:28.208228+0000","last_clean":"2024-04-26T12:35:28.208228+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:35:28.208228+0000","last_undegraded":"2024-04-26T12:35:28.208228+0000","last_fullsized":"2024-04-26T12:35:28.208228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:44.708029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212154+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:28.212154+0000","last_peered":"2024-04-26T12:35:28.212154+0000","last_clean":"2024-04-26T12:35:28.212154+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:28.212154+0000","last_undegraded":"2024-04-26T12:35:28.212154+0000","last_fullsized":"2024-04-26T12:35:28.212154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208344+0000","last_change":"2024-04-26T12:35:26.163568+0000","last_active":"2024-04-26T12:35:28.208344+0000","last_peered":"2024-04-26T12:35:28.208344+0000","last_clean":"2024-04-26T12:35:28.208344+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:35:28.208344+0000","last_undegraded":"2024-04-26T12:35:28.208344+0000","last_fullsized":"2024-04-26T12:35:28.208344+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:01.190879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211076+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:28.211076+0000","last_peered":"2024-04-26T12:35:28.211076+0000","last_clean":"2024-04-26T12:35:28.211076+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:28.211076+0000","last_undegraded":"2024-04-26T12:35:28.211076+0000","last_fullsized":"2024-04-26T12:35:28.211076+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:41.098435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210635+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:28.210635+0000","last_peered":"2024-04-26T12:35:28.210635+0000","last_clean":"2024-04-26T12:35:28.210635+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:28.210635+0000","last_undegraded":"2024-04-26T12:35:28.210635+0000","last_fullsized":"2024-04-26T12:35:28.210635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212994+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:28.212994+0000","last_peered":"2024-04-26T12:35:28.212994+0000","last_clean":"2024-04-26T12:35:28.212994+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:28.212994+0000","last_undegraded":"2024-04-26T12:35:28.212994+0000","last_fullsized":"2024-04-26T12:35:28.212994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208687+0000","last_change":"2024-04-26T12:35:26.163875+0000","last_active":"2024-04-26T12:35:28.208687+0000","last_peered":"2024-04-26T12:35:28.208687+0000","last_clean":"2024-04-26T12:35:28.208687+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:35:28.208687+0000","last_undegraded":"2024-04-26T12:35:28.208687+0000","last_fullsized":"2024-04-26T12:35:28.208687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:05.697046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212247+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:28.212247+0000","last_peered":"2024-04-26T12:35:28.212247+0000","last_clean":"2024-04-26T12:35:28.212247+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:28.212247+0000","last_undegraded":"2024-04-26T12:35:28.212247+0000","last_fullsized":"2024-04-26T12:35:28.212247+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211893+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:28.211893+0000","last_peered":"2024-04-26T12:35:28.211893+0000","last_clean":"2024-04-26T12:35:28.211893+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:28.211893+0000","last_undegraded":"2024-04-26T12:35:28.211893+0000","last_fullsized":"2024-04-26T12:35:28.211893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210480+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:28.210480+0000","last_peered":"2024-04-26T12:35:28.210480+0000","last_clean":"2024-04-26T12:35:28.210480+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:28.210480+0000","last_undegraded":"2024-04-26T12:35:28.210480+0000","last_fullsized":"2024-04-26T12:35:28.210480+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210119+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:28.210119+0000","last_peered":"2024-04-26T12:35:28.210119+0000","last_clean":"2024-04-26T12:35:28.210119+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:28.210119+0000","last_undegraded":"2024-04-26T12:35:28.210119+0000","last_fullsized":"2024-04-26T12:35:28.210119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210995+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:28.210995+0000","last_peered":"2024-04-26T12:35:28.210995+0000","last_clean":"2024-04-26T12:35:28.210995+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:28.210995+0000","last_undegraded":"2024-04-26T12:35:28.210995+0000","last_fullsized":"2024-04-26T12:35:28.210995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212150+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:28.212150+0000","last_peered":"2024-04-26T12:35:28.212150+0000","last_clean":"2024-04-26T12:35:28.212150+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:28.212150+0000","last_undegraded":"2024-04-26T12:35:28.212150+0000","last_fullsized":"2024-04-26T12:35:28.212150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211472+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:28.211472+0000","last_peered":"2024-04-26T12:35:28.211472+0000","last_clean":"2024-04-26T12:35:28.211472+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:28.211472+0000","last_undegraded":"2024-04-26T12:35:28.211472+0000","last_fullsized":"2024-04-26T12:35:28.211472+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210224+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:28.210224+0000","last_peered":"2024-04-26T12:35:28.210224+0000","last_clean":"2024-04-26T12:35:28.210224+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:28.210224+0000","last_undegraded":"2024-04-26T12:35:28.210224+0000","last_fullsized":"2024-04-26T12:35:28.210224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.216208+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:28.216208+0000","last_peered":"2024-04-26T12:35:28.216208+0000","last_clean":"2024-04-26T12:35:28.216208+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:28.216208+0000","last_undegraded":"2024-04-26T12:35:28.216208+0000","last_fullsized":"2024-04-26T12:35:28.216208+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:21.559371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211736+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:28.211736+0000","last_peered":"2024-04-26T12:35:28.211736+0000","last_clean":"2024-04-26T12:35:28.211736+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:28.211736+0000","last_undegraded":"2024-04-26T12:35:28.211736+0000","last_fullsized":"2024-04-26T12:35:28.211736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210256+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:28.210256+0000","last_peered":"2024-04-26T12:35:28.210256+0000","last_clean":"2024-04-26T12:35:28.210256+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:28.210256+0000","last_undegraded":"2024-04-26T12:35:28.210256+0000","last_fullsized":"2024-04-26T12:35:28.210256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8089,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209089+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:28.209089+0000","last_peered":"2024-04-26T12:35:28.209089+0000","last_clean":"2024-04-26T12:35:28.209089+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:28.209089+0000","last_undegraded":"2024-04-26T12:35:28.209089+0000","last_fullsized":"2024-04-26T12:35:28.209089+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:57.436637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209248+0000","last_change":"2024-04-26T12:35:26.163739+0000","last_active":"2024-04-26T12:35:28.209248+0000","last_peered":"2024-04-26T12:35:28.209248+0000","last_clean":"2024-04-26T12:35:28.209248+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:28.209248+0000","last_undegraded":"2024-04-26T12:35:28.209248+0000","last_fullsized":"2024-04-26T12:35:28.209248+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:31.079482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210697+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:28.210697+0000","last_peered":"2024-04-26T12:35:28.210697+0000","last_clean":"2024-04-26T12:35:28.210697+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:28.210697+0000","last_undegraded":"2024-04-26T12:35:28.210697+0000","last_fullsized":"2024-04-26T12:35:28.210697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208545+0000","last_change":"2024-04-26T12:35:26.168819+0000","last_active":"2024-04-26T12:35:28.208545+0000","last_peered":"2024-04-26T12:35:28.208545+0000","last_clean":"2024-04-26T12:35:28.208545+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:28.208545+0000","last_undegraded":"2024-04-26T12:35:28.208545+0000","last_fullsized":"2024-04-26T12:35:28.208545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:49.140618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210842+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:28.210842+0000","last_peered":"2024-04-26T12:35:28.210842+0000","last_clean":"2024-04-26T12:35:28.210842+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:28.210842+0000","last_undegraded":"2024-04-26T12:35:28.210842+0000","last_fullsized":"2024-04-26T12:35:28.210842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210820+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:28.210820+0000","last_peered":"2024-04-26T12:35:28.210820+0000","last_clean":"2024-04-26T12:35:28.210820+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:28.210820+0000","last_undegraded":"2024-04-26T12:35:28.210820+0000","last_fullsized":"2024-04-26T12:35:28.210820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210121+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:28.210121+0000","last_peered":"2024-04-26T12:35:28.210121+0000","last_clean":"2024-04-26T12:35:28.210121+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:28.210121+0000","last_undegraded":"2024-04-26T12:35:28.210121+0000","last_fullsized":"2024-04-26T12:35:28.210121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212129+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:28.212129+0000","last_peered":"2024-04-26T12:35:28.212129+0000","last_clean":"2024-04-26T12:35:28.212129+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:28.212129+0000","last_undegraded":"2024-04-26T12:35:28.212129+0000","last_fullsized":"2024-04-26T12:35:28.212129+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":82,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211118+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:28.211118+0000","last_peered":"2024-04-26T12:35:28.211118+0000","last_clean":"2024-04-26T12:35:28.211118+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:28.211118+0000","last_undegraded":"2024-04-26T12:35:28.211118+0000","last_fullsized":"2024-04-26T12:35:28.211118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":98,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208544+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:28.208544+0000","last_peered":"2024-04-26T12:35:28.208544+0000","last_clean":"2024-04-26T12:35:28.208544+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:28.208544+0000","last_undegraded":"2024-04-26T12:35:28.208544+0000","last_fullsized":"2024-04-26T12:35:28.208544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208669+0000","last_change":"2024-04-26T12:35:26.164494+0000","last_active":"2024-04-26T12:35:28.208669+0000","last_peered":"2024-04-26T12:35:28.208669+0000","last_clean":"2024-04-26T12:35:28.208669+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:35:28.208669+0000","last_undegraded":"2024-04-26T12:35:28.208669+0000","last_fullsized":"2024-04-26T12:35:28.208669+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:10.400059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208829+0000","last_change":"2024-04-26T12:35:26.167507+0000","last_active":"2024-04-26T12:35:28.208829+0000","last_peered":"2024-04-26T12:35:28.208829+0000","last_clean":"2024-04-26T12:35:28.208829+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:35:28.208829+0000","last_undegraded":"2024-04-26T12:35:28.208829+0000","last_fullsized":"2024-04-26T12:35:28.208829+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:47.316526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":110,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212348+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:28.212348+0000","last_peered":"2024-04-26T12:35:28.212348+0000","last_clean":"2024-04-26T12:35:28.212348+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:28.212348+0000","last_undegraded":"2024-04-26T12:35:28.212348+0000","last_fullsized":"2024-04-26T12:35:28.212348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2157,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211789+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:28.211789+0000","last_peered":"2024-04-26T12:35:28.211789+0000","last_clean":"2024-04-26T12:35:28.211789+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:28.211789+0000","last_undegraded":"2024-04-26T12:35:28.211789+0000","last_fullsized":"2024-04-26T12:35:28.211789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:50.285275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":60,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209350+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:28.209350+0000","last_peered":"2024-04-26T12:35:28.209350+0000","last_clean":"2024-04-26T12:35:28.209350+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:28.209350+0000","last_undegraded":"2024-04-26T12:35:28.209350+0000","last_fullsized":"2024-04-26T12:35:28.209350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:37.674963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":114,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211631+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:28.211631+0000","last_peered":"2024-04-26T12:35:28.211631+0000","last_clean":"2024-04-26T12:35:28.211631+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:28.211631+0000","last_undegraded":"2024-04-26T12:35:28.211631+0000","last_fullsized":"2024-04-26T12:35:28.211631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210937+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:28.210937+0000","last_peered":"2024-04-26T12:35:28.210937+0000","last_clean":"2024-04-26T12:35:28.210937+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:28.210937+0000","last_undegraded":"2024-04-26T12:35:28.210937+0000","last_fullsized":"2024-04-26T12:35:28.210937+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4180,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208145+0000","last_change":"2024-04-26T12:35:26.167799+0000","last_active":"2024-04-26T12:35:28.208145+0000","last_peered":"2024-04-26T12:35:28.208145+0000","last_clean":"2024-04-26T12:35:28.208145+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:35:28.208145+0000","last_undegraded":"2024-04-26T12:35:28.208145+0000","last_fullsized":"2024-04-26T12:35:28.208145+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:35.792155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211036+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:28.211036+0000","last_peered":"2024-04-26T12:35:28.211036+0000","last_clean":"2024-04-26T12:35:28.211036+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:28.211036+0000","last_undegraded":"2024-04-26T12:35:28.211036+0000","last_fullsized":"2024-04-26T12:35:28.211036+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2165,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:35.341488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":117,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211625+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:28.211625+0000","last_peered":"2024-04-26T12:35:28.211625+0000","last_clean":"2024-04-26T12:35:28.211625+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:28.211625+0000","last_undegraded":"2024-04-26T12:35:28.211625+0000","last_fullsized":"2024-04-26T12:35:28.211625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210182+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:28.210182+0000","last_peered":"2024-04-26T12:35:28.210182+0000","last_clean":"2024-04-26T12:35:28.210182+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:28.210182+0000","last_undegraded":"2024-04-26T12:35:28.210182+0000","last_fullsized":"2024-04-26T12:35:28.210182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2027,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208731+0000","last_change":"2024-04-26T12:35:26.169463+0000","last_active":"2024-04-26T12:35:28.208731+0000","last_peered":"2024-04-26T12:35:28.208731+0000","last_clean":"2024-04-26T12:35:28.208731+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:35:28.208731+0000","last_undegraded":"2024-04-26T12:35:28.208731+0000","last_fullsized":"2024-04-26T12:35:28.208731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:48.293346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2132,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210411+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:28.210411+0000","last_peered":"2024-04-26T12:35:28.210411+0000","last_clean":"2024-04-26T12:35:28.210411+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:28.210411+0000","last_undegraded":"2024-04-26T12:35:28.210411+0000","last_fullsized":"2024-04-26T12:35:28.210411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2137,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208869+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:28.208869+0000","last_peered":"2024-04-26T12:35:28.208869+0000","last_clean":"2024-04-26T12:35:28.208869+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:28.208869+0000","last_undegraded":"2024-04-26T12:35:28.208869+0000","last_fullsized":"2024-04-26T12:35:28.208869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142984,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228856,"statfs":{"total":96636764160,"available":95466348544,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.61399999999999999}]}]},{"osd":0,"up_from":85,"seq":365072220168,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52668,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319172,"statfs":{"total":96636764160,"available":96582832128,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860672,"statfs":{"total":96636764160,"available":95089328128,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:35:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.42099999999999999,"15min":0.441},"min":{"1min":0.40699999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.64000000000000001,"5min":1.137,"15min":1.137},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:33.783 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:34.189 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:34.191 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:34.203 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-26T12:35:33.050527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119321,"ondisk_log_size":119321,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706820,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408700,"statfs":{"total":289910292480,"available":287138508800,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001754"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2083,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208960+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:28.208960+0000","last_peered":"2024-04-26T12:35:28.208960+0000","last_clean":"2024-04-26T12:35:28.208960+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:28.208960+0000","last_undegraded":"2024-04-26T12:35:28.208960+0000","last_fullsized":"2024-04-26T12:35:28.208960+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:30.341356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208831+0000","last_change":"2024-04-26T12:35:26.170471+0000","last_active":"2024-04-26T12:35:28.208831+0000","last_peered":"2024-04-26T12:35:28.208831+0000","last_clean":"2024-04-26T12:35:28.208831+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:28.208831+0000","last_undegraded":"2024-04-26T12:35:28.208831+0000","last_fullsized":"2024-04-26T12:35:28.208831+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4131,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213004+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:28.213004+0000","last_peered":"2024-04-26T12:35:28.213004+0000","last_clean":"2024-04-26T12:35:28.213004+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:28.213004+0000","last_undegraded":"2024-04-26T12:35:28.213004+0000","last_fullsized":"2024-04-26T12:35:28.213004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212620+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:28.212620+0000","last_peered":"2024-04-26T12:35:28.212620+0000","last_clean":"2024-04-26T12:35:28.212620+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:28.212620+0000","last_undegraded":"2024-04-26T12:35:28.212620+0000","last_fullsized":"2024-04-26T12:35:28.212620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2154,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208571+0000","last_change":"2024-04-26T12:35:26.167949+0000","last_active":"2024-04-26T12:35:28.208571+0000","last_peered":"2024-04-26T12:35:28.208571+0000","last_clean":"2024-04-26T12:35:28.208571+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:35:28.208571+0000","last_undegraded":"2024-04-26T12:35:28.208571+0000","last_fullsized":"2024-04-26T12:35:28.208571+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:10.256259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214572+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:28.214572+0000","last_peered":"2024-04-26T12:35:28.214572+0000","last_clean":"2024-04-26T12:35:28.214572+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:28.214572+0000","last_undegraded":"2024-04-26T12:35:28.214572+0000","last_fullsized":"2024-04-26T12:35:28.214572+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:22.116087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214925+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:28.214925+0000","last_peered":"2024-04-26T12:35:28.214925+0000","last_clean":"2024-04-26T12:35:28.214925+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:28.214925+0000","last_undegraded":"2024-04-26T12:35:28.214925+0000","last_fullsized":"2024-04-26T12:35:28.214925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:19.062004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8204,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211343+0000","last_change":"2024-04-26T12:35:06.903708+0000","last_active":"2024-04-26T12:35:28.211343+0000","last_peered":"2024-04-26T12:35:28.211343+0000","last_clean":"2024-04-26T12:35:28.211343+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:28.211343+0000","last_undegraded":"2024-04-26T12:35:28.211343+0000","last_fullsized":"2024-04-26T12:35:28.211343+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211204+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:28.211204+0000","last_peered":"2024-04-26T12:35:28.211204+0000","last_clean":"2024-04-26T12:35:28.211204+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:28.211204+0000","last_undegraded":"2024-04-26T12:35:28.211204+0000","last_fullsized":"2024-04-26T12:35:28.211204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:49.537738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6240,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208908+0000","last_change":"2024-04-26T12:35:26.170653+0000","last_active":"2024-04-26T12:35:28.208908+0000","last_peered":"2024-04-26T12:35:28.208908+0000","last_clean":"2024-04-26T12:35:28.208908+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:28.208908+0000","last_undegraded":"2024-04-26T12:35:28.208908+0000","last_fullsized":"2024-04-26T12:35:28.208908+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:48.807860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240430+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:29.240430+0000","last_peered":"2024-04-26T12:35:29.240430+0000","last_clean":"2024-04-26T12:35:29.240430+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:29.240430+0000","last_undegraded":"2024-04-26T12:35:29.240430+0000","last_fullsized":"2024-04-26T12:35:29.240430+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:03.142930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2093,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208562+0000","last_change":"2024-04-26T12:35:26.168307+0000","last_active":"2024-04-26T12:35:28.208562+0000","last_peered":"2024-04-26T12:35:28.208562+0000","last_clean":"2024-04-26T12:35:28.208562+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:28.208562+0000","last_undegraded":"2024-04-26T12:35:28.208562+0000","last_fullsized":"2024-04-26T12:35:28.208562+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:10.743574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2138,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208382+0000","last_change":"2024-04-26T12:35:26.167308+0000","last_active":"2024-04-26T12:35:28.208382+0000","last_peered":"2024-04-26T12:35:28.208382+0000","last_clean":"2024-04-26T12:35:28.208382+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:35:28.208382+0000","last_undegraded":"2024-04-26T12:35:28.208382+0000","last_fullsized":"2024-04-26T12:35:28.208382+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:55.062566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2147,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212441+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:28.212441+0000","last_peered":"2024-04-26T12:35:28.212441+0000","last_clean":"2024-04-26T12:35:28.212441+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:28.212441+0000","last_undegraded":"2024-04-26T12:35:28.212441+0000","last_fullsized":"2024-04-26T12:35:28.212441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2166,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211989+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:28.211989+0000","last_peered":"2024-04-26T12:35:28.211989+0000","last_clean":"2024-04-26T12:35:28.211989+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:28.211989+0000","last_undegraded":"2024-04-26T12:35:28.211989+0000","last_fullsized":"2024-04-26T12:35:28.211989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239840+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:29.239840+0000","last_peered":"2024-04-26T12:35:29.239840+0000","last_clean":"2024-04-26T12:35:29.239840+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:29.239840+0000","last_undegraded":"2024-04-26T12:35:29.239840+0000","last_fullsized":"2024-04-26T12:35:29.239840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:42.219006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2118,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211167+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:28.211167+0000","last_peered":"2024-04-26T12:35:28.211167+0000","last_clean":"2024-04-26T12:35:28.211167+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:28.211167+0000","last_undegraded":"2024-04-26T12:35:28.211167+0000","last_fullsized":"2024-04-26T12:35:28.211167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:52.856014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2140,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209159+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:28.209159+0000","last_peered":"2024-04-26T12:35:28.209159+0000","last_clean":"2024-04-26T12:35:28.209159+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:28.209159+0000","last_undegraded":"2024-04-26T12:35:28.209159+0000","last_fullsized":"2024-04-26T12:35:28.209159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4098,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210794+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:28.210794+0000","last_peered":"2024-04-26T12:35:28.210794+0000","last_clean":"2024-04-26T12:35:28.210794+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:28.210794+0000","last_undegraded":"2024-04-26T12:35:28.210794+0000","last_fullsized":"2024-04-26T12:35:28.210794+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.866275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4222,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212532+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:28.212532+0000","last_peered":"2024-04-26T12:35:28.212532+0000","last_clean":"2024-04-26T12:35:28.212532+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:28.212532+0000","last_undegraded":"2024-04-26T12:35:28.212532+0000","last_fullsized":"2024-04-26T12:35:28.212532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:03.877816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211555+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:28.211555+0000","last_peered":"2024-04-26T12:35:28.211555+0000","last_clean":"2024-04-26T12:35:28.211555+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:28.211555+0000","last_undegraded":"2024-04-26T12:35:28.211555+0000","last_fullsized":"2024-04-26T12:35:28.211555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208329+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:28.208329+0000","last_peered":"2024-04-26T12:35:28.208329+0000","last_clean":"2024-04-26T12:35:28.208329+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:28.208329+0000","last_undegraded":"2024-04-26T12:35:28.208329+0000","last_fullsized":"2024-04-26T12:35:28.208329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210072+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:28.210072+0000","last_peered":"2024-04-26T12:35:28.210072+0000","last_clean":"2024-04-26T12:35:28.210072+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:28.210072+0000","last_undegraded":"2024-04-26T12:35:28.210072+0000","last_fullsized":"2024-04-26T12:35:28.210072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4139,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208389+0000","last_change":"2024-04-26T12:35:26.165413+0000","last_active":"2024-04-26T12:35:28.208389+0000","last_peered":"2024-04-26T12:35:28.208389+0000","last_clean":"2024-04-26T12:35:28.208389+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:35:28.208389+0000","last_undegraded":"2024-04-26T12:35:28.208389+0000","last_fullsized":"2024-04-26T12:35:28.208389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.367083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2141,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209087+0000","last_change":"2024-04-26T12:35:26.170324+0000","last_active":"2024-04-26T12:35:28.209087+0000","last_peered":"2024-04-26T12:35:28.209087+0000","last_clean":"2024-04-26T12:35:28.209087+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:28.209087+0000","last_undegraded":"2024-04-26T12:35:28.209087+0000","last_fullsized":"2024-04-26T12:35:28.209087+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:58.838513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211224+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:28.211224+0000","last_peered":"2024-04-26T12:35:28.211224+0000","last_clean":"2024-04-26T12:35:28.211224+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:28.211224+0000","last_undegraded":"2024-04-26T12:35:28.211224+0000","last_fullsized":"2024-04-26T12:35:28.211224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2101,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212916+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:28.212916+0000","last_peered":"2024-04-26T12:35:28.212916+0000","last_clean":"2024-04-26T12:35:28.212916+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:28.212916+0000","last_undegraded":"2024-04-26T12:35:28.212916+0000","last_fullsized":"2024-04-26T12:35:28.212916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208583+0000","last_change":"2024-04-26T12:35:26.165397+0000","last_active":"2024-04-26T12:35:28.208583+0000","last_peered":"2024-04-26T12:35:28.208583+0000","last_clean":"2024-04-26T12:35:28.208583+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:35:28.208583+0000","last_undegraded":"2024-04-26T12:35:28.208583+0000","last_fullsized":"2024-04-26T12:35:28.208583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:11.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209095+0000","last_change":"2024-04-26T12:35:26.166754+0000","last_active":"2024-04-26T12:35:28.209095+0000","last_peered":"2024-04-26T12:35:28.209095+0000","last_clean":"2024-04-26T12:35:28.209095+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:28.209095+0000","last_undegraded":"2024-04-26T12:35:28.209095+0000","last_fullsized":"2024-04-26T12:35:28.209095+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:52.222681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209874+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:28.209874+0000","last_peered":"2024-04-26T12:35:28.209874+0000","last_clean":"2024-04-26T12:35:28.209874+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:28.209874+0000","last_undegraded":"2024-04-26T12:35:28.209874+0000","last_fullsized":"2024-04-26T12:35:28.209874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211032+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:28.211032+0000","last_peered":"2024-04-26T12:35:28.211032+0000","last_clean":"2024-04-26T12:35:28.211032+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:28.211032+0000","last_undegraded":"2024-04-26T12:35:28.211032+0000","last_fullsized":"2024-04-26T12:35:28.211032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209808+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:28.209808+0000","last_peered":"2024-04-26T12:35:28.209808+0000","last_clean":"2024-04-26T12:35:28.209808+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:28.209808+0000","last_undegraded":"2024-04-26T12:35:28.209808+0000","last_fullsized":"2024-04-26T12:35:28.209808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209274+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:28.209274+0000","last_peered":"2024-04-26T12:35:28.209274+0000","last_clean":"2024-04-26T12:35:28.209274+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:28.209274+0000","last_undegraded":"2024-04-26T12:35:28.209274+0000","last_fullsized":"2024-04-26T12:35:28.209274+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:19.816252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210919+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:28.210919+0000","last_peered":"2024-04-26T12:35:28.210919+0000","last_clean":"2024-04-26T12:35:28.210919+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:28.210919+0000","last_undegraded":"2024-04-26T12:35:28.210919+0000","last_fullsized":"2024-04-26T12:35:28.210919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210388+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:28.210388+0000","last_peered":"2024-04-26T12:35:28.210388+0000","last_clean":"2024-04-26T12:35:28.210388+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:28.210388+0000","last_undegraded":"2024-04-26T12:35:28.210388+0000","last_fullsized":"2024-04-26T12:35:28.210388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240723+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:29.240723+0000","last_peered":"2024-04-26T12:35:29.240723+0000","last_clean":"2024-04-26T12:35:29.240723+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:29.240723+0000","last_undegraded":"2024-04-26T12:35:29.240723+0000","last_fullsized":"2024-04-26T12:35:29.240723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:38.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6182,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209958+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:28.209958+0000","last_peered":"2024-04-26T12:35:28.209958+0000","last_clean":"2024-04-26T12:35:28.209958+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:28.209958+0000","last_undegraded":"2024-04-26T12:35:28.209958+0000","last_fullsized":"2024-04-26T12:35:28.209958+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:50.387270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209285+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:28.209285+0000","last_peered":"2024-04-26T12:35:28.209285+0000","last_clean":"2024-04-26T12:35:28.209285+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:28.209285+0000","last_undegraded":"2024-04-26T12:35:28.209285+0000","last_fullsized":"2024-04-26T12:35:28.209285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:53.309649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4162,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210081+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:28.210081+0000","last_peered":"2024-04-26T12:35:28.210081+0000","last_clean":"2024-04-26T12:35:28.210081+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:28.210081+0000","last_undegraded":"2024-04-26T12:35:28.210081+0000","last_fullsized":"2024-04-26T12:35:28.210081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":192,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212508+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:28.212508+0000","last_peered":"2024-04-26T12:35:28.212508+0000","last_clean":"2024-04-26T12:35:28.212508+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:28.212508+0000","last_undegraded":"2024-04-26T12:35:28.212508+0000","last_fullsized":"2024-04-26T12:35:28.212508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4189,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212280+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:28.212280+0000","last_peered":"2024-04-26T12:35:28.212280+0000","last_clean":"2024-04-26T12:35:28.212280+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:28.212280+0000","last_undegraded":"2024-04-26T12:35:28.212280+0000","last_fullsized":"2024-04-26T12:35:28.212280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212311+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:28.212311+0000","last_peered":"2024-04-26T12:35:28.212311+0000","last_clean":"2024-04-26T12:35:28.212311+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:28.212311+0000","last_undegraded":"2024-04-26T12:35:28.212311+0000","last_fullsized":"2024-04-26T12:35:28.212311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2081,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208726+0000","last_change":"2024-04-26T12:35:26.166921+0000","last_active":"2024-04-26T12:35:28.208726+0000","last_peered":"2024-04-26T12:35:28.208726+0000","last_clean":"2024-04-26T12:35:28.208726+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:35:28.208726+0000","last_undegraded":"2024-04-26T12:35:28.208726+0000","last_fullsized":"2024-04-26T12:35:28.208726+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2078,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209347+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:28.209347+0000","last_peered":"2024-04-26T12:35:28.209347+0000","last_clean":"2024-04-26T12:35:28.209347+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:28.209347+0000","last_undegraded":"2024-04-26T12:35:28.209347+0000","last_fullsized":"2024-04-26T12:35:28.209347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:37.025987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208419+0000","last_change":"2024-04-26T12:35:26.163714+0000","last_active":"2024-04-26T12:35:28.208419+0000","last_peered":"2024-04-26T12:35:28.208419+0000","last_clean":"2024-04-26T12:35:28.208419+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:35:28.208419+0000","last_undegraded":"2024-04-26T12:35:28.208419+0000","last_fullsized":"2024-04-26T12:35:28.208419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:56.750192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211123+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:28.211123+0000","last_peered":"2024-04-26T12:35:28.211123+0000","last_clean":"2024-04-26T12:35:28.211123+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:28.211123+0000","last_undegraded":"2024-04-26T12:35:28.211123+0000","last_fullsized":"2024-04-26T12:35:28.211123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":105,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211774+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:28.211774+0000","last_peered":"2024-04-26T12:35:28.211774+0000","last_clean":"2024-04-26T12:35:28.211774+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:28.211774+0000","last_undegraded":"2024-04-26T12:35:28.211774+0000","last_fullsized":"2024-04-26T12:35:28.211774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2169,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211139+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:28.211139+0000","last_peered":"2024-04-26T12:35:28.211139+0000","last_clean":"2024-04-26T12:35:28.211139+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:28.211139+0000","last_undegraded":"2024-04-26T12:35:28.211139+0000","last_fullsized":"2024-04-26T12:35:28.211139+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:50.006267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":97,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212429+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:28.212429+0000","last_peered":"2024-04-26T12:35:28.212429+0000","last_clean":"2024-04-26T12:35:28.212429+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:28.212429+0000","last_undegraded":"2024-04-26T12:35:28.212429+0000","last_fullsized":"2024-04-26T12:35:28.212429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208506+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:28.208506+0000","last_peered":"2024-04-26T12:35:28.208506+0000","last_clean":"2024-04-26T12:35:28.208506+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:28.208506+0000","last_undegraded":"2024-04-26T12:35:28.208506+0000","last_fullsized":"2024-04-26T12:35:28.208506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:14.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208961+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:28.208961+0000","last_peered":"2024-04-26T12:35:28.208961+0000","last_clean":"2024-04-26T12:35:28.208961+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:28.208961+0000","last_undegraded":"2024-04-26T12:35:28.208961+0000","last_fullsized":"2024-04-26T12:35:28.208961+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208600+0000","last_change":"2024-04-26T12:35:26.165209+0000","last_active":"2024-04-26T12:35:28.208600+0000","last_peered":"2024-04-26T12:35:28.208600+0000","last_clean":"2024-04-26T12:35:28.208600+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:28.208600+0000","last_undegraded":"2024-04-26T12:35:28.208600+0000","last_fullsized":"2024-04-26T12:35:28.208600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:19.522824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":30,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240548+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:29.240548+0000","last_peered":"2024-04-26T12:35:29.240548+0000","last_clean":"2024-04-26T12:35:29.240548+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:29.240548+0000","last_undegraded":"2024-04-26T12:35:29.240548+0000","last_fullsized":"2024-04-26T12:35:29.240548+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:42.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211821+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:28.211821+0000","last_peered":"2024-04-26T12:35:28.211821+0000","last_clean":"2024-04-26T12:35:28.211821+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:28.211821+0000","last_undegraded":"2024-04-26T12:35:28.211821+0000","last_fullsized":"2024-04-26T12:35:28.211821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211859+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:28.211859+0000","last_peered":"2024-04-26T12:35:28.211859+0000","last_clean":"2024-04-26T12:35:28.211859+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:28.211859+0000","last_undegraded":"2024-04-26T12:35:28.211859+0000","last_fullsized":"2024-04-26T12:35:28.211859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210318+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:28.210318+0000","last_peered":"2024-04-26T12:35:28.210318+0000","last_clean":"2024-04-26T12:35:28.210318+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:28.210318+0000","last_undegraded":"2024-04-26T12:35:28.210318+0000","last_fullsized":"2024-04-26T12:35:28.210318+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212057+0000","last_change":"2024-04-26T12:35:05.902297+0000","last_active":"2024-04-26T12:35:28.212057+0000","last_peered":"2024-04-26T12:35:28.212057+0000","last_clean":"2024-04-26T12:35:28.212057+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:28.212057+0000","last_undegraded":"2024-04-26T12:35:28.212057+0000","last_fullsized":"2024-04-26T12:35:28.212057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:37.434819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211660+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:28.211660+0000","last_peered":"2024-04-26T12:35:28.211660+0000","last_clean":"2024-04-26T12:35:28.211660+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:28.211660+0000","last_undegraded":"2024-04-26T12:35:28.211660+0000","last_fullsized":"2024-04-26T12:35:28.211660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2134,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213133+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:28.213133+0000","last_peered":"2024-04-26T12:35:28.213133+0000","last_clean":"2024-04-26T12:35:28.213133+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:28.213133+0000","last_undegraded":"2024-04-26T12:35:28.213133+0000","last_fullsized":"2024-04-26T12:35:28.213133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208228+0000","last_change":"2024-04-26T12:35:26.161621+0000","last_active":"2024-04-26T12:35:28.208228+0000","last_peered":"2024-04-26T12:35:28.208228+0000","last_clean":"2024-04-26T12:35:28.208228+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:35:28.208228+0000","last_undegraded":"2024-04-26T12:35:28.208228+0000","last_fullsized":"2024-04-26T12:35:28.208228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:44.708029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212154+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:28.212154+0000","last_peered":"2024-04-26T12:35:28.212154+0000","last_clean":"2024-04-26T12:35:28.212154+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:28.212154+0000","last_undegraded":"2024-04-26T12:35:28.212154+0000","last_fullsized":"2024-04-26T12:35:28.212154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208344+0000","last_change":"2024-04-26T12:35:26.163568+0000","last_active":"2024-04-26T12:35:28.208344+0000","last_peered":"2024-04-26T12:35:28.208344+0000","last_clean":"2024-04-26T12:35:28.208344+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:35:28.208344+0000","last_undegraded":"2024-04-26T12:35:28.208344+0000","last_fullsized":"2024-04-26T12:35:28.208344+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:01.190879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211076+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:28.211076+0000","last_peered":"2024-04-26T12:35:28.211076+0000","last_clean":"2024-04-26T12:35:28.211076+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:28.211076+0000","last_undegraded":"2024-04-26T12:35:28.211076+0000","last_fullsized":"2024-04-26T12:35:28.211076+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:41.098435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210635+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:28.210635+0000","last_peered":"2024-04-26T12:35:28.210635+0000","last_clean":"2024-04-26T12:35:28.210635+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:28.210635+0000","last_undegraded":"2024-04-26T12:35:28.210635+0000","last_fullsized":"2024-04-26T12:35:28.210635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212994+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:28.212994+0000","last_peered":"2024-04-26T12:35:28.212994+0000","last_clean":"2024-04-26T12:35:28.212994+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:28.212994+0000","last_undegraded":"2024-04-26T12:35:28.212994+0000","last_fullsized":"2024-04-26T12:35:28.212994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208687+0000","last_change":"2024-04-26T12:35:26.163875+0000","last_active":"2024-04-26T12:35:28.208687+0000","last_peered":"2024-04-26T12:35:28.208687+0000","last_clean":"2024-04-26T12:35:28.208687+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:35:28.208687+0000","last_undegraded":"2024-04-26T12:35:28.208687+0000","last_fullsized":"2024-04-26T12:35:28.208687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:05.697046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212247+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:28.212247+0000","last_peered":"2024-04-26T12:35:28.212247+0000","last_clean":"2024-04-26T12:35:28.212247+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:28.212247+0000","last_undegraded":"2024-04-26T12:35:28.212247+0000","last_fullsized":"2024-04-26T12:35:28.212247+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211893+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:28.211893+0000","last_peered":"2024-04-26T12:35:28.211893+0000","last_clean":"2024-04-26T12:35:28.211893+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:28.211893+0000","last_undegraded":"2024-04-26T12:35:28.211893+0000","last_fullsized":"2024-04-26T12:35:28.211893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210480+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:28.210480+0000","last_peered":"2024-04-26T12:35:28.210480+0000","last_clean":"2024-04-26T12:35:28.210480+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:28.210480+0000","last_undegraded":"2024-04-26T12:35:28.210480+0000","last_fullsized":"2024-04-26T12:35:28.210480+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210119+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:28.210119+0000","last_peered":"2024-04-26T12:35:28.210119+0000","last_clean":"2024-04-26T12:35:28.210119+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:28.210119+0000","last_undegraded":"2024-04-26T12:35:28.210119+0000","last_fullsized":"2024-04-26T12:35:28.210119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210995+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:28.210995+0000","last_peered":"2024-04-26T12:35:28.210995+0000","last_clean":"2024-04-26T12:35:28.210995+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:28.210995+0000","last_undegraded":"2024-04-26T12:35:28.210995+0000","last_fullsized":"2024-04-26T12:35:28.210995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212150+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:28.212150+0000","last_peered":"2024-04-26T12:35:28.212150+0000","last_clean":"2024-04-26T12:35:28.212150+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:28.212150+0000","last_undegraded":"2024-04-26T12:35:28.212150+0000","last_fullsized":"2024-04-26T12:35:28.212150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211472+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:28.211472+0000","last_peered":"2024-04-26T12:35:28.211472+0000","last_clean":"2024-04-26T12:35:28.211472+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:28.211472+0000","last_undegraded":"2024-04-26T12:35:28.211472+0000","last_fullsized":"2024-04-26T12:35:28.211472+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210224+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:28.210224+0000","last_peered":"2024-04-26T12:35:28.210224+0000","last_clean":"2024-04-26T12:35:28.210224+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:28.210224+0000","last_undegraded":"2024-04-26T12:35:28.210224+0000","last_fullsized":"2024-04-26T12:35:28.210224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.216208+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:28.216208+0000","last_peered":"2024-04-26T12:35:28.216208+0000","last_clean":"2024-04-26T12:35:28.216208+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:28.216208+0000","last_undegraded":"2024-04-26T12:35:28.216208+0000","last_fullsized":"2024-04-26T12:35:28.216208+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:21.559371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211736+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:28.211736+0000","last_peered":"2024-04-26T12:35:28.211736+0000","last_clean":"2024-04-26T12:35:28.211736+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:28.211736+0000","last_undegraded":"2024-04-26T12:35:28.211736+0000","last_fullsized":"2024-04-26T12:35:28.211736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210256+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:28.210256+0000","last_peered":"2024-04-26T12:35:28.210256+0000","last_clean":"2024-04-26T12:35:28.210256+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:28.210256+0000","last_undegraded":"2024-04-26T12:35:28.210256+0000","last_fullsized":"2024-04-26T12:35:28.210256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8089,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209089+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:28.209089+0000","last_peered":"2024-04-26T12:35:28.209089+0000","last_clean":"2024-04-26T12:35:28.209089+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:28.209089+0000","last_undegraded":"2024-04-26T12:35:28.209089+0000","last_fullsized":"2024-04-26T12:35:28.209089+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:57.436637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209248+0000","last_change":"2024-04-26T12:35:26.163739+0000","last_active":"2024-04-26T12:35:28.209248+0000","last_peered":"2024-04-26T12:35:28.209248+0000","last_clean":"2024-04-26T12:35:28.209248+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:28.209248+0000","last_undegraded":"2024-04-26T12:35:28.209248+0000","last_fullsized":"2024-04-26T12:35:28.209248+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:31.079482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210697+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:28.210697+0000","last_peered":"2024-04-26T12:35:28.210697+0000","last_clean":"2024-04-26T12:35:28.210697+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:28.210697+0000","last_undegraded":"2024-04-26T12:35:28.210697+0000","last_fullsized":"2024-04-26T12:35:28.210697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208545+0000","last_change":"2024-04-26T12:35:26.168819+0000","last_active":"2024-04-26T12:35:28.208545+0000","last_peered":"2024-04-26T12:35:28.208545+0000","last_clean":"2024-04-26T12:35:28.208545+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:28.208545+0000","last_undegraded":"2024-04-26T12:35:28.208545+0000","last_fullsized":"2024-04-26T12:35:28.208545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:49.140618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210842+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:28.210842+0000","last_peered":"2024-04-26T12:35:28.210842+0000","last_clean":"2024-04-26T12:35:28.210842+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:28.210842+0000","last_undegraded":"2024-04-26T12:35:28.210842+0000","last_fullsized":"2024-04-26T12:35:28.210842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210820+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:28.210820+0000","last_peered":"2024-04-26T12:35:28.210820+0000","last_clean":"2024-04-26T12:35:28.210820+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:28.210820+0000","last_undegraded":"2024-04-26T12:35:28.210820+0000","last_fullsized":"2024-04-26T12:35:28.210820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210121+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:28.210121+0000","last_peered":"2024-04-26T12:35:28.210121+0000","last_clean":"2024-04-26T12:35:28.210121+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:28.210121+0000","last_undegraded":"2024-04-26T12:35:28.210121+0000","last_fullsized":"2024-04-26T12:35:28.210121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212129+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:28.212129+0000","last_peered":"2024-04-26T12:35:28.212129+0000","last_clean":"2024-04-26T12:35:28.212129+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:28.212129+0000","last_undegraded":"2024-04-26T12:35:28.212129+0000","last_fullsized":"2024-04-26T12:35:28.212129+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":82,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211118+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:28.211118+0000","last_peered":"2024-04-26T12:35:28.211118+0000","last_clean":"2024-04-26T12:35:28.211118+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:28.211118+0000","last_undegraded":"2024-04-26T12:35:28.211118+0000","last_fullsized":"2024-04-26T12:35:28.211118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":98,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208544+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:28.208544+0000","last_peered":"2024-04-26T12:35:28.208544+0000","last_clean":"2024-04-26T12:35:28.208544+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:28.208544+0000","last_undegraded":"2024-04-26T12:35:28.208544+0000","last_fullsized":"2024-04-26T12:35:28.208544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208669+0000","last_change":"2024-04-26T12:35:26.164494+0000","last_active":"2024-04-26T12:35:28.208669+0000","last_peered":"2024-04-26T12:35:28.208669+0000","last_clean":"2024-04-26T12:35:28.208669+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:35:28.208669+0000","last_undegraded":"2024-04-26T12:35:28.208669+0000","last_fullsized":"2024-04-26T12:35:28.208669+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:10.400059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208829+0000","last_change":"2024-04-26T12:35:26.167507+0000","last_active":"2024-04-26T12:35:28.208829+0000","last_peered":"2024-04-26T12:35:28.208829+0000","last_clean":"2024-04-26T12:35:28.208829+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:35:28.208829+0000","last_undegraded":"2024-04-26T12:35:28.208829+0000","last_fullsized":"2024-04-26T12:35:28.208829+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:47.316526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":110,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212348+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:28.212348+0000","last_peered":"2024-04-26T12:35:28.212348+0000","last_clean":"2024-04-26T12:35:28.212348+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:28.212348+0000","last_undegraded":"2024-04-26T12:35:28.212348+0000","last_fullsized":"2024-04-26T12:35:28.212348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2157,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211789+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:28.211789+0000","last_peered":"2024-04-26T12:35:28.211789+0000","last_clean":"2024-04-26T12:35:28.211789+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:28.211789+0000","last_undegraded":"2024-04-26T12:35:28.211789+0000","last_fullsized":"2024-04-26T12:35:28.211789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:50.285275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":60,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209350+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:28.209350+0000","last_peered":"2024-04-26T12:35:28.209350+0000","last_clean":"2024-04-26T12:35:28.209350+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:28.209350+0000","last_undegraded":"2024-04-26T12:35:28.209350+0000","last_fullsized":"2024-04-26T12:35:28.209350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:37.674963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":114,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211631+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:28.211631+0000","last_peered":"2024-04-26T12:35:28.211631+0000","last_clean":"2024-04-26T12:35:28.211631+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:28.211631+0000","last_undegraded":"2024-04-26T12:35:28.211631+0000","last_fullsized":"2024-04-26T12:35:28.211631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210937+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:28.210937+0000","last_peered":"2024-04-26T12:35:28.210937+0000","last_clean":"2024-04-26T12:35:28.210937+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:28.210937+0000","last_undegraded":"2024-04-26T12:35:28.210937+0000","last_fullsized":"2024-04-26T12:35:28.210937+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4180,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208145+0000","last_change":"2024-04-26T12:35:26.167799+0000","last_active":"2024-04-26T12:35:28.208145+0000","last_peered":"2024-04-26T12:35:28.208145+0000","last_clean":"2024-04-26T12:35:28.208145+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:35:28.208145+0000","last_undegraded":"2024-04-26T12:35:28.208145+0000","last_fullsized":"2024-04-26T12:35:28.208145+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:35.792155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211036+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:28.211036+0000","last_peered":"2024-04-26T12:35:28.211036+0000","last_clean":"2024-04-26T12:35:28.211036+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:28.211036+0000","last_undegraded":"2024-04-26T12:35:28.211036+0000","last_fullsized":"2024-04-26T12:35:28.211036+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2165,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:35.341488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":117,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211625+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:28.211625+0000","last_peered":"2024-04-26T12:35:28.211625+0000","last_clean":"2024-04-26T12:35:28.211625+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:28.211625+0000","last_undegraded":"2024-04-26T12:35:28.211625+0000","last_fullsized":"2024-04-26T12:35:28.211625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210182+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:28.210182+0000","last_peered":"2024-04-26T12:35:28.210182+0000","last_clean":"2024-04-26T12:35:28.210182+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:28.210182+0000","last_undegraded":"2024-04-26T12:35:28.210182+0000","last_fullsized":"2024-04-26T12:35:28.210182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2027,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208731+0000","last_change":"2024-04-26T12:35:26.169463+0000","last_active":"2024-04-26T12:35:28.208731+0000","last_peered":"2024-04-26T12:35:28.208731+0000","last_clean":"2024-04-26T12:35:28.208731+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:35:28.208731+0000","last_undegraded":"2024-04-26T12:35:28.208731+0000","last_fullsized":"2024-04-26T12:35:28.208731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:48.293346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2132,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210411+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:28.210411+0000","last_peered":"2024-04-26T12:35:28.210411+0000","last_clean":"2024-04-26T12:35:28.210411+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:28.210411+0000","last_undegraded":"2024-04-26T12:35:28.210411+0000","last_fullsized":"2024-04-26T12:35:28.210411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2137,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208869+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:28.208869+0000","last_peered":"2024-04-26T12:35:28.208869+0000","last_clean":"2024-04-26T12:35:28.208869+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:28.208869+0000","last_undegraded":"2024-04-26T12:35:28.208869+0000","last_fullsized":"2024-04-26T12:35:28.208869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142984,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228856,"statfs":{"total":96636764160,"available":95466348544,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.61399999999999999}]}]},{"osd":0,"up_from":85,"seq":365072220168,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52668,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319172,"statfs":{"total":96636764160,"available":96582832128,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860672,"statfs":{"total":96636764160,"available":95089328128,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:35:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.42099999999999999,"15min":0.441},"min":{"1min":0.40699999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.64000000000000001,"5min":1.137,"15min":1.137},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:34.207 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:35:34.208 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:34.617 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:34.619 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:34.631 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-26T12:35:33.050527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119321,"ondisk_log_size":119321,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706820,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408700,"statfs":{"total":289910292480,"available":287138508800,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001754"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2083,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208960+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:28.208960+0000","last_peered":"2024-04-26T12:35:28.208960+0000","last_clean":"2024-04-26T12:35:28.208960+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:28.208960+0000","last_undegraded":"2024-04-26T12:35:28.208960+0000","last_fullsized":"2024-04-26T12:35:28.208960+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:30.341356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208831+0000","last_change":"2024-04-26T12:35:26.170471+0000","last_active":"2024-04-26T12:35:28.208831+0000","last_peered":"2024-04-26T12:35:28.208831+0000","last_clean":"2024-04-26T12:35:28.208831+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:28.208831+0000","last_undegraded":"2024-04-26T12:35:28.208831+0000","last_fullsized":"2024-04-26T12:35:28.208831+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4131,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213004+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:28.213004+0000","last_peered":"2024-04-26T12:35:28.213004+0000","last_clean":"2024-04-26T12:35:28.213004+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:28.213004+0000","last_undegraded":"2024-04-26T12:35:28.213004+0000","last_fullsized":"2024-04-26T12:35:28.213004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212620+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:28.212620+0000","last_peered":"2024-04-26T12:35:28.212620+0000","last_clean":"2024-04-26T12:35:28.212620+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:28.212620+0000","last_undegraded":"2024-04-26T12:35:28.212620+0000","last_fullsized":"2024-04-26T12:35:28.212620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2154,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208571+0000","last_change":"2024-04-26T12:35:26.167949+0000","last_active":"2024-04-26T12:35:28.208571+0000","last_peered":"2024-04-26T12:35:28.208571+0000","last_clean":"2024-04-26T12:35:28.208571+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:35:28.208571+0000","last_undegraded":"2024-04-26T12:35:28.208571+0000","last_fullsized":"2024-04-26T12:35:28.208571+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:10.256259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214572+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:28.214572+0000","last_peered":"2024-04-26T12:35:28.214572+0000","last_clean":"2024-04-26T12:35:28.214572+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:28.214572+0000","last_undegraded":"2024-04-26T12:35:28.214572+0000","last_fullsized":"2024-04-26T12:35:28.214572+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:22.116087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.214925+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:28.214925+0000","last_peered":"2024-04-26T12:35:28.214925+0000","last_clean":"2024-04-26T12:35:28.214925+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:28.214925+0000","last_undegraded":"2024-04-26T12:35:28.214925+0000","last_fullsized":"2024-04-26T12:35:28.214925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:19.062004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8204,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211343+0000","last_change":"2024-04-26T12:35:06.903708+0000","last_active":"2024-04-26T12:35:28.211343+0000","last_peered":"2024-04-26T12:35:28.211343+0000","last_clean":"2024-04-26T12:35:28.211343+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:28.211343+0000","last_undegraded":"2024-04-26T12:35:28.211343+0000","last_fullsized":"2024-04-26T12:35:28.211343+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211204+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:28.211204+0000","last_peered":"2024-04-26T12:35:28.211204+0000","last_clean":"2024-04-26T12:35:28.211204+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:28.211204+0000","last_undegraded":"2024-04-26T12:35:28.211204+0000","last_fullsized":"2024-04-26T12:35:28.211204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:49.537738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6240,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208908+0000","last_change":"2024-04-26T12:35:26.170653+0000","last_active":"2024-04-26T12:35:28.208908+0000","last_peered":"2024-04-26T12:35:28.208908+0000","last_clean":"2024-04-26T12:35:28.208908+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:28.208908+0000","last_undegraded":"2024-04-26T12:35:28.208908+0000","last_fullsized":"2024-04-26T12:35:28.208908+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:48.807860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240430+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:29.240430+0000","last_peered":"2024-04-26T12:35:29.240430+0000","last_clean":"2024-04-26T12:35:29.240430+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:29.240430+0000","last_undegraded":"2024-04-26T12:35:29.240430+0000","last_fullsized":"2024-04-26T12:35:29.240430+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:03.142930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2093,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208562+0000","last_change":"2024-04-26T12:35:26.168307+0000","last_active":"2024-04-26T12:35:28.208562+0000","last_peered":"2024-04-26T12:35:28.208562+0000","last_clean":"2024-04-26T12:35:28.208562+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:28.208562+0000","last_undegraded":"2024-04-26T12:35:28.208562+0000","last_fullsized":"2024-04-26T12:35:28.208562+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:10.743574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2138,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208382+0000","last_change":"2024-04-26T12:35:26.167308+0000","last_active":"2024-04-26T12:35:28.208382+0000","last_peered":"2024-04-26T12:35:28.208382+0000","last_clean":"2024-04-26T12:35:28.208382+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:35:28.208382+0000","last_undegraded":"2024-04-26T12:35:28.208382+0000","last_fullsized":"2024-04-26T12:35:28.208382+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:55.062566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2147,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212441+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:28.212441+0000","last_peered":"2024-04-26T12:35:28.212441+0000","last_clean":"2024-04-26T12:35:28.212441+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:28.212441+0000","last_undegraded":"2024-04-26T12:35:28.212441+0000","last_fullsized":"2024-04-26T12:35:28.212441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2166,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211989+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:28.211989+0000","last_peered":"2024-04-26T12:35:28.211989+0000","last_clean":"2024-04-26T12:35:28.211989+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:28.211989+0000","last_undegraded":"2024-04-26T12:35:28.211989+0000","last_fullsized":"2024-04-26T12:35:28.211989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239840+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:29.239840+0000","last_peered":"2024-04-26T12:35:29.239840+0000","last_clean":"2024-04-26T12:35:29.239840+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:29.239840+0000","last_undegraded":"2024-04-26T12:35:29.239840+0000","last_fullsized":"2024-04-26T12:35:29.239840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:42.219006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2118,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211167+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:28.211167+0000","last_peered":"2024-04-26T12:35:28.211167+0000","last_clean":"2024-04-26T12:35:28.211167+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:28.211167+0000","last_undegraded":"2024-04-26T12:35:28.211167+0000","last_fullsized":"2024-04-26T12:35:28.211167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:52.856014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2140,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209159+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:28.209159+0000","last_peered":"2024-04-26T12:35:28.209159+0000","last_clean":"2024-04-26T12:35:28.209159+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:28.209159+0000","last_undegraded":"2024-04-26T12:35:28.209159+0000","last_fullsized":"2024-04-26T12:35:28.209159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4098,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210794+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:28.210794+0000","last_peered":"2024-04-26T12:35:28.210794+0000","last_clean":"2024-04-26T12:35:28.210794+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:28.210794+0000","last_undegraded":"2024-04-26T12:35:28.210794+0000","last_fullsized":"2024-04-26T12:35:28.210794+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.866275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4222,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212532+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:28.212532+0000","last_peered":"2024-04-26T12:35:28.212532+0000","last_clean":"2024-04-26T12:35:28.212532+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:28.212532+0000","last_undegraded":"2024-04-26T12:35:28.212532+0000","last_fullsized":"2024-04-26T12:35:28.212532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:03.877816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211555+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:28.211555+0000","last_peered":"2024-04-26T12:35:28.211555+0000","last_clean":"2024-04-26T12:35:28.211555+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:28.211555+0000","last_undegraded":"2024-04-26T12:35:28.211555+0000","last_fullsized":"2024-04-26T12:35:28.211555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208329+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:28.208329+0000","last_peered":"2024-04-26T12:35:28.208329+0000","last_clean":"2024-04-26T12:35:28.208329+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:28.208329+0000","last_undegraded":"2024-04-26T12:35:28.208329+0000","last_fullsized":"2024-04-26T12:35:28.208329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210072+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:28.210072+0000","last_peered":"2024-04-26T12:35:28.210072+0000","last_clean":"2024-04-26T12:35:28.210072+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:28.210072+0000","last_undegraded":"2024-04-26T12:35:28.210072+0000","last_fullsized":"2024-04-26T12:35:28.210072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4139,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208389+0000","last_change":"2024-04-26T12:35:26.165413+0000","last_active":"2024-04-26T12:35:28.208389+0000","last_peered":"2024-04-26T12:35:28.208389+0000","last_clean":"2024-04-26T12:35:28.208389+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:35:28.208389+0000","last_undegraded":"2024-04-26T12:35:28.208389+0000","last_fullsized":"2024-04-26T12:35:28.208389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.367083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2141,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209087+0000","last_change":"2024-04-26T12:35:26.170324+0000","last_active":"2024-04-26T12:35:28.209087+0000","last_peered":"2024-04-26T12:35:28.209087+0000","last_clean":"2024-04-26T12:35:28.209087+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:28.209087+0000","last_undegraded":"2024-04-26T12:35:28.209087+0000","last_fullsized":"2024-04-26T12:35:28.209087+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:58.838513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211224+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:28.211224+0000","last_peered":"2024-04-26T12:35:28.211224+0000","last_clean":"2024-04-26T12:35:28.211224+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:28.211224+0000","last_undegraded":"2024-04-26T12:35:28.211224+0000","last_fullsized":"2024-04-26T12:35:28.211224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2101,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212916+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:28.212916+0000","last_peered":"2024-04-26T12:35:28.212916+0000","last_clean":"2024-04-26T12:35:28.212916+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:28.212916+0000","last_undegraded":"2024-04-26T12:35:28.212916+0000","last_fullsized":"2024-04-26T12:35:28.212916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208583+0000","last_change":"2024-04-26T12:35:26.165397+0000","last_active":"2024-04-26T12:35:28.208583+0000","last_peered":"2024-04-26T12:35:28.208583+0000","last_clean":"2024-04-26T12:35:28.208583+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:35:28.208583+0000","last_undegraded":"2024-04-26T12:35:28.208583+0000","last_fullsized":"2024-04-26T12:35:28.208583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:11.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209095+0000","last_change":"2024-04-26T12:35:26.166754+0000","last_active":"2024-04-26T12:35:28.209095+0000","last_peered":"2024-04-26T12:35:28.209095+0000","last_clean":"2024-04-26T12:35:28.209095+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:28.209095+0000","last_undegraded":"2024-04-26T12:35:28.209095+0000","last_fullsized":"2024-04-26T12:35:28.209095+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:52.222681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209874+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:28.209874+0000","last_peered":"2024-04-26T12:35:28.209874+0000","last_clean":"2024-04-26T12:35:28.209874+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:28.209874+0000","last_undegraded":"2024-04-26T12:35:28.209874+0000","last_fullsized":"2024-04-26T12:35:28.209874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211032+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:28.211032+0000","last_peered":"2024-04-26T12:35:28.211032+0000","last_clean":"2024-04-26T12:35:28.211032+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:28.211032+0000","last_undegraded":"2024-04-26T12:35:28.211032+0000","last_fullsized":"2024-04-26T12:35:28.211032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209808+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:28.209808+0000","last_peered":"2024-04-26T12:35:28.209808+0000","last_clean":"2024-04-26T12:35:28.209808+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:28.209808+0000","last_undegraded":"2024-04-26T12:35:28.209808+0000","last_fullsized":"2024-04-26T12:35:28.209808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209274+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:28.209274+0000","last_peered":"2024-04-26T12:35:28.209274+0000","last_clean":"2024-04-26T12:35:28.209274+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:28.209274+0000","last_undegraded":"2024-04-26T12:35:28.209274+0000","last_fullsized":"2024-04-26T12:35:28.209274+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:19.816252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210919+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:28.210919+0000","last_peered":"2024-04-26T12:35:28.210919+0000","last_clean":"2024-04-26T12:35:28.210919+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:28.210919+0000","last_undegraded":"2024-04-26T12:35:28.210919+0000","last_fullsized":"2024-04-26T12:35:28.210919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210388+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:28.210388+0000","last_peered":"2024-04-26T12:35:28.210388+0000","last_clean":"2024-04-26T12:35:28.210388+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:28.210388+0000","last_undegraded":"2024-04-26T12:35:28.210388+0000","last_fullsized":"2024-04-26T12:35:28.210388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240723+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:29.240723+0000","last_peered":"2024-04-26T12:35:29.240723+0000","last_clean":"2024-04-26T12:35:29.240723+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:29.240723+0000","last_undegraded":"2024-04-26T12:35:29.240723+0000","last_fullsized":"2024-04-26T12:35:29.240723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:38.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6182,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209958+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:28.209958+0000","last_peered":"2024-04-26T12:35:28.209958+0000","last_clean":"2024-04-26T12:35:28.209958+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:28.209958+0000","last_undegraded":"2024-04-26T12:35:28.209958+0000","last_fullsized":"2024-04-26T12:35:28.209958+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:50.387270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209285+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:28.209285+0000","last_peered":"2024-04-26T12:35:28.209285+0000","last_clean":"2024-04-26T12:35:28.209285+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:28.209285+0000","last_undegraded":"2024-04-26T12:35:28.209285+0000","last_fullsized":"2024-04-26T12:35:28.209285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:53.309649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4162,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210081+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:28.210081+0000","last_peered":"2024-04-26T12:35:28.210081+0000","last_clean":"2024-04-26T12:35:28.210081+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:28.210081+0000","last_undegraded":"2024-04-26T12:35:28.210081+0000","last_fullsized":"2024-04-26T12:35:28.210081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":192,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212508+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:28.212508+0000","last_peered":"2024-04-26T12:35:28.212508+0000","last_clean":"2024-04-26T12:35:28.212508+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:28.212508+0000","last_undegraded":"2024-04-26T12:35:28.212508+0000","last_fullsized":"2024-04-26T12:35:28.212508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4189,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212280+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:28.212280+0000","last_peered":"2024-04-26T12:35:28.212280+0000","last_clean":"2024-04-26T12:35:28.212280+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:28.212280+0000","last_undegraded":"2024-04-26T12:35:28.212280+0000","last_fullsized":"2024-04-26T12:35:28.212280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212311+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:28.212311+0000","last_peered":"2024-04-26T12:35:28.212311+0000","last_clean":"2024-04-26T12:35:28.212311+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:28.212311+0000","last_undegraded":"2024-04-26T12:35:28.212311+0000","last_fullsized":"2024-04-26T12:35:28.212311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2081,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208726+0000","last_change":"2024-04-26T12:35:26.166921+0000","last_active":"2024-04-26T12:35:28.208726+0000","last_peered":"2024-04-26T12:35:28.208726+0000","last_clean":"2024-04-26T12:35:28.208726+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:35:28.208726+0000","last_undegraded":"2024-04-26T12:35:28.208726+0000","last_fullsized":"2024-04-26T12:35:28.208726+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2078,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209347+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:28.209347+0000","last_peered":"2024-04-26T12:35:28.209347+0000","last_clean":"2024-04-26T12:35:28.209347+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:28.209347+0000","last_undegraded":"2024-04-26T12:35:28.209347+0000","last_fullsized":"2024-04-26T12:35:28.209347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:37.025987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208419+0000","last_change":"2024-04-26T12:35:26.163714+0000","last_active":"2024-04-26T12:35:28.208419+0000","last_peered":"2024-04-26T12:35:28.208419+0000","last_clean":"2024-04-26T12:35:28.208419+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:35:28.208419+0000","last_undegraded":"2024-04-26T12:35:28.208419+0000","last_fullsized":"2024-04-26T12:35:28.208419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:56.750192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211123+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:28.211123+0000","last_peered":"2024-04-26T12:35:28.211123+0000","last_clean":"2024-04-26T12:35:28.211123+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:28.211123+0000","last_undegraded":"2024-04-26T12:35:28.211123+0000","last_fullsized":"2024-04-26T12:35:28.211123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":105,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211774+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:28.211774+0000","last_peered":"2024-04-26T12:35:28.211774+0000","last_clean":"2024-04-26T12:35:28.211774+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:28.211774+0000","last_undegraded":"2024-04-26T12:35:28.211774+0000","last_fullsized":"2024-04-26T12:35:28.211774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2169,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211139+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:28.211139+0000","last_peered":"2024-04-26T12:35:28.211139+0000","last_clean":"2024-04-26T12:35:28.211139+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:28.211139+0000","last_undegraded":"2024-04-26T12:35:28.211139+0000","last_fullsized":"2024-04-26T12:35:28.211139+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:50.006267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":97,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212429+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:28.212429+0000","last_peered":"2024-04-26T12:35:28.212429+0000","last_clean":"2024-04-26T12:35:28.212429+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:28.212429+0000","last_undegraded":"2024-04-26T12:35:28.212429+0000","last_fullsized":"2024-04-26T12:35:28.212429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208506+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:28.208506+0000","last_peered":"2024-04-26T12:35:28.208506+0000","last_clean":"2024-04-26T12:35:28.208506+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:28.208506+0000","last_undegraded":"2024-04-26T12:35:28.208506+0000","last_fullsized":"2024-04-26T12:35:28.208506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:14.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208961+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:28.208961+0000","last_peered":"2024-04-26T12:35:28.208961+0000","last_clean":"2024-04-26T12:35:28.208961+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:28.208961+0000","last_undegraded":"2024-04-26T12:35:28.208961+0000","last_fullsized":"2024-04-26T12:35:28.208961+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208600+0000","last_change":"2024-04-26T12:35:26.165209+0000","last_active":"2024-04-26T12:35:28.208600+0000","last_peered":"2024-04-26T12:35:28.208600+0000","last_clean":"2024-04-26T12:35:28.208600+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:28.208600+0000","last_undegraded":"2024-04-26T12:35:28.208600+0000","last_fullsized":"2024-04-26T12:35:28.208600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:19.522824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":30,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240548+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:29.240548+0000","last_peered":"2024-04-26T12:35:29.240548+0000","last_clean":"2024-04-26T12:35:29.240548+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:29.240548+0000","last_undegraded":"2024-04-26T12:35:29.240548+0000","last_fullsized":"2024-04-26T12:35:29.240548+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:42.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211821+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:28.211821+0000","last_peered":"2024-04-26T12:35:28.211821+0000","last_clean":"2024-04-26T12:35:28.211821+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:28.211821+0000","last_undegraded":"2024-04-26T12:35:28.211821+0000","last_fullsized":"2024-04-26T12:35:28.211821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211859+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:28.211859+0000","last_peered":"2024-04-26T12:35:28.211859+0000","last_clean":"2024-04-26T12:35:28.211859+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:28.211859+0000","last_undegraded":"2024-04-26T12:35:28.211859+0000","last_fullsized":"2024-04-26T12:35:28.211859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210318+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:28.210318+0000","last_peered":"2024-04-26T12:35:28.210318+0000","last_clean":"2024-04-26T12:35:28.210318+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:28.210318+0000","last_undegraded":"2024-04-26T12:35:28.210318+0000","last_fullsized":"2024-04-26T12:35:28.210318+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212057+0000","last_change":"2024-04-26T12:35:05.902297+0000","last_active":"2024-04-26T12:35:28.212057+0000","last_peered":"2024-04-26T12:35:28.212057+0000","last_clean":"2024-04-26T12:35:28.212057+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:28.212057+0000","last_undegraded":"2024-04-26T12:35:28.212057+0000","last_fullsized":"2024-04-26T12:35:28.212057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:37.434819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211660+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:28.211660+0000","last_peered":"2024-04-26T12:35:28.211660+0000","last_clean":"2024-04-26T12:35:28.211660+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:28.211660+0000","last_undegraded":"2024-04-26T12:35:28.211660+0000","last_fullsized":"2024-04-26T12:35:28.211660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2134,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213133+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:28.213133+0000","last_peered":"2024-04-26T12:35:28.213133+0000","last_clean":"2024-04-26T12:35:28.213133+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:28.213133+0000","last_undegraded":"2024-04-26T12:35:28.213133+0000","last_fullsized":"2024-04-26T12:35:28.213133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208228+0000","last_change":"2024-04-26T12:35:26.161621+0000","last_active":"2024-04-26T12:35:28.208228+0000","last_peered":"2024-04-26T12:35:28.208228+0000","last_clean":"2024-04-26T12:35:28.208228+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:35:28.208228+0000","last_undegraded":"2024-04-26T12:35:28.208228+0000","last_fullsized":"2024-04-26T12:35:28.208228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:44.708029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212154+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:28.212154+0000","last_peered":"2024-04-26T12:35:28.212154+0000","last_clean":"2024-04-26T12:35:28.212154+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:28.212154+0000","last_undegraded":"2024-04-26T12:35:28.212154+0000","last_fullsized":"2024-04-26T12:35:28.212154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208344+0000","last_change":"2024-04-26T12:35:26.163568+0000","last_active":"2024-04-26T12:35:28.208344+0000","last_peered":"2024-04-26T12:35:28.208344+0000","last_clean":"2024-04-26T12:35:28.208344+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:35:28.208344+0000","last_undegraded":"2024-04-26T12:35:28.208344+0000","last_fullsized":"2024-04-26T12:35:28.208344+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:01.190879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211076+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:28.211076+0000","last_peered":"2024-04-26T12:35:28.211076+0000","last_clean":"2024-04-26T12:35:28.211076+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:28.211076+0000","last_undegraded":"2024-04-26T12:35:28.211076+0000","last_fullsized":"2024-04-26T12:35:28.211076+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:41.098435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210635+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:28.210635+0000","last_peered":"2024-04-26T12:35:28.210635+0000","last_clean":"2024-04-26T12:35:28.210635+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:28.210635+0000","last_undegraded":"2024-04-26T12:35:28.210635+0000","last_fullsized":"2024-04-26T12:35:28.210635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212994+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:28.212994+0000","last_peered":"2024-04-26T12:35:28.212994+0000","last_clean":"2024-04-26T12:35:28.212994+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:28.212994+0000","last_undegraded":"2024-04-26T12:35:28.212994+0000","last_fullsized":"2024-04-26T12:35:28.212994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208687+0000","last_change":"2024-04-26T12:35:26.163875+0000","last_active":"2024-04-26T12:35:28.208687+0000","last_peered":"2024-04-26T12:35:28.208687+0000","last_clean":"2024-04-26T12:35:28.208687+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:35:28.208687+0000","last_undegraded":"2024-04-26T12:35:28.208687+0000","last_fullsized":"2024-04-26T12:35:28.208687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:05.697046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212247+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:28.212247+0000","last_peered":"2024-04-26T12:35:28.212247+0000","last_clean":"2024-04-26T12:35:28.212247+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:28.212247+0000","last_undegraded":"2024-04-26T12:35:28.212247+0000","last_fullsized":"2024-04-26T12:35:28.212247+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211893+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:28.211893+0000","last_peered":"2024-04-26T12:35:28.211893+0000","last_clean":"2024-04-26T12:35:28.211893+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:28.211893+0000","last_undegraded":"2024-04-26T12:35:28.211893+0000","last_fullsized":"2024-04-26T12:35:28.211893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210480+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:28.210480+0000","last_peered":"2024-04-26T12:35:28.210480+0000","last_clean":"2024-04-26T12:35:28.210480+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:28.210480+0000","last_undegraded":"2024-04-26T12:35:28.210480+0000","last_fullsized":"2024-04-26T12:35:28.210480+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210119+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:28.210119+0000","last_peered":"2024-04-26T12:35:28.210119+0000","last_clean":"2024-04-26T12:35:28.210119+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:28.210119+0000","last_undegraded":"2024-04-26T12:35:28.210119+0000","last_fullsized":"2024-04-26T12:35:28.210119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210995+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:28.210995+0000","last_peered":"2024-04-26T12:35:28.210995+0000","last_clean":"2024-04-26T12:35:28.210995+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:28.210995+0000","last_undegraded":"2024-04-26T12:35:28.210995+0000","last_fullsized":"2024-04-26T12:35:28.210995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212150+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:28.212150+0000","last_peered":"2024-04-26T12:35:28.212150+0000","last_clean":"2024-04-26T12:35:28.212150+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:28.212150+0000","last_undegraded":"2024-04-26T12:35:28.212150+0000","last_fullsized":"2024-04-26T12:35:28.212150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211472+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:28.211472+0000","last_peered":"2024-04-26T12:35:28.211472+0000","last_clean":"2024-04-26T12:35:28.211472+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:28.211472+0000","last_undegraded":"2024-04-26T12:35:28.211472+0000","last_fullsized":"2024-04-26T12:35:28.211472+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210224+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:28.210224+0000","last_peered":"2024-04-26T12:35:28.210224+0000","last_clean":"2024-04-26T12:35:28.210224+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:28.210224+0000","last_undegraded":"2024-04-26T12:35:28.210224+0000","last_fullsized":"2024-04-26T12:35:28.210224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.216208+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:28.216208+0000","last_peered":"2024-04-26T12:35:28.216208+0000","last_clean":"2024-04-26T12:35:28.216208+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:28.216208+0000","last_undegraded":"2024-04-26T12:35:28.216208+0000","last_fullsized":"2024-04-26T12:35:28.216208+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:21.559371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211736+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:28.211736+0000","last_peered":"2024-04-26T12:35:28.211736+0000","last_clean":"2024-04-26T12:35:28.211736+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:28.211736+0000","last_undegraded":"2024-04-26T12:35:28.211736+0000","last_fullsized":"2024-04-26T12:35:28.211736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210256+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:28.210256+0000","last_peered":"2024-04-26T12:35:28.210256+0000","last_clean":"2024-04-26T12:35:28.210256+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:28.210256+0000","last_undegraded":"2024-04-26T12:35:28.210256+0000","last_fullsized":"2024-04-26T12:35:28.210256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8089,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209089+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:28.209089+0000","last_peered":"2024-04-26T12:35:28.209089+0000","last_clean":"2024-04-26T12:35:28.209089+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:28.209089+0000","last_undegraded":"2024-04-26T12:35:28.209089+0000","last_fullsized":"2024-04-26T12:35:28.209089+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:57.436637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209248+0000","last_change":"2024-04-26T12:35:26.163739+0000","last_active":"2024-04-26T12:35:28.209248+0000","last_peered":"2024-04-26T12:35:28.209248+0000","last_clean":"2024-04-26T12:35:28.209248+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:28.209248+0000","last_undegraded":"2024-04-26T12:35:28.209248+0000","last_fullsized":"2024-04-26T12:35:28.209248+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:31.079482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210697+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:28.210697+0000","last_peered":"2024-04-26T12:35:28.210697+0000","last_clean":"2024-04-26T12:35:28.210697+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:28.210697+0000","last_undegraded":"2024-04-26T12:35:28.210697+0000","last_fullsized":"2024-04-26T12:35:28.210697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208545+0000","last_change":"2024-04-26T12:35:26.168819+0000","last_active":"2024-04-26T12:35:28.208545+0000","last_peered":"2024-04-26T12:35:28.208545+0000","last_clean":"2024-04-26T12:35:28.208545+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:28.208545+0000","last_undegraded":"2024-04-26T12:35:28.208545+0000","last_fullsized":"2024-04-26T12:35:28.208545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:49.140618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210842+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:28.210842+0000","last_peered":"2024-04-26T12:35:28.210842+0000","last_clean":"2024-04-26T12:35:28.210842+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:28.210842+0000","last_undegraded":"2024-04-26T12:35:28.210842+0000","last_fullsized":"2024-04-26T12:35:28.210842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210820+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:28.210820+0000","last_peered":"2024-04-26T12:35:28.210820+0000","last_clean":"2024-04-26T12:35:28.210820+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:28.210820+0000","last_undegraded":"2024-04-26T12:35:28.210820+0000","last_fullsized":"2024-04-26T12:35:28.210820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210121+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:28.210121+0000","last_peered":"2024-04-26T12:35:28.210121+0000","last_clean":"2024-04-26T12:35:28.210121+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:28.210121+0000","last_undegraded":"2024-04-26T12:35:28.210121+0000","last_fullsized":"2024-04-26T12:35:28.210121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212129+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:28.212129+0000","last_peered":"2024-04-26T12:35:28.212129+0000","last_clean":"2024-04-26T12:35:28.212129+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:28.212129+0000","last_undegraded":"2024-04-26T12:35:28.212129+0000","last_fullsized":"2024-04-26T12:35:28.212129+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":82,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211118+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:28.211118+0000","last_peered":"2024-04-26T12:35:28.211118+0000","last_clean":"2024-04-26T12:35:28.211118+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:28.211118+0000","last_undegraded":"2024-04-26T12:35:28.211118+0000","last_fullsized":"2024-04-26T12:35:28.211118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":98,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208544+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:28.208544+0000","last_peered":"2024-04-26T12:35:28.208544+0000","last_clean":"2024-04-26T12:35:28.208544+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:28.208544+0000","last_undegraded":"2024-04-26T12:35:28.208544+0000","last_fullsized":"2024-04-26T12:35:28.208544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208669+0000","last_change":"2024-04-26T12:35:26.164494+0000","last_active":"2024-04-26T12:35:28.208669+0000","last_peered":"2024-04-26T12:35:28.208669+0000","last_clean":"2024-04-26T12:35:28.208669+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:35:28.208669+0000","last_undegraded":"2024-04-26T12:35:28.208669+0000","last_fullsized":"2024-04-26T12:35:28.208669+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:10.400059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208829+0000","last_change":"2024-04-26T12:35:26.167507+0000","last_active":"2024-04-26T12:35:28.208829+0000","last_peered":"2024-04-26T12:35:28.208829+0000","last_clean":"2024-04-26T12:35:28.208829+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:35:28.208829+0000","last_undegraded":"2024-04-26T12:35:28.208829+0000","last_fullsized":"2024-04-26T12:35:28.208829+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:47.316526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":110,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212348+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:28.212348+0000","last_peered":"2024-04-26T12:35:28.212348+0000","last_clean":"2024-04-26T12:35:28.212348+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:28.212348+0000","last_undegraded":"2024-04-26T12:35:28.212348+0000","last_fullsized":"2024-04-26T12:35:28.212348+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2157,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211789+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:28.211789+0000","last_peered":"2024-04-26T12:35:28.211789+0000","last_clean":"2024-04-26T12:35:28.211789+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:28.211789+0000","last_undegraded":"2024-04-26T12:35:28.211789+0000","last_fullsized":"2024-04-26T12:35:28.211789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:50.285275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":60,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209350+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:28.209350+0000","last_peered":"2024-04-26T12:35:28.209350+0000","last_clean":"2024-04-26T12:35:28.209350+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:28.209350+0000","last_undegraded":"2024-04-26T12:35:28.209350+0000","last_fullsized":"2024-04-26T12:35:28.209350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:37.674963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":114,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211631+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:28.211631+0000","last_peered":"2024-04-26T12:35:28.211631+0000","last_clean":"2024-04-26T12:35:28.211631+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:28.211631+0000","last_undegraded":"2024-04-26T12:35:28.211631+0000","last_fullsized":"2024-04-26T12:35:28.211631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210937+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:28.210937+0000","last_peered":"2024-04-26T12:35:28.210937+0000","last_clean":"2024-04-26T12:35:28.210937+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:28.210937+0000","last_undegraded":"2024-04-26T12:35:28.210937+0000","last_fullsized":"2024-04-26T12:35:28.210937+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4180,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208145+0000","last_change":"2024-04-26T12:35:26.167799+0000","last_active":"2024-04-26T12:35:28.208145+0000","last_peered":"2024-04-26T12:35:28.208145+0000","last_clean":"2024-04-26T12:35:28.208145+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:35:28.208145+0000","last_undegraded":"2024-04-26T12:35:28.208145+0000","last_fullsized":"2024-04-26T12:35:28.208145+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:35.792155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211036+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:28.211036+0000","last_peered":"2024-04-26T12:35:28.211036+0000","last_clean":"2024-04-26T12:35:28.211036+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:28.211036+0000","last_undegraded":"2024-04-26T12:35:28.211036+0000","last_fullsized":"2024-04-26T12:35:28.211036+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2165,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:35.341488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":117,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211625+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:28.211625+0000","last_peered":"2024-04-26T12:35:28.211625+0000","last_clean":"2024-04-26T12:35:28.211625+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:28.211625+0000","last_undegraded":"2024-04-26T12:35:28.211625+0000","last_fullsized":"2024-04-26T12:35:28.211625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210182+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:28.210182+0000","last_peered":"2024-04-26T12:35:28.210182+0000","last_clean":"2024-04-26T12:35:28.210182+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:28.210182+0000","last_undegraded":"2024-04-26T12:35:28.210182+0000","last_fullsized":"2024-04-26T12:35:28.210182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2027,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208731+0000","last_change":"2024-04-26T12:35:26.169463+0000","last_active":"2024-04-26T12:35:28.208731+0000","last_peered":"2024-04-26T12:35:28.208731+0000","last_clean":"2024-04-26T12:35:28.208731+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:35:28.208731+0000","last_undegraded":"2024-04-26T12:35:28.208731+0000","last_fullsized":"2024-04-26T12:35:28.208731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:48.293346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2132,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210411+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:28.210411+0000","last_peered":"2024-04-26T12:35:28.210411+0000","last_clean":"2024-04-26T12:35:28.210411+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:28.210411+0000","last_undegraded":"2024-04-26T12:35:28.210411+0000","last_fullsized":"2024-04-26T12:35:28.210411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2137,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208869+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:28.208869+0000","last_peered":"2024-04-26T12:35:28.208869+0000","last_clean":"2024-04-26T12:35:28.208869+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:28.208869+0000","last_undegraded":"2024-04-26T12:35:28.208869+0000","last_fullsized":"2024-04-26T12:35:28.208869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142984,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228856,"statfs":{"total":96636764160,"available":95466348544,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.61399999999999999}]}]},{"osd":0,"up_from":85,"seq":365072220168,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52668,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319172,"statfs":{"total":96636764160,"available":96582832128,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860672,"statfs":{"total":96636764160,"available":95089328128,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:35:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.42099999999999999,"15min":0.441},"min":{"1min":0.40699999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.64000000000000001,"5min":1.137,"15min":1.137},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:34.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:35:35.040 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:35.041 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":98,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:35:29.214507+0000","last_up_change":"2024-04-26T12:35:02.136525+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":63,"up_from":85,"up_thru":89,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":5978},{"type":"v1","addr":"172.21.15.98:6801","nonce":5978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":5978},{"type":"v1","addr":"172.21.15.98:6803","nonce":5978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":5978},{"type":"v1","addr":"172.21.15.98:6807","nonce":5978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":5978},{"type":"v1","addr":"172.21.15.98:6805","nonce":5978}]},"public_addr":"172.21.15.98:6801/5978","cluster_addr":"172.21.15.98:6803/5978","heartbeat_back_addr":"172.21.15.98:6807/5978","heartbeat_front_addr":"172.21.15.98:6805/5978","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":63},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.18","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:35:36.057 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T12:35:36.057 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:35:36.232 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-26T12:35:36.232 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T12:35:36.233 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-26T12:35:36.247 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T12:35:36.615 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T12:35:36.628 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T12:35:36.628 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:35:36.793 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-26T12:35:36.793 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:35:36.793 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-26T12:35:36.807 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T12:35:37.176 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T12:35:37.189 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T12:35:37.189 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:35:37.353 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2024-04-26T12:35:37.354 INFO:teuthology.orchestra.run.smithi038.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:35:37.354 INFO:teuthology.orchestra.run.smithi038.stdout:} 2024-04-26T12:35:37.367 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T12:35:37.737 INFO:teuthology.orchestra.run.smithi038.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T12:35:37.750 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:38.118 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:38.120 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:38.133 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-04-26T12:35:37.051195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119321,"ondisk_log_size":119321,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706820,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408700,"statfs":{"total":289910292480,"available":287138508800,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.842926"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2083,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208960+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:28.208960+0000","last_peered":"2024-04-26T12:35:28.208960+0000","last_clean":"2024-04-26T12:35:28.208960+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:28.208960+0000","last_undegraded":"2024-04-26T12:35:28.208960+0000","last_fullsized":"2024-04-26T12:35:28.208960+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:30.341356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208831+0000","last_change":"2024-04-26T12:35:26.170471+0000","last_active":"2024-04-26T12:35:28.208831+0000","last_peered":"2024-04-26T12:35:28.208831+0000","last_clean":"2024-04-26T12:35:28.208831+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:28.208831+0000","last_undegraded":"2024-04-26T12:35:28.208831+0000","last_fullsized":"2024-04-26T12:35:28.208831+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4131,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213004+0000","last_change":"2024-04-26T12:30:32.619348+0000","last_active":"2024-04-26T12:35:28.213004+0000","last_peered":"2024-04-26T12:35:28.213004+0000","last_clean":"2024-04-26T12:35:28.213004+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:28.213004+0000","last_undegraded":"2024-04-26T12:35:28.213004+0000","last_fullsized":"2024-04-26T12:35:28.213004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:52.629601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212620+0000","last_change":"2024-04-26T12:35:03.189570+0000","last_active":"2024-04-26T12:35:28.212620+0000","last_peered":"2024-04-26T12:35:28.212620+0000","last_clean":"2024-04-26T12:35:28.212620+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:28.212620+0000","last_undegraded":"2024-04-26T12:35:28.212620+0000","last_fullsized":"2024-04-26T12:35:28.212620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:47.392642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2155,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222418+0000","last_change":"2024-04-26T12:35:26.167949+0000","last_active":"2024-04-26T12:35:29.222418+0000","last_peered":"2024-04-26T12:35:29.222418+0000","last_clean":"2024-04-26T12:35:29.222418+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:35:29.222418+0000","last_undegraded":"2024-04-26T12:35:29.222418+0000","last_fullsized":"2024-04-26T12:35:29.222418+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:10.256259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":60,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240114+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:29.240114+0000","last_peered":"2024-04-26T12:35:29.240114+0000","last_clean":"2024-04-26T12:35:29.240114+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:29.240114+0000","last_undegraded":"2024-04-26T12:35:29.240114+0000","last_fullsized":"2024-04-26T12:35:29.240114+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:22.116087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240144+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:29.240144+0000","last_peered":"2024-04-26T12:35:29.240144+0000","last_clean":"2024-04-26T12:35:29.240144+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:29.240144+0000","last_undegraded":"2024-04-26T12:35:29.240144+0000","last_fullsized":"2024-04-26T12:35:29.240144+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:19.062004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8205,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239768+0000","last_change":"2024-04-26T12:35:06.903708+0000","last_active":"2024-04-26T12:35:29.239768+0000","last_peered":"2024-04-26T12:35:29.239768+0000","last_clean":"2024-04-26T12:35:29.239768+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:29.239768+0000","last_undegraded":"2024-04-26T12:35:29.239768+0000","last_fullsized":"2024-04-26T12:35:29.239768+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:22.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211204+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:28.211204+0000","last_peered":"2024-04-26T12:35:28.211204+0000","last_clean":"2024-04-26T12:35:28.211204+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:28.211204+0000","last_undegraded":"2024-04-26T12:35:28.211204+0000","last_fullsized":"2024-04-26T12:35:28.211204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:49.537738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6240,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208908+0000","last_change":"2024-04-26T12:35:26.170653+0000","last_active":"2024-04-26T12:35:28.208908+0000","last_peered":"2024-04-26T12:35:28.208908+0000","last_clean":"2024-04-26T12:35:28.208908+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:28.208908+0000","last_undegraded":"2024-04-26T12:35:28.208908+0000","last_fullsized":"2024-04-26T12:35:28.208908+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:48.807860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240430+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:29.240430+0000","last_peered":"2024-04-26T12:35:29.240430+0000","last_clean":"2024-04-26T12:35:29.240430+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:29.240430+0000","last_undegraded":"2024-04-26T12:35:29.240430+0000","last_fullsized":"2024-04-26T12:35:29.240430+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:03.142930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2093,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208562+0000","last_change":"2024-04-26T12:35:26.168307+0000","last_active":"2024-04-26T12:35:28.208562+0000","last_peered":"2024-04-26T12:35:28.208562+0000","last_clean":"2024-04-26T12:35:28.208562+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:28.208562+0000","last_undegraded":"2024-04-26T12:35:28.208562+0000","last_fullsized":"2024-04-26T12:35:28.208562+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:10.743574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2138,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208382+0000","last_change":"2024-04-26T12:35:26.167308+0000","last_active":"2024-04-26T12:35:28.208382+0000","last_peered":"2024-04-26T12:35:28.208382+0000","last_clean":"2024-04-26T12:35:28.208382+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:35:28.208382+0000","last_undegraded":"2024-04-26T12:35:28.208382+0000","last_fullsized":"2024-04-26T12:35:28.208382+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:55.062566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2147,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212441+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:28.212441+0000","last_peered":"2024-04-26T12:35:28.212441+0000","last_clean":"2024-04-26T12:35:28.212441+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:28.212441+0000","last_undegraded":"2024-04-26T12:35:28.212441+0000","last_fullsized":"2024-04-26T12:35:28.212441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:34.295226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2166,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211989+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:28.211989+0000","last_peered":"2024-04-26T12:35:28.211989+0000","last_clean":"2024-04-26T12:35:28.211989+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:28.211989+0000","last_undegraded":"2024-04-26T12:35:28.211989+0000","last_fullsized":"2024-04-26T12:35:28.211989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:01:08.011883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239840+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:29.239840+0000","last_peered":"2024-04-26T12:35:29.239840+0000","last_clean":"2024-04-26T12:35:29.239840+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:29.239840+0000","last_undegraded":"2024-04-26T12:35:29.239840+0000","last_fullsized":"2024-04-26T12:35:29.239840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:42.219006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2118,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211167+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:28.211167+0000","last_peered":"2024-04-26T12:35:28.211167+0000","last_clean":"2024-04-26T12:35:28.211167+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:28.211167+0000","last_undegraded":"2024-04-26T12:35:28.211167+0000","last_fullsized":"2024-04-26T12:35:28.211167+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:52.856014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2140,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209159+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:28.209159+0000","last_peered":"2024-04-26T12:35:28.209159+0000","last_clean":"2024-04-26T12:35:28.209159+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:28.209159+0000","last_undegraded":"2024-04-26T12:35:28.209159+0000","last_fullsized":"2024-04-26T12:35:28.209159+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4098,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210794+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:28.210794+0000","last_peered":"2024-04-26T12:35:28.210794+0000","last_clean":"2024-04-26T12:35:28.210794+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:28.210794+0000","last_undegraded":"2024-04-26T12:35:28.210794+0000","last_fullsized":"2024-04-26T12:35:28.210794+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.866275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4222,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212532+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:28.212532+0000","last_peered":"2024-04-26T12:35:28.212532+0000","last_clean":"2024-04-26T12:35:28.212532+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:28.212532+0000","last_undegraded":"2024-04-26T12:35:28.212532+0000","last_fullsized":"2024-04-26T12:35:28.212532+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:03.877816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":119,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211555+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:28.211555+0000","last_peered":"2024-04-26T12:35:28.211555+0000","last_clean":"2024-04-26T12:35:28.211555+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:28.211555+0000","last_undegraded":"2024-04-26T12:35:28.211555+0000","last_fullsized":"2024-04-26T12:35:28.211555+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:36.932286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2116,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208329+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:28.208329+0000","last_peered":"2024-04-26T12:35:28.208329+0000","last_clean":"2024-04-26T12:35:28.208329+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:28.208329+0000","last_undegraded":"2024-04-26T12:35:28.208329+0000","last_fullsized":"2024-04-26T12:35:28.208329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:43.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210072+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:28.210072+0000","last_peered":"2024-04-26T12:35:28.210072+0000","last_clean":"2024-04-26T12:35:28.210072+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:28.210072+0000","last_undegraded":"2024-04-26T12:35:28.210072+0000","last_fullsized":"2024-04-26T12:35:28.210072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:08.716552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4139,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208389+0000","last_change":"2024-04-26T12:35:26.165413+0000","last_active":"2024-04-26T12:35:28.208389+0000","last_peered":"2024-04-26T12:35:28.208389+0000","last_clean":"2024-04-26T12:35:28.208389+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:35:28.208389+0000","last_undegraded":"2024-04-26T12:35:28.208389+0000","last_fullsized":"2024-04-26T12:35:28.208389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:36.367083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2141,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209087+0000","last_change":"2024-04-26T12:35:26.170324+0000","last_active":"2024-04-26T12:35:28.209087+0000","last_peered":"2024-04-26T12:35:28.209087+0000","last_clean":"2024-04-26T12:35:28.209087+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:28.209087+0000","last_undegraded":"2024-04-26T12:35:28.209087+0000","last_fullsized":"2024-04-26T12:35:28.209087+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:58.838513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211224+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:28.211224+0000","last_peered":"2024-04-26T12:35:28.211224+0000","last_clean":"2024-04-26T12:35:28.211224+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:28.211224+0000","last_undegraded":"2024-04-26T12:35:28.211224+0000","last_fullsized":"2024-04-26T12:35:28.211224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.737286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2101,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212916+0000","last_change":"2024-04-26T12:30:32.619095+0000","last_active":"2024-04-26T12:35:28.212916+0000","last_peered":"2024-04-26T12:35:28.212916+0000","last_clean":"2024-04-26T12:35:28.212916+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:28.212916+0000","last_undegraded":"2024-04-26T12:35:28.212916+0000","last_fullsized":"2024-04-26T12:35:28.212916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:55.724220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222431+0000","last_change":"2024-04-26T12:35:26.165397+0000","last_active":"2024-04-26T12:35:29.222431+0000","last_peered":"2024-04-26T12:35:29.222431+0000","last_clean":"2024-04-26T12:35:29.222431+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:35:29.222431+0000","last_undegraded":"2024-04-26T12:35:29.222431+0000","last_fullsized":"2024-04-26T12:35:29.222431+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:11.688049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209095+0000","last_change":"2024-04-26T12:35:26.166754+0000","last_active":"2024-04-26T12:35:28.209095+0000","last_peered":"2024-04-26T12:35:28.209095+0000","last_clean":"2024-04-26T12:35:28.209095+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:28.209095+0000","last_undegraded":"2024-04-26T12:35:28.209095+0000","last_fullsized":"2024-04-26T12:35:28.209095+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:52.222681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209874+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:28.209874+0000","last_peered":"2024-04-26T12:35:28.209874+0000","last_clean":"2024-04-26T12:35:28.209874+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:28.209874+0000","last_undegraded":"2024-04-26T12:35:28.209874+0000","last_fullsized":"2024-04-26T12:35:28.209874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:55.830374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211032+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:28.211032+0000","last_peered":"2024-04-26T12:35:28.211032+0000","last_clean":"2024-04-26T12:35:28.211032+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:28.211032+0000","last_undegraded":"2024-04-26T12:35:28.211032+0000","last_fullsized":"2024-04-26T12:35:28.211032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:41.069026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209808+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:28.209808+0000","last_peered":"2024-04-26T12:35:28.209808+0000","last_clean":"2024-04-26T12:35:28.209808+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:28.209808+0000","last_undegraded":"2024-04-26T12:35:28.209808+0000","last_fullsized":"2024-04-26T12:35:28.209808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.514199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209274+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:28.209274+0000","last_peered":"2024-04-26T12:35:28.209274+0000","last_clean":"2024-04-26T12:35:28.209274+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:28.209274+0000","last_undegraded":"2024-04-26T12:35:28.209274+0000","last_fullsized":"2024-04-26T12:35:28.209274+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:19.816252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210919+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:28.210919+0000","last_peered":"2024-04-26T12:35:28.210919+0000","last_clean":"2024-04-26T12:35:28.210919+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:28.210919+0000","last_undegraded":"2024-04-26T12:35:28.210919+0000","last_fullsized":"2024-04-26T12:35:28.210919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:01.501759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210388+0000","last_change":"2024-04-26T12:35:03.176751+0000","last_active":"2024-04-26T12:35:28.210388+0000","last_peered":"2024-04-26T12:35:28.210388+0000","last_clean":"2024-04-26T12:35:28.210388+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:28.210388+0000","last_undegraded":"2024-04-26T12:35:28.210388+0000","last_fullsized":"2024-04-26T12:35:28.210388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:36.542614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":55,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240723+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:29.240723+0000","last_peered":"2024-04-26T12:35:29.240723+0000","last_clean":"2024-04-26T12:35:29.240723+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:29.240723+0000","last_undegraded":"2024-04-26T12:35:29.240723+0000","last_fullsized":"2024-04-26T12:35:29.240723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:38.526059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6182,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209958+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:28.209958+0000","last_peered":"2024-04-26T12:35:28.209958+0000","last_clean":"2024-04-26T12:35:28.209958+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:28.209958+0000","last_undegraded":"2024-04-26T12:35:28.209958+0000","last_fullsized":"2024-04-26T12:35:28.209958+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:50.387270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209285+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:28.209285+0000","last_peered":"2024-04-26T12:35:28.209285+0000","last_clean":"2024-04-26T12:35:28.209285+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:28.209285+0000","last_undegraded":"2024-04-26T12:35:28.209285+0000","last_fullsized":"2024-04-26T12:35:28.209285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:53.309649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4162,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210081+0000","last_change":"2024-04-26T12:35:05.898374+0000","last_active":"2024-04-26T12:35:28.210081+0000","last_peered":"2024-04-26T12:35:28.210081+0000","last_clean":"2024-04-26T12:35:28.210081+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:28.210081+0000","last_undegraded":"2024-04-26T12:35:28.210081+0000","last_fullsized":"2024-04-26T12:35:28.210081+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:06.931165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":192,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212508+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:28.212508+0000","last_peered":"2024-04-26T12:35:28.212508+0000","last_clean":"2024-04-26T12:35:28.212508+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:28.212508+0000","last_undegraded":"2024-04-26T12:35:28.212508+0000","last_fullsized":"2024-04-26T12:35:28.212508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:39.336245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4189,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212280+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:28.212280+0000","last_peered":"2024-04-26T12:35:28.212280+0000","last_clean":"2024-04-26T12:35:28.212280+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:28.212280+0000","last_undegraded":"2024-04-26T12:35:28.212280+0000","last_fullsized":"2024-04-26T12:35:28.212280+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:35.313324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212311+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:28.212311+0000","last_peered":"2024-04-26T12:35:28.212311+0000","last_clean":"2024-04-26T12:35:28.212311+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:28.212311+0000","last_undegraded":"2024-04-26T12:35:28.212311+0000","last_fullsized":"2024-04-26T12:35:28.212311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:28.297657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2081,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208726+0000","last_change":"2024-04-26T12:35:26.166921+0000","last_active":"2024-04-26T12:35:28.208726+0000","last_peered":"2024-04-26T12:35:28.208726+0000","last_clean":"2024-04-26T12:35:28.208726+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:35:28.208726+0000","last_undegraded":"2024-04-26T12:35:28.208726+0000","last_fullsized":"2024-04-26T12:35:28.208726+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:08.152245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:33.513404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2078,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209347+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:28.209347+0000","last_peered":"2024-04-26T12:35:28.209347+0000","last_clean":"2024-04-26T12:35:28.209347+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:28.209347+0000","last_undegraded":"2024-04-26T12:35:28.209347+0000","last_fullsized":"2024-04-26T12:35:28.209347+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:37.025987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208419+0000","last_change":"2024-04-26T12:35:26.163714+0000","last_active":"2024-04-26T12:35:28.208419+0000","last_peered":"2024-04-26T12:35:28.208419+0000","last_clean":"2024-04-26T12:35:28.208419+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:35:28.208419+0000","last_undegraded":"2024-04-26T12:35:28.208419+0000","last_fullsized":"2024-04-26T12:35:28.208419+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:56.750192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211123+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:28.211123+0000","last_peered":"2024-04-26T12:35:28.211123+0000","last_clean":"2024-04-26T12:35:28.211123+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:28.211123+0000","last_undegraded":"2024-04-26T12:35:28.211123+0000","last_fullsized":"2024-04-26T12:35:28.211123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.865145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":105,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211774+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:28.211774+0000","last_peered":"2024-04-26T12:35:28.211774+0000","last_clean":"2024-04-26T12:35:28.211774+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:28.211774+0000","last_undegraded":"2024-04-26T12:35:28.211774+0000","last_fullsized":"2024-04-26T12:35:28.211774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.703101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2169,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211139+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:28.211139+0000","last_peered":"2024-04-26T12:35:28.211139+0000","last_clean":"2024-04-26T12:35:28.211139+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:28.211139+0000","last_undegraded":"2024-04-26T12:35:28.211139+0000","last_fullsized":"2024-04-26T12:35:28.211139+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:50.006267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":97,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212429+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:28.212429+0000","last_peered":"2024-04-26T12:35:28.212429+0000","last_clean":"2024-04-26T12:35:28.212429+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:28.212429+0000","last_undegraded":"2024-04-26T12:35:28.212429+0000","last_fullsized":"2024-04-26T12:35:28.212429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:41.425379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208506+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:28.208506+0000","last_peered":"2024-04-26T12:35:28.208506+0000","last_clean":"2024-04-26T12:35:28.208506+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:28.208506+0000","last_undegraded":"2024-04-26T12:35:28.208506+0000","last_fullsized":"2024-04-26T12:35:28.208506+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:14.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":96,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208961+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:28.208961+0000","last_peered":"2024-04-26T12:35:28.208961+0000","last_clean":"2024-04-26T12:35:28.208961+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:28.208961+0000","last_undegraded":"2024-04-26T12:35:28.208961+0000","last_fullsized":"2024-04-26T12:35:28.208961+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:17.540643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208600+0000","last_change":"2024-04-26T12:35:26.165209+0000","last_active":"2024-04-26T12:35:28.208600+0000","last_peered":"2024-04-26T12:35:28.208600+0000","last_clean":"2024-04-26T12:35:28.208600+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:28.208600+0000","last_undegraded":"2024-04-26T12:35:28.208600+0000","last_fullsized":"2024-04-26T12:35:28.208600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:19.522824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":30,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240548+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:29.240548+0000","last_peered":"2024-04-26T12:35:29.240548+0000","last_clean":"2024-04-26T12:35:29.240548+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:29.240548+0000","last_undegraded":"2024-04-26T12:35:29.240548+0000","last_fullsized":"2024-04-26T12:35:29.240548+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:42.620994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211821+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:28.211821+0000","last_peered":"2024-04-26T12:35:28.211821+0000","last_clean":"2024-04-26T12:35:28.211821+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:28.211821+0000","last_undegraded":"2024-04-26T12:35:28.211821+0000","last_fullsized":"2024-04-26T12:35:28.211821+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:37.988723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211859+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:28.211859+0000","last_peered":"2024-04-26T12:35:28.211859+0000","last_clean":"2024-04-26T12:35:28.211859+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:28.211859+0000","last_undegraded":"2024-04-26T12:35:28.211859+0000","last_fullsized":"2024-04-26T12:35:28.211859+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:09.264115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210318+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:28.210318+0000","last_peered":"2024-04-26T12:35:28.210318+0000","last_clean":"2024-04-26T12:35:28.210318+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:28.210318+0000","last_undegraded":"2024-04-26T12:35:28.210318+0000","last_fullsized":"2024-04-26T12:35:28.210318+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:01.814504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210066+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:28.210066+0000","last_peered":"2024-04-26T12:35:28.210066+0000","last_clean":"2024-04-26T12:35:28.210066+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:28.210066+0000","last_undegraded":"2024-04-26T12:35:28.210066+0000","last_fullsized":"2024-04-26T12:35:28.210066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:01.285250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2099,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212057+0000","last_change":"2024-04-26T12:35:05.902297+0000","last_active":"2024-04-26T12:35:28.212057+0000","last_peered":"2024-04-26T12:35:28.212057+0000","last_clean":"2024-04-26T12:35:28.212057+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:28.212057+0000","last_undegraded":"2024-04-26T12:35:28.212057+0000","last_fullsized":"2024-04-26T12:35:28.212057+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:37.434819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211660+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:28.211660+0000","last_peered":"2024-04-26T12:35:28.211660+0000","last_clean":"2024-04-26T12:35:28.211660+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:28.211660+0000","last_undegraded":"2024-04-26T12:35:28.211660+0000","last_fullsized":"2024-04-26T12:35:28.211660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:44.277558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2134,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.213133+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:28.213133+0000","last_peered":"2024-04-26T12:35:28.213133+0000","last_clean":"2024-04-26T12:35:28.213133+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:28.213133+0000","last_undegraded":"2024-04-26T12:35:28.213133+0000","last_fullsized":"2024-04-26T12:35:28.213133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.762786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208228+0000","last_change":"2024-04-26T12:35:26.161621+0000","last_active":"2024-04-26T12:35:28.208228+0000","last_peered":"2024-04-26T12:35:28.208228+0000","last_clean":"2024-04-26T12:35:28.208228+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:35:28.208228+0000","last_undegraded":"2024-04-26T12:35:28.208228+0000","last_fullsized":"2024-04-26T12:35:28.208228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:44.708029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212154+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:28.212154+0000","last_peered":"2024-04-26T12:35:28.212154+0000","last_clean":"2024-04-26T12:35:28.212154+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:28.212154+0000","last_undegraded":"2024-04-26T12:35:28.212154+0000","last_fullsized":"2024-04-26T12:35:28.212154+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:11.518829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":84,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208344+0000","last_change":"2024-04-26T12:35:26.163568+0000","last_active":"2024-04-26T12:35:28.208344+0000","last_peered":"2024-04-26T12:35:28.208344+0000","last_clean":"2024-04-26T12:35:28.208344+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:35:28.208344+0000","last_undegraded":"2024-04-26T12:35:28.208344+0000","last_fullsized":"2024-04-26T12:35:28.208344+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:01.190879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6184,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211076+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:28.211076+0000","last_peered":"2024-04-26T12:35:28.211076+0000","last_clean":"2024-04-26T12:35:28.211076+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:28.211076+0000","last_undegraded":"2024-04-26T12:35:28.211076+0000","last_fullsized":"2024-04-26T12:35:28.211076+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:41.098435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210635+0000","last_change":"2024-04-26T12:35:03.181348+0000","last_active":"2024-04-26T12:35:28.210635+0000","last_peered":"2024-04-26T12:35:28.210635+0000","last_clean":"2024-04-26T12:35:28.210635+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:28.210635+0000","last_undegraded":"2024-04-26T12:35:28.210635+0000","last_fullsized":"2024-04-26T12:35:28.210635+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:47.313762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212994+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:28.212994+0000","last_peered":"2024-04-26T12:35:28.212994+0000","last_clean":"2024-04-26T12:35:28.212994+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:28.212994+0000","last_undegraded":"2024-04-26T12:35:28.212994+0000","last_fullsized":"2024-04-26T12:35:28.212994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:21:26.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":57,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208687+0000","last_change":"2024-04-26T12:35:26.163875+0000","last_active":"2024-04-26T12:35:28.208687+0000","last_peered":"2024-04-26T12:35:28.208687+0000","last_clean":"2024-04-26T12:35:28.208687+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:35:28.208687+0000","last_undegraded":"2024-04-26T12:35:28.208687+0000","last_fullsized":"2024-04-26T12:35:28.208687+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:05.697046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212247+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:28.212247+0000","last_peered":"2024-04-26T12:35:28.212247+0000","last_clean":"2024-04-26T12:35:28.212247+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:28.212247+0000","last_undegraded":"2024-04-26T12:35:28.212247+0000","last_fullsized":"2024-04-26T12:35:28.212247+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:30.507958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":109,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211893+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:28.211893+0000","last_peered":"2024-04-26T12:35:28.211893+0000","last_clean":"2024-04-26T12:35:28.211893+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:28.211893+0000","last_undegraded":"2024-04-26T12:35:28.211893+0000","last_fullsized":"2024-04-26T12:35:28.211893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:27.278049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210480+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:28.210480+0000","last_peered":"2024-04-26T12:35:28.210480+0000","last_clean":"2024-04-26T12:35:28.210480+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:28.210480+0000","last_undegraded":"2024-04-26T12:35:28.210480+0000","last_fullsized":"2024-04-26T12:35:28.210480+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:54.233779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210119+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:28.210119+0000","last_peered":"2024-04-26T12:35:28.210119+0000","last_clean":"2024-04-26T12:35:28.210119+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:28.210119+0000","last_undegraded":"2024-04-26T12:35:28.210119+0000","last_fullsized":"2024-04-26T12:35:28.210119+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:48.052059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:06.892448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210995+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:28.210995+0000","last_peered":"2024-04-26T12:35:28.210995+0000","last_clean":"2024-04-26T12:35:28.210995+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:28.210995+0000","last_undegraded":"2024-04-26T12:35:28.210995+0000","last_fullsized":"2024-04-26T12:35:28.210995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:17.812458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212150+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:28.212150+0000","last_peered":"2024-04-26T12:35:28.212150+0000","last_clean":"2024-04-26T12:35:28.212150+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:28.212150+0000","last_undegraded":"2024-04-26T12:35:28.212150+0000","last_fullsized":"2024-04-26T12:35:28.212150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:33.989724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":295,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211472+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:28.211472+0000","last_peered":"2024-04-26T12:35:28.211472+0000","last_clean":"2024-04-26T12:35:28.211472+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:28.211472+0000","last_undegraded":"2024-04-26T12:35:28.211472+0000","last_fullsized":"2024-04-26T12:35:28.211472+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:13.335324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210224+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:28.210224+0000","last_peered":"2024-04-26T12:35:28.210224+0000","last_clean":"2024-04-26T12:35:28.210224+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:28.210224+0000","last_undegraded":"2024-04-26T12:35:28.210224+0000","last_fullsized":"2024-04-26T12:35:28.210224+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:23.571922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":83,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.216208+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:28.216208+0000","last_peered":"2024-04-26T12:35:28.216208+0000","last_clean":"2024-04-26T12:35:28.216208+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:28.216208+0000","last_undegraded":"2024-04-26T12:35:28.216208+0000","last_fullsized":"2024-04-26T12:35:28.216208+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:21.559371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211736+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:28.211736+0000","last_peered":"2024-04-26T12:35:28.211736+0000","last_clean":"2024-04-26T12:35:28.211736+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:28.211736+0000","last_undegraded":"2024-04-26T12:35:28.211736+0000","last_fullsized":"2024-04-26T12:35:28.211736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:24:21.294389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'3","reported_seq":77,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210256+0000","last_change":"2024-04-26T12:35:03.192527+0000","last_active":"2024-04-26T12:35:28.210256+0000","last_peered":"2024-04-26T12:35:28.210256+0000","last_clean":"2024-04-26T12:35:28.210256+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:28.210256+0000","last_undegraded":"2024-04-26T12:35:28.210256+0000","last_fullsized":"2024-04-26T12:35:28.210256+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:22:49.319835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8089,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209089+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:28.209089+0000","last_peered":"2024-04-26T12:35:28.209089+0000","last_clean":"2024-04-26T12:35:28.209089+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:28.209089+0000","last_undegraded":"2024-04-26T12:35:28.209089+0000","last_fullsized":"2024-04-26T12:35:28.209089+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:57.436637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209248+0000","last_change":"2024-04-26T12:35:26.163739+0000","last_active":"2024-04-26T12:35:28.209248+0000","last_peered":"2024-04-26T12:35:28.209248+0000","last_clean":"2024-04-26T12:35:28.209248+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:28.209248+0000","last_undegraded":"2024-04-26T12:35:28.209248+0000","last_fullsized":"2024-04-26T12:35:28.209248+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:31.079482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210697+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:28.210697+0000","last_peered":"2024-04-26T12:35:28.210697+0000","last_clean":"2024-04-26T12:35:28.210697+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:28.210697+0000","last_undegraded":"2024-04-26T12:35:28.210697+0000","last_fullsized":"2024-04-26T12:35:28.210697+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:16.304401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2095,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208545+0000","last_change":"2024-04-26T12:35:26.168819+0000","last_active":"2024-04-26T12:35:28.208545+0000","last_peered":"2024-04-26T12:35:28.208545+0000","last_clean":"2024-04-26T12:35:28.208545+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:28.208545+0000","last_undegraded":"2024-04-26T12:35:28.208545+0000","last_fullsized":"2024-04-26T12:35:28.208545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:49.140618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210842+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:28.210842+0000","last_peered":"2024-04-26T12:35:28.210842+0000","last_clean":"2024-04-26T12:35:28.210842+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:28.210842+0000","last_undegraded":"2024-04-26T12:35:28.210842+0000","last_fullsized":"2024-04-26T12:35:28.210842+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:24.826672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210820+0000","last_change":"2024-04-26T12:35:03.187692+0000","last_active":"2024-04-26T12:35:28.210820+0000","last_peered":"2024-04-26T12:35:28.210820+0000","last_clean":"2024-04-26T12:35:28.210820+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:28.210820+0000","last_undegraded":"2024-04-26T12:35:28.210820+0000","last_fullsized":"2024-04-26T12:35:28.210820+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:59.537333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210121+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:28.210121+0000","last_peered":"2024-04-26T12:35:28.210121+0000","last_clean":"2024-04-26T12:35:28.210121+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:28.210121+0000","last_undegraded":"2024-04-26T12:35:28.210121+0000","last_fullsized":"2024-04-26T12:35:28.210121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:20.701278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.212129+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:28.212129+0000","last_peered":"2024-04-26T12:35:28.212129+0000","last_clean":"2024-04-26T12:35:28.212129+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:28.212129+0000","last_undegraded":"2024-04-26T12:35:28.212129+0000","last_fullsized":"2024-04-26T12:35:28.212129+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:50.929145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":82,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211118+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:28.211118+0000","last_peered":"2024-04-26T12:35:28.211118+0000","last_clean":"2024-04-26T12:35:28.211118+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:28.211118+0000","last_undegraded":"2024-04-26T12:35:28.211118+0000","last_fullsized":"2024-04-26T12:35:28.211118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:40.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":98,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208544+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:28.208544+0000","last_peered":"2024-04-26T12:35:28.208544+0000","last_clean":"2024-04-26T12:35:28.208544+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:28.208544+0000","last_undegraded":"2024-04-26T12:35:28.208544+0000","last_fullsized":"2024-04-26T12:35:28.208544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:57.072970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":59,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208669+0000","last_change":"2024-04-26T12:35:26.164494+0000","last_active":"2024-04-26T12:35:28.208669+0000","last_peered":"2024-04-26T12:35:28.208669+0000","last_clean":"2024-04-26T12:35:28.208669+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:35:28.208669+0000","last_undegraded":"2024-04-26T12:35:28.208669+0000","last_fullsized":"2024-04-26T12:35:28.208669+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:10.400059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2120,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222667+0000","last_change":"2024-04-26T12:35:26.167507+0000","last_active":"2024-04-26T12:35:29.222667+0000","last_peered":"2024-04-26T12:35:29.222667+0000","last_clean":"2024-04-26T12:35:29.222667+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:35:29.222667+0000","last_undegraded":"2024-04-26T12:35:29.222667+0000","last_fullsized":"2024-04-26T12:35:29.222667+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:47.316526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240442+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:29.240442+0000","last_peered":"2024-04-26T12:35:29.240442+0000","last_clean":"2024-04-26T12:35:29.240442+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:29.240442+0000","last_undegraded":"2024-04-26T12:35:29.240442+0000","last_fullsized":"2024-04-26T12:35:29.240442+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:36.875546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2158,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240355+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:29.240355+0000","last_peered":"2024-04-26T12:35:29.240355+0000","last_clean":"2024-04-26T12:35:29.240355+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:29.240355+0000","last_undegraded":"2024-04-26T12:35:29.240355+0000","last_fullsized":"2024-04-26T12:35:29.240355+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:50.285275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":60,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.209350+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:28.209350+0000","last_peered":"2024-04-26T12:35:28.209350+0000","last_clean":"2024-04-26T12:35:28.209350+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:28.209350+0000","last_undegraded":"2024-04-26T12:35:28.209350+0000","last_fullsized":"2024-04-26T12:35:28.209350+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:37.674963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":115,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240674+0000","last_change":"2024-04-26T12:35:03.180769+0000","last_active":"2024-04-26T12:35:29.240674+0000","last_peered":"2024-04-26T12:35:29.240674+0000","last_clean":"2024-04-26T12:35:29.240674+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:29.240674+0000","last_undegraded":"2024-04-26T12:35:29.240674+0000","last_fullsized":"2024-04-26T12:35:29.240674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:50.305255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210937+0000","last_change":"2024-04-26T12:35:03.187816+0000","last_active":"2024-04-26T12:35:28.210937+0000","last_peered":"2024-04-26T12:35:28.210937+0000","last_clean":"2024-04-26T12:35:28.210937+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:28.210937+0000","last_undegraded":"2024-04-26T12:35:28.210937+0000","last_fullsized":"2024-04-26T12:35:28.210937+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:36.154752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4180,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208145+0000","last_change":"2024-04-26T12:35:26.167799+0000","last_active":"2024-04-26T12:35:28.208145+0000","last_peered":"2024-04-26T12:35:28.208145+0000","last_clean":"2024-04-26T12:35:28.208145+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:35:28.208145+0000","last_undegraded":"2024-04-26T12:35:28.208145+0000","last_fullsized":"2024-04-26T12:35:28.208145+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:35.792155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":78,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211036+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:28.211036+0000","last_peered":"2024-04-26T12:35:28.211036+0000","last_clean":"2024-04-26T12:35:28.211036+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:28.211036+0000","last_undegraded":"2024-04-26T12:35:28.211036+0000","last_fullsized":"2024-04-26T12:35:28.211036+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:04.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2165,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208223+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:28.208223+0000","last_peered":"2024-04-26T12:35:28.208223+0000","last_clean":"2024-04-26T12:35:28.208223+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:28.208223+0000","last_undegraded":"2024-04-26T12:35:28.208223+0000","last_fullsized":"2024-04-26T12:35:28.208223+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:35.341488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":117,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.211625+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:28.211625+0000","last_peered":"2024-04-26T12:35:28.211625+0000","last_clean":"2024-04-26T12:35:28.211625+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:28.211625+0000","last_undegraded":"2024-04-26T12:35:28.211625+0000","last_fullsized":"2024-04-26T12:35:28.211625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:48.652134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":73,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210182+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:28.210182+0000","last_peered":"2024-04-26T12:35:28.210182+0000","last_clean":"2024-04-26T12:35:28.210182+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:28.210182+0000","last_undegraded":"2024-04-26T12:35:28.210182+0000","last_fullsized":"2024-04-26T12:35:28.210182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.152952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2027,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208731+0000","last_change":"2024-04-26T12:35:26.169463+0000","last_active":"2024-04-26T12:35:28.208731+0000","last_peered":"2024-04-26T12:35:28.208731+0000","last_clean":"2024-04-26T12:35:28.208731+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:35:28.208731+0000","last_undegraded":"2024-04-26T12:35:28.208731+0000","last_fullsized":"2024-04-26T12:35:28.208731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:48.293346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2132,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.210411+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:28.210411+0000","last_peered":"2024-04-26T12:35:28.210411+0000","last_clean":"2024-04-26T12:35:28.210411+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:28.210411+0000","last_undegraded":"2024-04-26T12:35:28.210411+0000","last_fullsized":"2024-04-26T12:35:28.210411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:10.714880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2137,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-26T12:35:28.208869+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:28.208869+0000","last_peered":"2024-04-26T12:35:28.208869+0000","last_clean":"2024-04-26T12:35:28.208869+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:28.208869+0000","last_undegraded":"2024-04-26T12:35:28.208869+0000","last_fullsized":"2024-04-26T12:35:28.208869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142984,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228856,"statfs":{"total":96636764160,"available":95466348544,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":0.68100000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.41699999999999998,"15min":0.439},"min":{"1min":0.41699999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.60199999999999998,"5min":0.628,"15min":0.628},"last":0.61199999999999999}]}]},{"osd":0,"up_from":85,"seq":365072220169,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52668,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319172,"statfs":{"total":96636764160,"available":96582832128,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511168,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860672,"statfs":{"total":96636764160,"available":95089328128,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.308}]},{"osd":2,"last update":"Fri Apr 26 12:35:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.42099999999999999,"15min":0.441},"min":{"1min":0.40699999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.64000000000000001,"5min":1.137,"15min":1.137},"last":0.35899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:38.143 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.143 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.143 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.143 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.144 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.144 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.144 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.144 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.144 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.145 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.145 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.145 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.145 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.146 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.146 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.146 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.146 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.147 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.147 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.147 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.147 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.148 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.148 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.148 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.148 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.149 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.149 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.149 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.149 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.149 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.150 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.150 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.150 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.150 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.150 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.150 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.151 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.151 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.151 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.151 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.151 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.151 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.152 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.152 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.152 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.152 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.152 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.152 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.153 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.153 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.153 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.153 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.153 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.154 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.154 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.154 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.154 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.154 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.155 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.155 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.155 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.155 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.156 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.156 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.156 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.156 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.156 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.156 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.156 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.157 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.157 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.157 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.157 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.157 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.157 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.157 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.157 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.158 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.158 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.158 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.158 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.158 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.159 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.159 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.159 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.159 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.159 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.159 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.160 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.160 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.160 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.160 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.160 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.160 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.161 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.161 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.161 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.161 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.161 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.161 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.161 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.162 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.162 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.162 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.162 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:38.162 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:35:58.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:35:58.543 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:35:58.545 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:35:58.557 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-04-26T12:35:57.056653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119322,"ondisk_log_size":119322,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706804,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408716,"statfs":{"total":289910292480,"available":287138525184,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003133"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2084,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222887+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:29.222887+0000","last_peered":"2024-04-26T12:35:29.222887+0000","last_clean":"2024-04-26T12:35:29.222887+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:29.222887+0000","last_undegraded":"2024-04-26T12:35:29.222887+0000","last_fullsized":"2024-04-26T12:35:29.222887+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":99,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:52.167121+0000","last_change":"2024-04-26T12:35:52.167251+0000","last_active":"2024-04-26T12:35:52.167121+0000","last_peered":"2024-04-26T12:35:52.167121+0000","last_clean":"2024-04-26T12:35:52.167121+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:52.167121+0000","last_undegraded":"2024-04-26T12:35:52.167121+0000","last_fullsized":"2024-04-26T12:35:52.167121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_clean_scrub_stamp":"2024-04-26T12:35:52.167078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.351227+0000","scrub_duration":0.0068001590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4143,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:45.987721+0000","last_change":"2024-04-26T12:35:45.987903+0000","last_active":"2024-04-26T12:35:45.987721+0000","last_peered":"2024-04-26T12:35:45.987721+0000","last_clean":"2024-04-26T12:35:45.987721+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:45.987721+0000","last_undegraded":"2024-04-26T12:35:45.987721+0000","last_fullsized":"2024-04-26T12:35:45.987721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4036","last_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_deep_scrub":"80'4036","last_deep_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_clean_scrub_stamp":"2024-04-26T12:35:45.987680+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:57.838823+0000","scrub_duration":0.014722818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":128,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:51.983130+0000","last_change":"2024-04-26T12:35:51.983250+0000","last_active":"2024-04-26T12:35:51.983130+0000","last_peered":"2024-04-26T12:35:51.983130+0000","last_clean":"2024-04-26T12:35:51.983130+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:51.983130+0000","last_undegraded":"2024-04-26T12:35:51.983130+0000","last_fullsized":"2024-04-26T12:35:51.983130+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_clean_scrub_stamp":"2024-04-26T12:35:51.983105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:34.627140+0000","scrub_duration":0.0030895979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2156,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.163660+0000","last_change":"2024-04-26T12:35:26.167949+0000","last_active":"2024-04-26T12:35:35.163660+0000","last_peered":"2024-04-26T12:35:35.163660+0000","last_clean":"2024-04-26T12:35:35.163660+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:35:35.163660+0000","last_undegraded":"2024-04-26T12:35:35.163660+0000","last_fullsized":"2024-04-26T12:35:35.163660+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103322+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:35.103322+0000","last_peered":"2024-04-26T12:35:35.103322+0000","last_clean":"2024-04-26T12:35:35.103322+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:35.103322+0000","last_undegraded":"2024-04-26T12:35:35.103322+0000","last_fullsized":"2024-04-26T12:35:35.103322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":60,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103311+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:35.103311+0000","last_peered":"2024-04-26T12:35:35.103311+0000","last_clean":"2024-04-26T12:35:35.103311+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:35.103311+0000","last_undegraded":"2024-04-26T12:35:35.103311+0000","last_fullsized":"2024-04-26T12:35:35.103311+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8217,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.006065+0000","last_change":"2024-04-26T12:35:38.006208+0000","last_active":"2024-04-26T12:35:38.006065+0000","last_peered":"2024-04-26T12:35:38.006065+0000","last_clean":"2024-04-26T12:35:38.006065+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:38.006065+0000","last_undegraded":"2024-04-26T12:35:38.006065+0000","last_fullsized":"2024-04-26T12:35:38.006065+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8077","last_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_deep_scrub":"80'8077","last_deep_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.006040+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:57.036646+0000","scrub_duration":0.014128129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6180,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227277+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:29.227277+0000","last_peered":"2024-04-26T12:35:29.227277+0000","last_clean":"2024-04-26T12:35:29.227277+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:29.227277+0000","last_undegraded":"2024-04-26T12:35:29.227277+0000","last_fullsized":"2024-04-26T12:35:29.227277+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6252,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.280808+0000","last_change":"2024-04-26T12:35:49.280948+0000","last_active":"2024-04-26T12:35:49.280808+0000","last_peered":"2024-04-26T12:35:49.280808+0000","last_clean":"2024-04-26T12:35:49.280808+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:49.280808+0000","last_undegraded":"2024-04-26T12:35:49.280808+0000","last_fullsized":"2024-04-26T12:35:49.280808+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6120","last_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_deep_scrub":"80'6120","last_deep_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.280781+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:12.424132+0000","scrub_duration":0.01226383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4080,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102734+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:30.102734+0000","last_peered":"2024-04-26T12:35:30.102734+0000","last_clean":"2024-04-26T12:35:30.102734+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:30.102734+0000","last_undegraded":"2024-04-26T12:35:30.102734+0000","last_fullsized":"2024-04-26T12:35:30.102734+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2094,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222317+0000","last_change":"2024-04-26T12:35:26.168307+0000","last_active":"2024-04-26T12:35:29.222317+0000","last_peered":"2024-04-26T12:35:29.222317+0000","last_clean":"2024-04-26T12:35:29.222317+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:29.222317+0000","last_undegraded":"2024-04-26T12:35:29.222317+0000","last_fullsized":"2024-04-26T12:35:29.222317+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2139,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222284+0000","last_change":"2024-04-26T12:35:26.167308+0000","last_active":"2024-04-26T12:35:29.222284+0000","last_peered":"2024-04-26T12:35:29.222284+0000","last_clean":"2024-04-26T12:35:29.222284+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:35:29.222284+0000","last_undegraded":"2024-04-26T12:35:29.222284+0000","last_fullsized":"2024-04-26T12:35:29.222284+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2148,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240932+0000","last_change":"2024-04-26T12:30:32.617662+0000","last_active":"2024-04-26T12:35:29.240932+0000","last_peered":"2024-04-26T12:35:29.240932+0000","last_clean":"2024-04-26T12:35:29.240932+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:29.240932+0000","last_undegraded":"2024-04-26T12:35:29.240932+0000","last_fullsized":"2024-04-26T12:35:29.240932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2167,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239961+0000","last_change":"2024-04-26T12:30:32.618205+0000","last_active":"2024-04-26T12:35:29.239961+0000","last_peered":"2024-04-26T12:35:29.239961+0000","last_clean":"2024-04-26T12:35:29.239961+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:35:29.239961+0000","last_undegraded":"2024-04-26T12:35:29.239961+0000","last_fullsized":"2024-04-26T12:35:29.239961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102574+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:30.102574+0000","last_peered":"2024-04-26T12:35:30.102574+0000","last_clean":"2024-04-26T12:35:30.102574+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:30.102574+0000","last_undegraded":"2024-04-26T12:35:30.102574+0000","last_fullsized":"2024-04-26T12:35:30.102574+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2119,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227235+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:29.227235+0000","last_peered":"2024-04-26T12:35:29.227235+0000","last_clean":"2024-04-26T12:35:29.227235+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:29.227235+0000","last_undegraded":"2024-04-26T12:35:29.227235+0000","last_fullsized":"2024-04-26T12:35:29.227235+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223130+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:29.223130+0000","last_peered":"2024-04-26T12:35:29.223130+0000","last_clean":"2024-04-26T12:35:29.223130+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:29.223130+0000","last_undegraded":"2024-04-26T12:35:29.223130+0000","last_fullsized":"2024-04-26T12:35:29.223130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4099,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226842+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:29.226842+0000","last_peered":"2024-04-26T12:35:29.226842+0000","last_clean":"2024-04-26T12:35:29.226842+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:29.226842+0000","last_undegraded":"2024-04-26T12:35:29.226842+0000","last_fullsized":"2024-04-26T12:35:29.226842+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4223,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240789+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:29.240789+0000","last_peered":"2024-04-26T12:35:29.240789+0000","last_clean":"2024-04-26T12:35:29.240789+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:29.240789+0000","last_undegraded":"2024-04-26T12:35:29.240789+0000","last_fullsized":"2024-04-26T12:35:29.240789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":120,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240259+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:29.240259+0000","last_peered":"2024-04-26T12:35:29.240259+0000","last_clean":"2024-04-26T12:35:29.240259+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:29.240259+0000","last_undegraded":"2024-04-26T12:35:29.240259+0000","last_fullsized":"2024-04-26T12:35:29.240259+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2117,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222173+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:29.222173+0000","last_peered":"2024-04-26T12:35:29.222173+0000","last_clean":"2024-04-26T12:35:29.222173+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:29.222173+0000","last_undegraded":"2024-04-26T12:35:29.222173+0000","last_fullsized":"2024-04-26T12:35:29.222173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226240+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:29.226240+0000","last_peered":"2024-04-26T12:35:29.226240+0000","last_clean":"2024-04-26T12:35:29.226240+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:29.226240+0000","last_undegraded":"2024-04-26T12:35:29.226240+0000","last_fullsized":"2024-04-26T12:35:29.226240+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4140,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222357+0000","last_change":"2024-04-26T12:35:26.165413+0000","last_active":"2024-04-26T12:35:29.222357+0000","last_peered":"2024-04-26T12:35:29.222357+0000","last_clean":"2024-04-26T12:35:29.222357+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:35:29.222357+0000","last_undegraded":"2024-04-26T12:35:29.222357+0000","last_fullsized":"2024-04-26T12:35:29.222357+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2142,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223025+0000","last_change":"2024-04-26T12:35:26.170324+0000","last_active":"2024-04-26T12:35:29.223025+0000","last_peered":"2024-04-26T12:35:29.223025+0000","last_clean":"2024-04-26T12:35:29.223025+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:29.223025+0000","last_undegraded":"2024-04-26T12:35:29.223025+0000","last_fullsized":"2024-04-26T12:35:29.223025+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227234+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:29.227234+0000","last_peered":"2024-04-26T12:35:29.227234+0000","last_clean":"2024-04-26T12:35:29.227234+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:29.227234+0000","last_undegraded":"2024-04-26T12:35:29.227234+0000","last_fullsized":"2024-04-26T12:35:29.227234+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.999615+0000","last_change":"2024-04-26T12:35:49.999776+0000","last_active":"2024-04-26T12:35:49.999615+0000","last_peered":"2024-04-26T12:35:49.999615+0000","last_clean":"2024-04-26T12:35:49.999615+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:49.999615+0000","last_undegraded":"2024-04-26T12:35:49.999615+0000","last_fullsized":"2024-04-26T12:35:49.999615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2006","last_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_deep_scrub":"80'2006","last_deep_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.999571+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:58.313518+0000","scrub_duration":0.012700795000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.163624+0000","last_change":"2024-04-26T12:35:26.165397+0000","last_active":"2024-04-26T12:35:35.163624+0000","last_peered":"2024-04-26T12:35:35.163624+0000","last_clean":"2024-04-26T12:35:35.163624+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:35:35.163624+0000","last_undegraded":"2024-04-26T12:35:35.163624+0000","last_fullsized":"2024-04-26T12:35:35.163624+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.161522+0000","last_change":"2024-04-26T12:35:38.161638+0000","last_active":"2024-04-26T12:35:38.161522+0000","last_peered":"2024-04-26T12:35:38.161522+0000","last_clean":"2024-04-26T12:35:38.161522+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:38.161522+0000","last_undegraded":"2024-04-26T12:35:38.161522+0000","last_fullsized":"2024-04-26T12:35:38.161522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.161494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:19.249824+0000","scrub_duration":0.014847795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.225981+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:29.225981+0000","last_peered":"2024-04-26T12:35:29.225981+0000","last_clean":"2024-04-26T12:35:29.225981+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:29.225981+0000","last_undegraded":"2024-04-26T12:35:29.225981+0000","last_fullsized":"2024-04-26T12:35:29.225981+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227128+0000","last_change":"2024-04-26T12:35:03.190685+0000","last_active":"2024-04-26T12:35:29.227128+0000","last_peered":"2024-04-26T12:35:29.227128+0000","last_clean":"2024-04-26T12:35:29.227128+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:35:29.227128+0000","last_undegraded":"2024-04-26T12:35:29.227128+0000","last_fullsized":"2024-04-26T12:35:29.227128+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.225870+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:29.225870+0000","last_peered":"2024-04-26T12:35:29.225870+0000","last_clean":"2024-04-26T12:35:29.225870+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:29.225870+0000","last_undegraded":"2024-04-26T12:35:29.225870+0000","last_fullsized":"2024-04-26T12:35:29.225870+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223197+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:29.223197+0000","last_peered":"2024-04-26T12:35:29.223197+0000","last_clean":"2024-04-26T12:35:29.223197+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:29.223197+0000","last_undegraded":"2024-04-26T12:35:29.223197+0000","last_fullsized":"2024-04-26T12:35:29.223197+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227029+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:29.227029+0000","last_peered":"2024-04-26T12:35:29.227029+0000","last_clean":"2024-04-26T12:35:29.227029+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:29.227029+0000","last_undegraded":"2024-04-26T12:35:29.227029+0000","last_fullsized":"2024-04-26T12:35:29.227029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:46.789110+0000","last_change":"2024-04-26T12:35:46.789233+0000","last_active":"2024-04-26T12:35:46.789110+0000","last_peered":"2024-04-26T12:35:46.789110+0000","last_clean":"2024-04-26T12:35:46.789110+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:46.789110+0000","last_undegraded":"2024-04-26T12:35:46.789110+0000","last_fullsized":"2024-04-26T12:35:46.789110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_clean_scrub_stamp":"2024-04-26T12:35:46.789065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:51.542684+0000","scrub_duration":0.010829827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102784+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:30.102784+0000","last_peered":"2024-04-26T12:35:30.102784+0000","last_clean":"2024-04-26T12:35:30.102784+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:30.102784+0000","last_undegraded":"2024-04-26T12:35:30.102784+0000","last_fullsized":"2024-04-26T12:35:30.102784+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226290+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:29.226290+0000","last_peered":"2024-04-26T12:35:29.226290+0000","last_clean":"2024-04-26T12:35:29.226290+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:29.226290+0000","last_undegraded":"2024-04-26T12:35:29.226290+0000","last_fullsized":"2024-04-26T12:35:29.226290+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223086+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:29.223086+0000","last_peered":"2024-04-26T12:35:29.223086+0000","last_clean":"2024-04-26T12:35:29.223086+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:29.223086+0000","last_undegraded":"2024-04-26T12:35:29.223086+0000","last_fullsized":"2024-04-26T12:35:29.223086+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:42.691761+0000","last_change":"2024-04-26T12:35:42.691943+0000","last_active":"2024-04-26T12:35:42.691761+0000","last_peered":"2024-04-26T12:35:42.691761+0000","last_clean":"2024-04-26T12:35:42.691761+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:42.691761+0000","last_undegraded":"2024-04-26T12:35:42.691761+0000","last_fullsized":"2024-04-26T12:35:42.691761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4058","last_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_deep_scrub":"80'4058","last_deep_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_clean_scrub_stamp":"2024-04-26T12:35:42.691721+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:59.851784+0000","scrub_duration":0.010224120999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":193,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240550+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:29.240550+0000","last_peered":"2024-04-26T12:35:29.240550+0000","last_clean":"2024-04-26T12:35:29.240550+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:29.240550+0000","last_undegraded":"2024-04-26T12:35:29.240550+0000","last_fullsized":"2024-04-26T12:35:29.240550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4190,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240615+0000","last_change":"2024-04-26T12:30:32.620201+0000","last_active":"2024-04-26T12:35:29.240615+0000","last_peered":"2024-04-26T12:35:29.240615+0000","last_clean":"2024-04-26T12:35:29.240615+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:29.240615+0000","last_undegraded":"2024-04-26T12:35:29.240615+0000","last_fullsized":"2024-04-26T12:35:29.240615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240495+0000","last_change":"2024-04-26T12:35:03.184766+0000","last_active":"2024-04-26T12:35:29.240495+0000","last_peered":"2024-04-26T12:35:29.240495+0000","last_clean":"2024-04-26T12:35:29.240495+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:35:29.240495+0000","last_undegraded":"2024-04-26T12:35:29.240495+0000","last_fullsized":"2024-04-26T12:35:29.240495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2082,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222550+0000","last_change":"2024-04-26T12:35:26.166921+0000","last_active":"2024-04-26T12:35:29.222550+0000","last_peered":"2024-04-26T12:35:29.222550+0000","last_clean":"2024-04-26T12:35:29.222550+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:35:29.222550+0000","last_undegraded":"2024-04-26T12:35:29.222550+0000","last_fullsized":"2024-04-26T12:35:29.222550+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226184+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:29.226184+0000","last_peered":"2024-04-26T12:35:29.226184+0000","last_clean":"2024-04-26T12:35:29.226184+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:29.226184+0000","last_undegraded":"2024-04-26T12:35:29.226184+0000","last_fullsized":"2024-04-26T12:35:29.226184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223191+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:29.223191+0000","last_peered":"2024-04-26T12:35:29.223191+0000","last_clean":"2024-04-26T12:35:29.223191+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:29.223191+0000","last_undegraded":"2024-04-26T12:35:29.223191+0000","last_fullsized":"2024-04-26T12:35:29.223191+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222537+0000","last_change":"2024-04-26T12:35:26.163714+0000","last_active":"2024-04-26T12:35:29.222537+0000","last_peered":"2024-04-26T12:35:29.222537+0000","last_clean":"2024-04-26T12:35:29.222537+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:35:29.222537+0000","last_undegraded":"2024-04-26T12:35:29.222537+0000","last_fullsized":"2024-04-26T12:35:29.222537+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227174+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:29.227174+0000","last_peered":"2024-04-26T12:35:29.227174+0000","last_clean":"2024-04-26T12:35:29.227174+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:29.227174+0000","last_undegraded":"2024-04-26T12:35:29.227174+0000","last_fullsized":"2024-04-26T12:35:29.227174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":106,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240129+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:29.240129+0000","last_peered":"2024-04-26T12:35:29.240129+0000","last_clean":"2024-04-26T12:35:29.240129+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:29.240129+0000","last_undegraded":"2024-04-26T12:35:29.240129+0000","last_fullsized":"2024-04-26T12:35:29.240129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227218+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:29.227218+0000","last_peered":"2024-04-26T12:35:29.227218+0000","last_clean":"2024-04-26T12:35:29.227218+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:29.227218+0000","last_undegraded":"2024-04-26T12:35:29.227218+0000","last_fullsized":"2024-04-26T12:35:29.227218+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":98,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240716+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:29.240716+0000","last_peered":"2024-04-26T12:35:29.240716+0000","last_clean":"2024-04-26T12:35:29.240716+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:29.240716+0000","last_undegraded":"2024-04-26T12:35:29.240716+0000","last_fullsized":"2024-04-26T12:35:29.240716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2096,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222476+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:29.222476+0000","last_peered":"2024-04-26T12:35:29.222476+0000","last_clean":"2024-04-26T12:35:29.222476+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:29.222476+0000","last_undegraded":"2024-04-26T12:35:29.222476+0000","last_fullsized":"2024-04-26T12:35:29.222476+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222921+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:29.222921+0000","last_peered":"2024-04-26T12:35:29.222921+0000","last_clean":"2024-04-26T12:35:29.222921+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:29.222921+0000","last_undegraded":"2024-04-26T12:35:29.222921+0000","last_fullsized":"2024-04-26T12:35:29.222921+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:40.208916+0000","last_change":"2024-04-26T12:35:40.209064+0000","last_active":"2024-04-26T12:35:40.208916+0000","last_peered":"2024-04-26T12:35:40.208916+0000","last_clean":"2024-04-26T12:35:40.208916+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:40.208916+0000","last_undegraded":"2024-04-26T12:35:40.208916+0000","last_fullsized":"2024-04-26T12:35:40.208916+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_clean_scrub_stamp":"2024-04-26T12:35:40.208887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:37.520324+0000","scrub_duration":0.016687707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":31,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102753+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:30.102753+0000","last_peered":"2024-04-26T12:35:30.102753+0000","last_clean":"2024-04-26T12:35:30.102753+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:30.102753+0000","last_undegraded":"2024-04-26T12:35:30.102753+0000","last_fullsized":"2024-04-26T12:35:30.102753+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240669+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:29.240669+0000","last_peered":"2024-04-26T12:35:29.240669+0000","last_clean":"2024-04-26T12:35:29.240669+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:29.240669+0000","last_undegraded":"2024-04-26T12:35:29.240669+0000","last_fullsized":"2024-04-26T12:35:29.240669+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240225+0000","last_change":"2024-04-26T12:35:03.189253+0000","last_active":"2024-04-26T12:35:29.240225+0000","last_peered":"2024-04-26T12:35:29.240225+0000","last_clean":"2024-04-26T12:35:29.240225+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:35:29.240225+0000","last_undegraded":"2024-04-26T12:35:29.240225+0000","last_fullsized":"2024-04-26T12:35:29.240225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226686+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:29.226686+0000","last_peered":"2024-04-26T12:35:29.226686+0000","last_clean":"2024-04-26T12:35:29.226686+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:29.226686+0000","last_undegraded":"2024-04-26T12:35:29.226686+0000","last_fullsized":"2024-04-26T12:35:29.226686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":77,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226393+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:29.226393+0000","last_peered":"2024-04-26T12:35:29.226393+0000","last_clean":"2024-04-26T12:35:29.226393+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:29.226393+0000","last_undegraded":"2024-04-26T12:35:29.226393+0000","last_fullsized":"2024-04-26T12:35:29.226393+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240516+0000","last_change":"2024-04-26T12:35:05.902297+0000","last_active":"2024-04-26T12:35:29.240516+0000","last_peered":"2024-04-26T12:35:29.240516+0000","last_clean":"2024-04-26T12:35:29.240516+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:29.240516+0000","last_undegraded":"2024-04-26T12:35:29.240516+0000","last_fullsized":"2024-04-26T12:35:29.240516+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240317+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:29.240317+0000","last_peered":"2024-04-26T12:35:29.240317+0000","last_clean":"2024-04-26T12:35:29.240317+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:29.240317+0000","last_undegraded":"2024-04-26T12:35:29.240317+0000","last_fullsized":"2024-04-26T12:35:29.240317+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2135,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240978+0000","last_change":"2024-04-26T12:30:32.620824+0000","last_active":"2024-04-26T12:35:29.240978+0000","last_peered":"2024-04-26T12:35:29.240978+0000","last_clean":"2024-04-26T12:35:29.240978+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:35:29.240978+0000","last_undegraded":"2024-04-26T12:35:29.240978+0000","last_fullsized":"2024-04-26T12:35:29.240978+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222113+0000","last_change":"2024-04-26T12:35:26.161621+0000","last_active":"2024-04-26T12:35:29.222113+0000","last_peered":"2024-04-26T12:35:29.222113+0000","last_clean":"2024-04-26T12:35:29.222113+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:35:29.222113+0000","last_undegraded":"2024-04-26T12:35:29.222113+0000","last_fullsized":"2024-04-26T12:35:29.222113+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2161,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240643+0000","last_change":"2024-04-26T12:30:32.618210+0000","last_active":"2024-04-26T12:35:29.240643+0000","last_peered":"2024-04-26T12:35:29.240643+0000","last_clean":"2024-04-26T12:35:29.240643+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:35:29.240643+0000","last_undegraded":"2024-04-26T12:35:29.240643+0000","last_fullsized":"2024-04-26T12:35:29.240643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222233+0000","last_change":"2024-04-26T12:35:26.163568+0000","last_active":"2024-04-26T12:35:29.222233+0000","last_peered":"2024-04-26T12:35:29.222233+0000","last_clean":"2024-04-26T12:35:29.222233+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:35:29.222233+0000","last_undegraded":"2024-04-26T12:35:29.222233+0000","last_fullsized":"2024-04-26T12:35:29.222233+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227148+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:29.227148+0000","last_peered":"2024-04-26T12:35:29.227148+0000","last_clean":"2024-04-26T12:35:29.227148+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:29.227148+0000","last_undegraded":"2024-04-26T12:35:29.227148+0000","last_fullsized":"2024-04-26T12:35:29.227148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:54.828629+0000","last_change":"2024-04-26T12:35:54.828732+0000","last_active":"2024-04-26T12:35:54.828629+0000","last_peered":"2024-04-26T12:35:54.828629+0000","last_clean":"2024-04-26T12:35:54.828629+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:54.828629+0000","last_undegraded":"2024-04-26T12:35:54.828629+0000","last_fullsized":"2024-04-26T12:35:54.828629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_clean_scrub_stamp":"2024-04-26T12:35:54.828605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:29.226278+0000","scrub_duration":0.001515267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240645+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:29.240645+0000","last_peered":"2024-04-26T12:35:29.240645+0000","last_clean":"2024-04-26T12:35:29.240645+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:29.240645+0000","last_undegraded":"2024-04-26T12:35:29.240645+0000","last_fullsized":"2024-04-26T12:35:29.240645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222575+0000","last_change":"2024-04-26T12:35:26.163875+0000","last_active":"2024-04-26T12:35:29.222575+0000","last_peered":"2024-04-26T12:35:29.222575+0000","last_clean":"2024-04-26T12:35:29.222575+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:35:29.222575+0000","last_undegraded":"2024-04-26T12:35:29.222575+0000","last_fullsized":"2024-04-26T12:35:29.222575+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240831+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:29.240831+0000","last_peered":"2024-04-26T12:35:29.240831+0000","last_clean":"2024-04-26T12:35:29.240831+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:29.240831+0000","last_undegraded":"2024-04-26T12:35:29.240831+0000","last_fullsized":"2024-04-26T12:35:29.240831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240376+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:29.240376+0000","last_peered":"2024-04-26T12:35:29.240376+0000","last_clean":"2024-04-26T12:35:29.240376+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:29.240376+0000","last_undegraded":"2024-04-26T12:35:29.240376+0000","last_fullsized":"2024-04-26T12:35:29.240376+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226341+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:29.226341+0000","last_peered":"2024-04-26T12:35:29.226341+0000","last_clean":"2024-04-26T12:35:29.226341+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:29.226341+0000","last_undegraded":"2024-04-26T12:35:29.226341+0000","last_fullsized":"2024-04-26T12:35:29.226341+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226385+0000","last_change":"2024-04-26T12:35:03.186139+0000","last_active":"2024-04-26T12:35:29.226385+0000","last_peered":"2024-04-26T12:35:29.226385+0000","last_clean":"2024-04-26T12:35:29.226385+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:35:29.226385+0000","last_undegraded":"2024-04-26T12:35:29.226385+0000","last_fullsized":"2024-04-26T12:35:29.226385+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":95,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222103+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:29.222103+0000","last_peered":"2024-04-26T12:35:29.222103+0000","last_clean":"2024-04-26T12:35:29.222103+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:29.222103+0000","last_undegraded":"2024-04-26T12:35:29.222103+0000","last_fullsized":"2024-04-26T12:35:29.222103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227067+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:29.227067+0000","last_peered":"2024-04-26T12:35:29.227067+0000","last_clean":"2024-04-26T12:35:29.227067+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:29.227067+0000","last_undegraded":"2024-04-26T12:35:29.227067+0000","last_fullsized":"2024-04-26T12:35:29.227067+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240493+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:29.240493+0000","last_peered":"2024-04-26T12:35:29.240493+0000","last_clean":"2024-04-26T12:35:29.240493+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:29.240493+0000","last_undegraded":"2024-04-26T12:35:29.240493+0000","last_fullsized":"2024-04-26T12:35:29.240493+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":296,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239887+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:29.239887+0000","last_peered":"2024-04-26T12:35:29.239887+0000","last_clean":"2024-04-26T12:35:29.239887+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:29.239887+0000","last_undegraded":"2024-04-26T12:35:29.239887+0000","last_fullsized":"2024-04-26T12:35:29.239887+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226316+0000","last_change":"2024-04-26T12:35:03.174432+0000","last_active":"2024-04-26T12:35:29.226316+0000","last_peered":"2024-04-26T12:35:29.226316+0000","last_clean":"2024-04-26T12:35:29.226316+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:35:29.226316+0000","last_undegraded":"2024-04-26T12:35:29.226316+0000","last_fullsized":"2024-04-26T12:35:29.226316+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":84,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240750+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:29.240750+0000","last_peered":"2024-04-26T12:35:29.240750+0000","last_clean":"2024-04-26T12:35:29.240750+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:29.240750+0000","last_undegraded":"2024-04-26T12:35:29.240750+0000","last_fullsized":"2024-04-26T12:35:29.240750+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239975+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:29.239975+0000","last_peered":"2024-04-26T12:35:29.239975+0000","last_clean":"2024-04-26T12:35:29.239975+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:29.239975+0000","last_undegraded":"2024-04-26T12:35:29.239975+0000","last_fullsized":"2024-04-26T12:35:29.239975+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.833477+0000","last_change":"2024-04-26T12:35:55.833616+0000","last_active":"2024-04-26T12:35:55.833477+0000","last_peered":"2024-04-26T12:35:55.833477+0000","last_clean":"2024-04-26T12:35:55.833477+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:55.833477+0000","last_undegraded":"2024-04-26T12:35:55.833477+0000","last_fullsized":"2024-04-26T12:35:55.833477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.833451+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:41.021792+0000","scrub_duration":0.003578328,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8090,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223077+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:29.223077+0000","last_peered":"2024-04-26T12:35:29.223077+0000","last_clean":"2024-04-26T12:35:29.223077+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:29.223077+0000","last_undegraded":"2024-04-26T12:35:29.223077+0000","last_fullsized":"2024-04-26T12:35:29.223077+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:43.256681+0000","last_change":"2024-04-26T12:35:43.256815+0000","last_active":"2024-04-26T12:35:43.256681+0000","last_peered":"2024-04-26T12:35:43.256681+0000","last_clean":"2024-04-26T12:35:43.256681+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:43.256681+0000","last_undegraded":"2024-04-26T12:35:43.256681+0000","last_fullsized":"2024-04-26T12:35:43.256681+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_clean_scrub_stamp":"2024-04-26T12:35:43.256655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:10.856381+0000","scrub_duration":0.001974197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226625+0000","last_change":"2024-04-26T12:35:03.180293+0000","last_active":"2024-04-26T12:35:29.226625+0000","last_peered":"2024-04-26T12:35:29.226625+0000","last_clean":"2024-04-26T12:35:29.226625+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:29.226625+0000","last_undegraded":"2024-04-26T12:35:29.226625+0000","last_fullsized":"2024-04-26T12:35:29.226625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.150119+0000","last_change":"2024-04-26T12:35:55.150310+0000","last_active":"2024-04-26T12:35:55.150119+0000","last_peered":"2024-04-26T12:35:55.150119+0000","last_clean":"2024-04-26T12:35:55.150119+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:55.150119+0000","last_undegraded":"2024-04-26T12:35:55.150119+0000","last_fullsized":"2024-04-26T12:35:55.150119+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.150079+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.249254+0000","scrub_duration":0.011542274999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":77,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226935+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:29.226935+0000","last_peered":"2024-04-26T12:35:29.226935+0000","last_clean":"2024-04-26T12:35:29.226935+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:29.226935+0000","last_undegraded":"2024-04-26T12:35:29.226935+0000","last_fullsized":"2024-04-26T12:35:29.226935+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.880037+0000","last_change":"2024-04-26T12:35:49.880182+0000","last_active":"2024-04-26T12:35:49.880037+0000","last_peered":"2024-04-26T12:35:49.880037+0000","last_clean":"2024-04-26T12:35:49.880037+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:49.880037+0000","last_undegraded":"2024-04-26T12:35:49.880037+0000","last_fullsized":"2024-04-26T12:35:49.880037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.880012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.320847+0000","scrub_duration":0.0019327299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226034+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:29.226034+0000","last_peered":"2024-04-26T12:35:29.226034+0000","last_clean":"2024-04-26T12:35:29.226034+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:29.226034+0000","last_undegraded":"2024-04-26T12:35:29.226034+0000","last_fullsized":"2024-04-26T12:35:29.226034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240749+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:29.240749+0000","last_peered":"2024-04-26T12:35:29.240749+0000","last_clean":"2024-04-26T12:35:29.240749+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:29.240749+0000","last_undegraded":"2024-04-26T12:35:29.240749+0000","last_fullsized":"2024-04-26T12:35:29.240749+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"81'8","reported_seq":83,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227105+0000","last_change":"2024-04-26T12:35:03.195592+0000","last_active":"2024-04-26T12:35:29.227105+0000","last_peered":"2024-04-26T12:35:29.227105+0000","last_clean":"2024-04-26T12:35:29.227105+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:35:29.227105+0000","last_undegraded":"2024-04-26T12:35:29.227105+0000","last_fullsized":"2024-04-26T12:35:29.227105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":99,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222677+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:29.222677+0000","last_peered":"2024-04-26T12:35:29.222677+0000","last_clean":"2024-04-26T12:35:29.222677+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:29.222677+0000","last_undegraded":"2024-04-26T12:35:29.222677+0000","last_fullsized":"2024-04-26T12:35:29.222677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":60,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222563+0000","last_change":"2024-04-26T12:35:26.164494+0000","last_active":"2024-04-26T12:35:29.222563+0000","last_peered":"2024-04-26T12:35:29.222563+0000","last_clean":"2024-04-26T12:35:29.222563+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:35:29.222563+0000","last_undegraded":"2024-04-26T12:35:29.222563+0000","last_fullsized":"2024-04-26T12:35:29.222563+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2121,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.163694+0000","last_change":"2024-04-26T12:35:26.167507+0000","last_active":"2024-04-26T12:35:35.163694+0000","last_peered":"2024-04-26T12:35:35.163694+0000","last_clean":"2024-04-26T12:35:35.163694+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:35:35.163694+0000","last_undegraded":"2024-04-26T12:35:35.163694+0000","last_fullsized":"2024-04-26T12:35:35.163694+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103414+0000","last_change":"2024-04-26T12:35:03.189373+0000","last_active":"2024-04-26T12:35:35.103414+0000","last_peered":"2024-04-26T12:35:35.103414+0000","last_clean":"2024-04-26T12:35:35.103414+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:35:35.103414+0000","last_undegraded":"2024-04-26T12:35:35.103414+0000","last_fullsized":"2024-04-26T12:35:35.103414+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2159,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103373+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:35.103373+0000","last_peered":"2024-04-26T12:35:35.103373+0000","last_clean":"2024-04-26T12:35:35.103373+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:35.103373+0000","last_undegraded":"2024-04-26T12:35:35.103373+0000","last_fullsized":"2024-04-26T12:35:35.103373+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223153+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:29.223153+0000","last_peered":"2024-04-26T12:35:29.223153+0000","last_clean":"2024-04-26T12:35:29.223153+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:29.223153+0000","last_undegraded":"2024-04-26T12:35:29.223153+0000","last_fullsized":"2024-04-26T12:35:29.223153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":127,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:41.966293+0000","last_change":"2024-04-26T12:35:41.966428+0000","last_active":"2024-04-26T12:35:41.966293+0000","last_peered":"2024-04-26T12:35:41.966293+0000","last_clean":"2024-04-26T12:35:41.966293+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:41.966293+0000","last_undegraded":"2024-04-26T12:35:41.966293+0000","last_fullsized":"2024-04-26T12:35:41.966293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7","last_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_deep_scrub":"80'7","last_deep_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_clean_scrub_stamp":"2024-04-26T12:35:41.966266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:47.286627+0000","scrub_duration":0.011530692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":87,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:50.849528+0000","last_change":"2024-04-26T12:35:50.849631+0000","last_active":"2024-04-26T12:35:50.849528+0000","last_peered":"2024-04-26T12:35:50.849528+0000","last_clean":"2024-04-26T12:35:50.849528+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:50.849528+0000","last_undegraded":"2024-04-26T12:35:50.849528+0000","last_fullsized":"2024-04-26T12:35:50.849528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_clean_scrub_stamp":"2024-04-26T12:35:50.849501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:53.832051+0000","scrub_duration":0.002006037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4181,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222070+0000","last_change":"2024-04-26T12:35:26.167799+0000","last_active":"2024-04-26T12:35:29.222070+0000","last_peered":"2024-04-26T12:35:29.222070+0000","last_clean":"2024-04-26T12:35:29.222070+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:35:29.222070+0000","last_undegraded":"2024-04-26T12:35:29.222070+0000","last_fullsized":"2024-04-26T12:35:29.222070+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":79,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227128+0000","last_change":"2024-04-26T12:35:03.195543+0000","last_active":"2024-04-26T12:35:29.227128+0000","last_peered":"2024-04-26T12:35:29.227128+0000","last_clean":"2024-04-26T12:35:29.227128+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:35:29.227128+0000","last_undegraded":"2024-04-26T12:35:29.227128+0000","last_fullsized":"2024-04-26T12:35:29.227128+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2166,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222234+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:29.222234+0000","last_peered":"2024-04-26T12:35:29.222234+0000","last_clean":"2024-04-26T12:35:29.222234+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:29.222234+0000","last_undegraded":"2024-04-26T12:35:29.222234+0000","last_fullsized":"2024-04-26T12:35:29.222234+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":118,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240021+0000","last_change":"2024-04-26T12:35:03.180492+0000","last_active":"2024-04-26T12:35:29.240021+0000","last_peered":"2024-04-26T12:35:29.240021+0000","last_clean":"2024-04-26T12:35:29.240021+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:35:29.240021+0000","last_undegraded":"2024-04-26T12:35:29.240021+0000","last_fullsized":"2024-04-26T12:35:29.240021+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226514+0000","last_change":"2024-04-26T12:35:03.184507+0000","last_active":"2024-04-26T12:35:29.226514+0000","last_peered":"2024-04-26T12:35:29.226514+0000","last_clean":"2024-04-26T12:35:29.226514+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:29.226514+0000","last_undegraded":"2024-04-26T12:35:29.226514+0000","last_fullsized":"2024-04-26T12:35:29.226514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2028,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222691+0000","last_change":"2024-04-26T12:35:26.169463+0000","last_active":"2024-04-26T12:35:29.222691+0000","last_peered":"2024-04-26T12:35:29.222691+0000","last_clean":"2024-04-26T12:35:29.222691+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:35:29.222691+0000","last_undegraded":"2024-04-26T12:35:29.222691+0000","last_fullsized":"2024-04-26T12:35:29.222691+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2133,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226589+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:29.226589+0000","last_peered":"2024-04-26T12:35:29.226589+0000","last_clean":"2024-04-26T12:35:29.226589+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:29.226589+0000","last_undegraded":"2024-04-26T12:35:29.226589+0000","last_fullsized":"2024-04-26T12:35:29.226589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2138,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222723+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:29.222723+0000","last_peered":"2024-04-26T12:35:29.222723+0000","last_clean":"2024-04-26T12:35:29.222723+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:29.222723+0000","last_undegraded":"2024-04-26T12:35:29.222723+0000","last_fullsized":"2024-04-26T12:35:29.222723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142980,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228860,"statfs":{"total":96636764160,"available":95466352640,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.442},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.56399999999999995,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.371}]},{"osd":1,"last update":"Fri Apr 26 12:35:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42299999999999999,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.63200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42399999999999999,"15min":0.442},"min":{"1min":0.34999999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.51000000000000001}]}]},{"osd":0,"up_from":85,"seq":365072220173,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52660,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319180,"statfs":{"total":96636764160,"available":96582840320,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":1,"up_from":8,"seq":34359738438,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860676,"statfs":{"total":96636764160,"available":95089332224,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38300000000000001,"15min":0.38700000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.14899999999999999,"5min":0.14899999999999999,"15min":0.14899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:35:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.42099999999999999,"15min":0.441},"min":{"1min":0.40699999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.497},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.64000000000000001,"5min":1.137,"15min":1.137},"last":0.53800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:35:58.561 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.562 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.562 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.562 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.562 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.562 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.562 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.562 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.563 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.564 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.564 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.564 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.564 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.564 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.564 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.564 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.564 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.564 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.565 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.566 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.566 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.566 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.566 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.566 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.566 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.566 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.566 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.566 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.567 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.568 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.568 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.568 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.568 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.568 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.568 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.568 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.568 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.568 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.569 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.569 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.569 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.569 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.569 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.569 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.569 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.569 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.569 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.570 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.571 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.571 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.571 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.571 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:35:58.571 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:36:18.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:36:18.951 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:36:18.953 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:36:18.964 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2024-04-26T12:36:17.062372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119328,"ondisk_log_size":119328,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706804,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408716,"statfs":{"total":289910292480,"available":287138525184,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003320"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2084,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222887+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:29.222887+0000","last_peered":"2024-04-26T12:35:29.222887+0000","last_clean":"2024-04-26T12:35:29.222887+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:29.222887+0000","last_undegraded":"2024-04-26T12:35:29.222887+0000","last_fullsized":"2024-04-26T12:35:29.222887+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":99,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:52.167121+0000","last_change":"2024-04-26T12:35:52.167251+0000","last_active":"2024-04-26T12:35:52.167121+0000","last_peered":"2024-04-26T12:35:52.167121+0000","last_clean":"2024-04-26T12:35:52.167121+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:52.167121+0000","last_undegraded":"2024-04-26T12:35:52.167121+0000","last_fullsized":"2024-04-26T12:35:52.167121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_clean_scrub_stamp":"2024-04-26T12:35:52.167078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.351227+0000","scrub_duration":0.0068001590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4143,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:45.987721+0000","last_change":"2024-04-26T12:35:45.987903+0000","last_active":"2024-04-26T12:35:45.987721+0000","last_peered":"2024-04-26T12:35:45.987721+0000","last_clean":"2024-04-26T12:35:45.987721+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:45.987721+0000","last_undegraded":"2024-04-26T12:35:45.987721+0000","last_fullsized":"2024-04-26T12:35:45.987721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4036","last_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_deep_scrub":"80'4036","last_deep_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_clean_scrub_stamp":"2024-04-26T12:35:45.987680+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:57.838823+0000","scrub_duration":0.014722818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":128,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:51.983130+0000","last_change":"2024-04-26T12:35:51.983250+0000","last_active":"2024-04-26T12:35:51.983130+0000","last_peered":"2024-04-26T12:35:51.983130+0000","last_clean":"2024-04-26T12:35:51.983130+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:51.983130+0000","last_undegraded":"2024-04-26T12:35:51.983130+0000","last_fullsized":"2024-04-26T12:35:51.983130+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_clean_scrub_stamp":"2024-04-26T12:35:51.983105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:34.627140+0000","scrub_duration":0.0030895979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2156,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.163660+0000","last_change":"2024-04-26T12:35:26.167949+0000","last_active":"2024-04-26T12:35:35.163660+0000","last_peered":"2024-04-26T12:35:35.163660+0000","last_clean":"2024-04-26T12:35:35.163660+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:35:35.163660+0000","last_undegraded":"2024-04-26T12:35:35.163660+0000","last_fullsized":"2024-04-26T12:35:35.163660+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103322+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:35.103322+0000","last_peered":"2024-04-26T12:35:35.103322+0000","last_clean":"2024-04-26T12:35:35.103322+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:35.103322+0000","last_undegraded":"2024-04-26T12:35:35.103322+0000","last_fullsized":"2024-04-26T12:35:35.103322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":60,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103311+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:35.103311+0000","last_peered":"2024-04-26T12:35:35.103311+0000","last_clean":"2024-04-26T12:35:35.103311+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:35.103311+0000","last_undegraded":"2024-04-26T12:35:35.103311+0000","last_fullsized":"2024-04-26T12:35:35.103311+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8217,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.006065+0000","last_change":"2024-04-26T12:35:38.006208+0000","last_active":"2024-04-26T12:35:38.006065+0000","last_peered":"2024-04-26T12:35:38.006065+0000","last_clean":"2024-04-26T12:35:38.006065+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:38.006065+0000","last_undegraded":"2024-04-26T12:35:38.006065+0000","last_fullsized":"2024-04-26T12:35:38.006065+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8077","last_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_deep_scrub":"80'8077","last_deep_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.006040+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:57.036646+0000","scrub_duration":0.014128129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6180,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227277+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:29.227277+0000","last_peered":"2024-04-26T12:35:29.227277+0000","last_clean":"2024-04-26T12:35:29.227277+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:29.227277+0000","last_undegraded":"2024-04-26T12:35:29.227277+0000","last_fullsized":"2024-04-26T12:35:29.227277+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6252,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.280808+0000","last_change":"2024-04-26T12:35:49.280948+0000","last_active":"2024-04-26T12:35:49.280808+0000","last_peered":"2024-04-26T12:35:49.280808+0000","last_clean":"2024-04-26T12:35:49.280808+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:49.280808+0000","last_undegraded":"2024-04-26T12:35:49.280808+0000","last_fullsized":"2024-04-26T12:35:49.280808+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6120","last_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_deep_scrub":"80'6120","last_deep_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.280781+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:12.424132+0000","scrub_duration":0.01226383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4080,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102734+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:30.102734+0000","last_peered":"2024-04-26T12:35:30.102734+0000","last_clean":"2024-04-26T12:35:30.102734+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:30.102734+0000","last_undegraded":"2024-04-26T12:35:30.102734+0000","last_fullsized":"2024-04-26T12:35:30.102734+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.138480+0000","last_change":"2024-04-26T12:35:56.138597+0000","last_active":"2024-04-26T12:35:56.138480+0000","last_peered":"2024-04-26T12:35:56.138480+0000","last_clean":"2024-04-26T12:35:56.138480+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:56.138480+0000","last_undegraded":"2024-04-26T12:35:56.138480+0000","last_fullsized":"2024-04-26T12:35:56.138480+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2051","last_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_deep_scrub":"80'2051","last_deep_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.138454+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:03.549045+0000","scrub_duration":0.011597293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2139,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222284+0000","last_change":"2024-04-26T12:35:26.167308+0000","last_active":"2024-04-26T12:35:29.222284+0000","last_peered":"2024-04-26T12:35:29.222284+0000","last_clean":"2024-04-26T12:35:29.222284+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:35:29.222284+0000","last_undegraded":"2024-04-26T12:35:29.222284+0000","last_fullsized":"2024-04-26T12:35:29.222284+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2159,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:57.048226+0000","last_change":"2024-04-26T12:35:57.048340+0000","last_active":"2024-04-26T12:35:57.048226+0000","last_peered":"2024-04-26T12:35:57.048226+0000","last_clean":"2024-04-26T12:35:57.048226+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:57.048226+0000","last_undegraded":"2024-04-26T12:35:57.048226+0000","last_fullsized":"2024-04-26T12:35:57.048226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2052","last_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_deep_scrub":"80'2052","last_deep_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_clean_scrub_stamp":"2024-04-26T12:35:57.048199+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:27.456428+0000","scrub_duration":0.016047618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2178,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:01.108264+0000","last_change":"2024-04-26T12:36:01.108416+0000","last_active":"2024-04-26T12:36:01.108264+0000","last_peered":"2024-04-26T12:36:01.108264+0000","last_clean":"2024-04-26T12:36:01.108264+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:36:01.108264+0000","last_undegraded":"2024-04-26T12:36:01.108264+0000","last_fullsized":"2024-04-26T12:36:01.108264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2071","last_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_deep_scrub":"80'2071","last_deep_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_clean_scrub_stamp":"2024-04-26T12:36:01.108240+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:16.539046+0000","scrub_duration":0.014518568000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102574+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:30.102574+0000","last_peered":"2024-04-26T12:35:30.102574+0000","last_clean":"2024-04-26T12:35:30.102574+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:30.102574+0000","last_undegraded":"2024-04-26T12:35:30.102574+0000","last_fullsized":"2024-04-26T12:35:30.102574+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2119,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227235+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:29.227235+0000","last_peered":"2024-04-26T12:35:29.227235+0000","last_clean":"2024-04-26T12:35:29.227235+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:29.227235+0000","last_undegraded":"2024-04-26T12:35:29.227235+0000","last_fullsized":"2024-04-26T12:35:29.227235+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223130+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:29.223130+0000","last_peered":"2024-04-26T12:35:29.223130+0000","last_clean":"2024-04-26T12:35:29.223130+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:29.223130+0000","last_undegraded":"2024-04-26T12:35:29.223130+0000","last_fullsized":"2024-04-26T12:35:29.223130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4099,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226842+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:29.226842+0000","last_peered":"2024-04-26T12:35:29.226842+0000","last_clean":"2024-04-26T12:35:29.226842+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:29.226842+0000","last_undegraded":"2024-04-26T12:35:29.226842+0000","last_fullsized":"2024-04-26T12:35:29.226842+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4223,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240789+0000","last_change":"2024-04-26T12:35:05.901173+0000","last_active":"2024-04-26T12:35:29.240789+0000","last_peered":"2024-04-26T12:35:29.240789+0000","last_clean":"2024-04-26T12:35:29.240789+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:35:29.240789+0000","last_undegraded":"2024-04-26T12:35:29.240789+0000","last_fullsized":"2024-04-26T12:35:29.240789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":120,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240259+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:29.240259+0000","last_peered":"2024-04-26T12:35:29.240259+0000","last_clean":"2024-04-26T12:35:29.240259+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:29.240259+0000","last_undegraded":"2024-04-26T12:35:29.240259+0000","last_fullsized":"2024-04-26T12:35:29.240259+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2117,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222173+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:29.222173+0000","last_peered":"2024-04-26T12:35:29.222173+0000","last_clean":"2024-04-26T12:35:29.222173+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:29.222173+0000","last_undegraded":"2024-04-26T12:35:29.222173+0000","last_fullsized":"2024-04-26T12:35:29.222173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226240+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:29.226240+0000","last_peered":"2024-04-26T12:35:29.226240+0000","last_clean":"2024-04-26T12:35:29.226240+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:29.226240+0000","last_undegraded":"2024-04-26T12:35:29.226240+0000","last_fullsized":"2024-04-26T12:35:29.226240+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4151,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:03.188978+0000","last_change":"2024-04-26T12:36:03.189097+0000","last_active":"2024-04-26T12:36:03.188978+0000","last_peered":"2024-04-26T12:36:03.188978+0000","last_clean":"2024-04-26T12:36:03.188978+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:36:03.188978+0000","last_undegraded":"2024-04-26T12:36:03.188978+0000","last_fullsized":"2024-04-26T12:36:03.188978+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4067","last_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_deep_scrub":"80'4067","last_deep_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_clean_scrub_stamp":"2024-04-26T12:36:03.188951+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:22.219557+0000","scrub_duration":0.013814754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2153,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.127431+0000","last_change":"2024-04-26T12:35:59.127545+0000","last_active":"2024-04-26T12:35:59.127431+0000","last_peered":"2024-04-26T12:35:59.127431+0000","last_clean":"2024-04-26T12:35:59.127431+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:59.127431+0000","last_undegraded":"2024-04-26T12:35:59.127431+0000","last_fullsized":"2024-04-26T12:35:59.127431+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2053","last_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_deep_scrub":"80'2053","last_deep_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.127404+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:55.177992+0000","scrub_duration":0.018465079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227234+0000","last_change":"2024-04-26T12:35:03.190217+0000","last_active":"2024-04-26T12:35:29.227234+0000","last_peered":"2024-04-26T12:35:29.227234+0000","last_clean":"2024-04-26T12:35:29.227234+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:35:29.227234+0000","last_undegraded":"2024-04-26T12:35:29.227234+0000","last_fullsized":"2024-04-26T12:35:29.227234+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.999615+0000","last_change":"2024-04-26T12:35:49.999776+0000","last_active":"2024-04-26T12:35:49.999615+0000","last_peered":"2024-04-26T12:35:49.999615+0000","last_clean":"2024-04-26T12:35:49.999615+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:49.999615+0000","last_undegraded":"2024-04-26T12:35:49.999615+0000","last_fullsized":"2024-04-26T12:35:49.999615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2006","last_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_deep_scrub":"80'2006","last_deep_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.999571+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:58.313518+0000","scrub_duration":0.012700795000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.163624+0000","last_change":"2024-04-26T12:35:26.165397+0000","last_active":"2024-04-26T12:35:35.163624+0000","last_peered":"2024-04-26T12:35:35.163624+0000","last_clean":"2024-04-26T12:35:35.163624+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:35:35.163624+0000","last_undegraded":"2024-04-26T12:35:35.163624+0000","last_fullsized":"2024-04-26T12:35:35.163624+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.161522+0000","last_change":"2024-04-26T12:35:38.161638+0000","last_active":"2024-04-26T12:35:38.161522+0000","last_peered":"2024-04-26T12:35:38.161522+0000","last_clean":"2024-04-26T12:35:38.161522+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:38.161522+0000","last_undegraded":"2024-04-26T12:35:38.161522+0000","last_fullsized":"2024-04-26T12:35:38.161522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.161494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:19.249824+0000","scrub_duration":0.014847795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.225981+0000","last_change":"2024-04-26T12:35:03.188364+0000","last_active":"2024-04-26T12:35:29.225981+0000","last_peered":"2024-04-26T12:35:29.225981+0000","last_clean":"2024-04-26T12:35:29.225981+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:35:29.225981+0000","last_undegraded":"2024-04-26T12:35:29.225981+0000","last_fullsized":"2024-04-26T12:35:29.225981+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.946133+0000","last_change":"2024-04-26T12:36:07.946252+0000","last_active":"2024-04-26T12:36:07.946133+0000","last_peered":"2024-04-26T12:36:07.946133+0000","last_clean":"2024-04-26T12:36:07.946133+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:36:07.946133+0000","last_undegraded":"2024-04-26T12:36:07.946133+0000","last_fullsized":"2024-04-26T12:36:07.946133+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.946106+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:15.251311+0000","scrub_duration":0.0085133599999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.225870+0000","last_change":"2024-04-26T12:35:03.177931+0000","last_active":"2024-04-26T12:35:29.225870+0000","last_peered":"2024-04-26T12:35:29.225870+0000","last_clean":"2024-04-26T12:35:29.225870+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:35:29.225870+0000","last_undegraded":"2024-04-26T12:35:29.225870+0000","last_fullsized":"2024-04-26T12:35:29.225870+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223197+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:29.223197+0000","last_peered":"2024-04-26T12:35:29.223197+0000","last_clean":"2024-04-26T12:35:29.223197+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:29.223197+0000","last_undegraded":"2024-04-26T12:35:29.223197+0000","last_fullsized":"2024-04-26T12:35:29.223197+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227029+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:29.227029+0000","last_peered":"2024-04-26T12:35:29.227029+0000","last_clean":"2024-04-26T12:35:29.227029+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:29.227029+0000","last_undegraded":"2024-04-26T12:35:29.227029+0000","last_fullsized":"2024-04-26T12:35:29.227029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:46.789110+0000","last_change":"2024-04-26T12:35:46.789233+0000","last_active":"2024-04-26T12:35:46.789110+0000","last_peered":"2024-04-26T12:35:46.789110+0000","last_clean":"2024-04-26T12:35:46.789110+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:46.789110+0000","last_undegraded":"2024-04-26T12:35:46.789110+0000","last_fullsized":"2024-04-26T12:35:46.789110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_clean_scrub_stamp":"2024-04-26T12:35:46.789065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:51.542684+0000","scrub_duration":0.010829827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102784+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:30.102784+0000","last_peered":"2024-04-26T12:35:30.102784+0000","last_clean":"2024-04-26T12:35:30.102784+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:30.102784+0000","last_undegraded":"2024-04-26T12:35:30.102784+0000","last_fullsized":"2024-04-26T12:35:30.102784+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226290+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:29.226290+0000","last_peered":"2024-04-26T12:35:29.226290+0000","last_clean":"2024-04-26T12:35:29.226290+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:29.226290+0000","last_undegraded":"2024-04-26T12:35:29.226290+0000","last_fullsized":"2024-04-26T12:35:29.226290+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223086+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:29.223086+0000","last_peered":"2024-04-26T12:35:29.223086+0000","last_clean":"2024-04-26T12:35:29.223086+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:29.223086+0000","last_undegraded":"2024-04-26T12:35:29.223086+0000","last_fullsized":"2024-04-26T12:35:29.223086+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:42.691761+0000","last_change":"2024-04-26T12:35:42.691943+0000","last_active":"2024-04-26T12:35:42.691761+0000","last_peered":"2024-04-26T12:35:42.691761+0000","last_clean":"2024-04-26T12:35:42.691761+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:42.691761+0000","last_undegraded":"2024-04-26T12:35:42.691761+0000","last_fullsized":"2024-04-26T12:35:42.691761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4058","last_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_deep_scrub":"80'4058","last_deep_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_clean_scrub_stamp":"2024-04-26T12:35:42.691721+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:59.851784+0000","scrub_duration":0.010224120999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":193,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240550+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:29.240550+0000","last_peered":"2024-04-26T12:35:29.240550+0000","last_clean":"2024-04-26T12:35:29.240550+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:29.240550+0000","last_undegraded":"2024-04-26T12:35:29.240550+0000","last_fullsized":"2024-04-26T12:35:29.240550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4201,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.099299+0000","last_change":"2024-04-26T12:35:59.099460+0000","last_active":"2024-04-26T12:35:59.099299+0000","last_peered":"2024-04-26T12:35:59.099299+0000","last_clean":"2024-04-26T12:35:59.099299+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:59.099299+0000","last_undegraded":"2024-04-26T12:35:59.099299+0000","last_fullsized":"2024-04-26T12:35:59.099299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4094","last_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_deep_scrub":"80'4094","last_deep_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.099256+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:46.127201+0000","scrub_duration":0.013902207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"98'4","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:10.954307+0000","last_change":"2024-04-26T12:36:10.954415+0000","last_active":"2024-04-26T12:36:10.954307+0000","last_peered":"2024-04-26T12:36:10.954307+0000","last_clean":"2024-04-26T12:36:10.954307+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:36:10.954307+0000","last_undegraded":"2024-04-26T12:36:10.954307+0000","last_fullsized":"2024-04-26T12:36:10.954307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_clean_scrub_stamp":"2024-04-26T12:36:10.954281+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:30.939529+0000","scrub_duration":0.0038576499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2093,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.082461+0000","last_change":"2024-04-26T12:36:00.082579+0000","last_active":"2024-04-26T12:36:00.082461+0000","last_peered":"2024-04-26T12:36:00.082461+0000","last_clean":"2024-04-26T12:36:00.082461+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:36:00.082461+0000","last_undegraded":"2024-04-26T12:36:00.082461+0000","last_fullsized":"2024-04-26T12:36:00.082461+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1968","last_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_deep_scrub":"80'1968","last_deep_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.082433+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.908109+0000","scrub_duration":0.011161457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226184+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:29.226184+0000","last_peered":"2024-04-26T12:35:29.226184+0000","last_clean":"2024-04-26T12:35:29.226184+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:29.226184+0000","last_undegraded":"2024-04-26T12:35:29.226184+0000","last_fullsized":"2024-04-26T12:35:29.226184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223191+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:29.223191+0000","last_peered":"2024-04-26T12:35:29.223191+0000","last_clean":"2024-04-26T12:35:29.223191+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:29.223191+0000","last_undegraded":"2024-04-26T12:35:29.223191+0000","last_fullsized":"2024-04-26T12:35:29.223191+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222537+0000","last_change":"2024-04-26T12:35:26.163714+0000","last_active":"2024-04-26T12:35:29.222537+0000","last_peered":"2024-04-26T12:35:29.222537+0000","last_clean":"2024-04-26T12:35:29.222537+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:35:29.222537+0000","last_undegraded":"2024-04-26T12:35:29.222537+0000","last_fullsized":"2024-04-26T12:35:29.222537+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227174+0000","last_change":"2024-04-26T12:35:03.190878+0000","last_active":"2024-04-26T12:35:29.227174+0000","last_peered":"2024-04-26T12:35:29.227174+0000","last_clean":"2024-04-26T12:35:29.227174+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:35:29.227174+0000","last_undegraded":"2024-04-26T12:35:29.227174+0000","last_fullsized":"2024-04-26T12:35:29.227174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":106,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240129+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:29.240129+0000","last_peered":"2024-04-26T12:35:29.240129+0000","last_clean":"2024-04-26T12:35:29.240129+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:29.240129+0000","last_undegraded":"2024-04-26T12:35:29.240129+0000","last_fullsized":"2024-04-26T12:35:29.240129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227218+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:29.227218+0000","last_peered":"2024-04-26T12:35:29.227218+0000","last_clean":"2024-04-26T12:35:29.227218+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:29.227218+0000","last_undegraded":"2024-04-26T12:35:29.227218+0000","last_fullsized":"2024-04-26T12:35:29.227218+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":98,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240716+0000","last_change":"2024-04-26T12:30:32.159263+0000","last_active":"2024-04-26T12:35:29.240716+0000","last_peered":"2024-04-26T12:35:29.240716+0000","last_clean":"2024-04-26T12:35:29.240716+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:35:29.240716+0000","last_undegraded":"2024-04-26T12:35:29.240716+0000","last_fullsized":"2024-04-26T12:35:29.240716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2096,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222476+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:29.222476+0000","last_peered":"2024-04-26T12:35:29.222476+0000","last_clean":"2024-04-26T12:35:29.222476+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:29.222476+0000","last_undegraded":"2024-04-26T12:35:29.222476+0000","last_fullsized":"2024-04-26T12:35:29.222476+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222921+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:29.222921+0000","last_peered":"2024-04-26T12:35:29.222921+0000","last_clean":"2024-04-26T12:35:29.222921+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:29.222921+0000","last_undegraded":"2024-04-26T12:35:29.222921+0000","last_fullsized":"2024-04-26T12:35:29.222921+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:40.208916+0000","last_change":"2024-04-26T12:35:40.209064+0000","last_active":"2024-04-26T12:35:40.208916+0000","last_peered":"2024-04-26T12:35:40.208916+0000","last_clean":"2024-04-26T12:35:40.208916+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:40.208916+0000","last_undegraded":"2024-04-26T12:35:40.208916+0000","last_fullsized":"2024-04-26T12:35:40.208916+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_clean_scrub_stamp":"2024-04-26T12:35:40.208887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:37.520324+0000","scrub_duration":0.016687707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":31,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102753+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:30.102753+0000","last_peered":"2024-04-26T12:35:30.102753+0000","last_clean":"2024-04-26T12:35:30.102753+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:30.102753+0000","last_undegraded":"2024-04-26T12:35:30.102753+0000","last_fullsized":"2024-04-26T12:35:30.102753+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240669+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:29.240669+0000","last_peered":"2024-04-26T12:35:29.240669+0000","last_clean":"2024-04-26T12:35:29.240669+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:29.240669+0000","last_undegraded":"2024-04-26T12:35:29.240669+0000","last_fullsized":"2024-04-26T12:35:29.240669+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":121,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.982136+0000","last_change":"2024-04-26T12:36:14.982242+0000","last_active":"2024-04-26T12:36:14.982136+0000","last_peered":"2024-04-26T12:36:14.982136+0000","last_clean":"2024-04-26T12:36:14.982136+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:36:14.982136+0000","last_undegraded":"2024-04-26T12:36:14.982136+0000","last_fullsized":"2024-04-26T12:36:14.982136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.982103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.704809+0000","scrub_duration":0.0018977480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226686+0000","last_change":"2024-04-26T12:35:03.186113+0000","last_active":"2024-04-26T12:35:29.226686+0000","last_peered":"2024-04-26T12:35:29.226686+0000","last_clean":"2024-04-26T12:35:29.226686+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:35:29.226686+0000","last_undegraded":"2024-04-26T12:35:29.226686+0000","last_fullsized":"2024-04-26T12:35:29.226686+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":77,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226393+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:29.226393+0000","last_peered":"2024-04-26T12:35:29.226393+0000","last_clean":"2024-04-26T12:35:29.226393+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:29.226393+0000","last_undegraded":"2024-04-26T12:35:29.226393+0000","last_fullsized":"2024-04-26T12:35:29.226393+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.017218+0000","last_change":"2024-04-26T12:35:56.017326+0000","last_active":"2024-04-26T12:35:56.017218+0000","last_peered":"2024-04-26T12:35:56.017218+0000","last_clean":"2024-04-26T12:35:56.017218+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:56.017218+0000","last_undegraded":"2024-04-26T12:35:56.017218+0000","last_fullsized":"2024-04-26T12:35:56.017218+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1980","last_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_deep_scrub":"80'1980","last_deep_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.017191+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:19.910231+0000","scrub_duration":0.0081651450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240317+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:29.240317+0000","last_peered":"2024-04-26T12:35:29.240317+0000","last_clean":"2024-04-26T12:35:29.240317+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:29.240317+0000","last_undegraded":"2024-04-26T12:35:29.240317+0000","last_fullsized":"2024-04-26T12:35:29.240317+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2146,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:04.058960+0000","last_change":"2024-04-26T12:36:04.059101+0000","last_active":"2024-04-26T12:36:04.058960+0000","last_peered":"2024-04-26T12:36:04.058960+0000","last_clean":"2024-04-26T12:36:04.058960+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:36:04.058960+0000","last_undegraded":"2024-04-26T12:36:04.058960+0000","last_fullsized":"2024-04-26T12:36:04.058960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2039","last_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_deep_scrub":"80'2039","last_deep_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_clean_scrub_stamp":"2024-04-26T12:36:04.058924+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:30.481629+0000","scrub_duration":0.012146647999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222113+0000","last_change":"2024-04-26T12:35:26.161621+0000","last_active":"2024-04-26T12:35:29.222113+0000","last_peered":"2024-04-26T12:35:29.222113+0000","last_clean":"2024-04-26T12:35:29.222113+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:35:29.222113+0000","last_undegraded":"2024-04-26T12:35:29.222113+0000","last_fullsized":"2024-04-26T12:35:29.222113+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.984844+0000","last_change":"2024-04-26T12:36:09.984957+0000","last_active":"2024-04-26T12:36:09.984844+0000","last_peered":"2024-04-26T12:36:09.984844+0000","last_clean":"2024-04-26T12:36:09.984844+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:36:09.984844+0000","last_undegraded":"2024-04-26T12:36:09.984844+0000","last_fullsized":"2024-04-26T12:36:09.984844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2065","last_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_deep_scrub":"80'2065","last_deep_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.984820+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:04.882200+0000","scrub_duration":0.013017881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":96,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.285614+0000","last_change":"2024-04-26T12:36:14.285733+0000","last_active":"2024-04-26T12:36:14.285614+0000","last_peered":"2024-04-26T12:36:14.285614+0000","last_clean":"2024-04-26T12:36:14.285614+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:36:14.285614+0000","last_undegraded":"2024-04-26T12:36:14.285614+0000","last_fullsized":"2024-04-26T12:36:14.285614+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.285570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:22.599518+0000","scrub_duration":0.0020305150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227148+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:29.227148+0000","last_peered":"2024-04-26T12:35:29.227148+0000","last_clean":"2024-04-26T12:35:29.227148+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:29.227148+0000","last_undegraded":"2024-04-26T12:35:29.227148+0000","last_fullsized":"2024-04-26T12:35:29.227148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:54.828629+0000","last_change":"2024-04-26T12:35:54.828732+0000","last_active":"2024-04-26T12:35:54.828629+0000","last_peered":"2024-04-26T12:35:54.828629+0000","last_clean":"2024-04-26T12:35:54.828629+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:54.828629+0000","last_undegraded":"2024-04-26T12:35:54.828629+0000","last_fullsized":"2024-04-26T12:35:54.828629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_clean_scrub_stamp":"2024-04-26T12:35:54.828605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:29.226278+0000","scrub_duration":0.001515267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240645+0000","last_change":"2024-04-26T12:35:03.184367+0000","last_active":"2024-04-26T12:35:29.240645+0000","last_peered":"2024-04-26T12:35:29.240645+0000","last_clean":"2024-04-26T12:35:29.240645+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:35:29.240645+0000","last_undegraded":"2024-04-26T12:35:29.240645+0000","last_fullsized":"2024-04-26T12:35:29.240645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222575+0000","last_change":"2024-04-26T12:35:26.163875+0000","last_active":"2024-04-26T12:35:29.222575+0000","last_peered":"2024-04-26T12:35:29.222575+0000","last_clean":"2024-04-26T12:35:29.222575+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:35:29.222575+0000","last_undegraded":"2024-04-26T12:35:29.222575+0000","last_fullsized":"2024-04-26T12:35:29.222575+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240831+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:29.240831+0000","last_peered":"2024-04-26T12:35:29.240831+0000","last_clean":"2024-04-26T12:35:29.240831+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:29.240831+0000","last_undegraded":"2024-04-26T12:35:29.240831+0000","last_fullsized":"2024-04-26T12:35:29.240831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240376+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:29.240376+0000","last_peered":"2024-04-26T12:35:29.240376+0000","last_clean":"2024-04-26T12:35:29.240376+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:29.240376+0000","last_undegraded":"2024-04-26T12:35:29.240376+0000","last_fullsized":"2024-04-26T12:35:29.240376+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226341+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:29.226341+0000","last_peered":"2024-04-26T12:35:29.226341+0000","last_clean":"2024-04-26T12:35:29.226341+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:29.226341+0000","last_undegraded":"2024-04-26T12:35:29.226341+0000","last_fullsized":"2024-04-26T12:35:29.226341+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.903377+0000","last_change":"2024-04-26T12:36:14.903484+0000","last_active":"2024-04-26T12:36:14.903377+0000","last_peered":"2024-04-26T12:36:14.903377+0000","last_clean":"2024-04-26T12:36:14.903377+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:36:14.903377+0000","last_undegraded":"2024-04-26T12:36:14.903377+0000","last_fullsized":"2024-04-26T12:36:14.903377+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.903354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:16.770079+0000","scrub_duration":0.0017945649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":95,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222103+0000","last_change":"2024-04-26T12:30:32.155466+0000","last_active":"2024-04-26T12:35:29.222103+0000","last_peered":"2024-04-26T12:35:29.222103+0000","last_clean":"2024-04-26T12:35:29.222103+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:35:29.222103+0000","last_undegraded":"2024-04-26T12:35:29.222103+0000","last_fullsized":"2024-04-26T12:35:29.222103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227067+0000","last_change":"2024-04-26T12:35:03.195042+0000","last_active":"2024-04-26T12:35:29.227067+0000","last_peered":"2024-04-26T12:35:29.227067+0000","last_clean":"2024-04-26T12:35:29.227067+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:35:29.227067+0000","last_undegraded":"2024-04-26T12:35:29.227067+0000","last_fullsized":"2024-04-26T12:35:29.227067+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240493+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:29.240493+0000","last_peered":"2024-04-26T12:35:29.240493+0000","last_clean":"2024-04-26T12:35:29.240493+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:29.240493+0000","last_undegraded":"2024-04-26T12:35:29.240493+0000","last_fullsized":"2024-04-26T12:35:29.240493+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":296,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239887+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:29.239887+0000","last_peered":"2024-04-26T12:35:29.239887+0000","last_clean":"2024-04-26T12:35:29.239887+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:29.239887+0000","last_undegraded":"2024-04-26T12:35:29.239887+0000","last_fullsized":"2024-04-26T12:35:29.239887+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.886236+0000","last_change":"2024-04-26T12:36:00.886361+0000","last_active":"2024-04-26T12:36:00.886236+0000","last_peered":"2024-04-26T12:36:00.886236+0000","last_clean":"2024-04-26T12:36:00.886236+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:36:00.886236+0000","last_undegraded":"2024-04-26T12:36:00.886236+0000","last_fullsized":"2024-04-26T12:36:00.886236+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.886200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.777562+0000","scrub_duration":0.0021566559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":84,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240750+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:29.240750+0000","last_peered":"2024-04-26T12:35:29.240750+0000","last_clean":"2024-04-26T12:35:29.240750+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:29.240750+0000","last_undegraded":"2024-04-26T12:35:29.240750+0000","last_fullsized":"2024-04-26T12:35:29.240750+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.239975+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:29.239975+0000","last_peered":"2024-04-26T12:35:29.239975+0000","last_clean":"2024-04-26T12:35:29.239975+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:29.239975+0000","last_undegraded":"2024-04-26T12:35:29.239975+0000","last_fullsized":"2024-04-26T12:35:29.239975+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.833477+0000","last_change":"2024-04-26T12:35:55.833616+0000","last_active":"2024-04-26T12:35:55.833477+0000","last_peered":"2024-04-26T12:35:55.833477+0000","last_clean":"2024-04-26T12:35:55.833477+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:55.833477+0000","last_undegraded":"2024-04-26T12:35:55.833477+0000","last_fullsized":"2024-04-26T12:35:55.833477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.833451+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:41.021792+0000","scrub_duration":0.003578328,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8090,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223077+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:29.223077+0000","last_peered":"2024-04-26T12:35:29.223077+0000","last_clean":"2024-04-26T12:35:29.223077+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:29.223077+0000","last_undegraded":"2024-04-26T12:35:29.223077+0000","last_fullsized":"2024-04-26T12:35:29.223077+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:43.256681+0000","last_change":"2024-04-26T12:35:43.256815+0000","last_active":"2024-04-26T12:35:43.256681+0000","last_peered":"2024-04-26T12:35:43.256681+0000","last_clean":"2024-04-26T12:35:43.256681+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:43.256681+0000","last_undegraded":"2024-04-26T12:35:43.256681+0000","last_fullsized":"2024-04-26T12:35:43.256681+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_clean_scrub_stamp":"2024-04-26T12:35:43.256655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:10.856381+0000","scrub_duration":0.001974197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.839712+0000","last_change":"2024-04-26T12:35:59.839864+0000","last_active":"2024-04-26T12:35:59.839712+0000","last_peered":"2024-04-26T12:35:59.839712+0000","last_clean":"2024-04-26T12:35:59.839712+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:59.839712+0000","last_undegraded":"2024-04-26T12:35:59.839712+0000","last_fullsized":"2024-04-26T12:35:59.839712+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.839691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:13.298302+0000","scrub_duration":0.0019804599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.150119+0000","last_change":"2024-04-26T12:35:55.150310+0000","last_active":"2024-04-26T12:35:55.150119+0000","last_peered":"2024-04-26T12:35:55.150119+0000","last_clean":"2024-04-26T12:35:55.150119+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:55.150119+0000","last_undegraded":"2024-04-26T12:35:55.150119+0000","last_fullsized":"2024-04-26T12:35:55.150119+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.150079+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.249254+0000","scrub_duration":0.011542274999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":77,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226935+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:29.226935+0000","last_peered":"2024-04-26T12:35:29.226935+0000","last_clean":"2024-04-26T12:35:29.226935+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:29.226935+0000","last_undegraded":"2024-04-26T12:35:29.226935+0000","last_fullsized":"2024-04-26T12:35:29.226935+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.880037+0000","last_change":"2024-04-26T12:35:49.880182+0000","last_active":"2024-04-26T12:35:49.880037+0000","last_peered":"2024-04-26T12:35:49.880037+0000","last_clean":"2024-04-26T12:35:49.880037+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:49.880037+0000","last_undegraded":"2024-04-26T12:35:49.880037+0000","last_fullsized":"2024-04-26T12:35:49.880037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.880012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.320847+0000","scrub_duration":0.0019327299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226034+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:29.226034+0000","last_peered":"2024-04-26T12:35:29.226034+0000","last_clean":"2024-04-26T12:35:29.226034+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:29.226034+0000","last_undegraded":"2024-04-26T12:35:29.226034+0000","last_fullsized":"2024-04-26T12:35:29.226034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240749+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:29.240749+0000","last_peered":"2024-04-26T12:35:29.240749+0000","last_clean":"2024-04-26T12:35:29.240749+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:29.240749+0000","last_undegraded":"2024-04-26T12:35:29.240749+0000","last_fullsized":"2024-04-26T12:35:29.240749+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"98'9","reported_seq":95,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:13.902533+0000","last_change":"2024-04-26T12:36:13.902674+0000","last_active":"2024-04-26T12:36:13.902533+0000","last_peered":"2024-04-26T12:36:13.902533+0000","last_clean":"2024-04-26T12:36:13.902533+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:36:13.902533+0000","last_undegraded":"2024-04-26T12:36:13.902533+0000","last_fullsized":"2024-04-26T12:36:13.902533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_deep_scrub":"98'9","last_deep_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_clean_scrub_stamp":"2024-04-26T12:36:13.902508+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:02.310643+0000","scrub_duration":0.0037104799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":99,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222677+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:29.222677+0000","last_peered":"2024-04-26T12:35:29.222677+0000","last_clean":"2024-04-26T12:35:29.222677+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:29.222677+0000","last_undegraded":"2024-04-26T12:35:29.222677+0000","last_fullsized":"2024-04-26T12:35:29.222677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":60,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222563+0000","last_change":"2024-04-26T12:35:26.164494+0000","last_active":"2024-04-26T12:35:29.222563+0000","last_peered":"2024-04-26T12:35:29.222563+0000","last_clean":"2024-04-26T12:35:29.222563+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:35:29.222563+0000","last_undegraded":"2024-04-26T12:35:29.222563+0000","last_fullsized":"2024-04-26T12:35:29.222563+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2132,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.254488+0000","last_change":"2024-04-26T12:36:09.254596+0000","last_active":"2024-04-26T12:36:09.254488+0000","last_peered":"2024-04-26T12:36:09.254488+0000","last_clean":"2024-04-26T12:36:09.254488+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:36:09.254488+0000","last_undegraded":"2024-04-26T12:36:09.254488+0000","last_fullsized":"2024-04-26T12:36:09.254488+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2049","last_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_deep_scrub":"80'2049","last_deep_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.254461+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:25.158195+0000","scrub_duration":0.0084966799999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"98'3","reported_seq":124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:06.029049+0000","last_change":"2024-04-26T12:36:06.029182+0000","last_active":"2024-04-26T12:36:06.029049+0000","last_peered":"2024-04-26T12:36:06.029049+0000","last_clean":"2024-04-26T12:36:06.029049+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:36:06.029049+0000","last_undegraded":"2024-04-26T12:36:06.029049+0000","last_fullsized":"2024-04-26T12:36:06.029049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_clean_scrub_stamp":"2024-04-26T12:36:06.029025+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:17.682144+0000","scrub_duration":0.0034148149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2159,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103373+0000","last_change":"2024-04-26T12:35:05.900555+0000","last_active":"2024-04-26T12:35:35.103373+0000","last_peered":"2024-04-26T12:35:35.103373+0000","last_clean":"2024-04-26T12:35:35.103373+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:35:35.103373+0000","last_undegraded":"2024-04-26T12:35:35.103373+0000","last_fullsized":"2024-04-26T12:35:35.103373+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223153+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:29.223153+0000","last_peered":"2024-04-26T12:35:29.223153+0000","last_clean":"2024-04-26T12:35:29.223153+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:29.223153+0000","last_undegraded":"2024-04-26T12:35:29.223153+0000","last_fullsized":"2024-04-26T12:35:29.223153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":127,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:41.966293+0000","last_change":"2024-04-26T12:35:41.966428+0000","last_active":"2024-04-26T12:35:41.966293+0000","last_peered":"2024-04-26T12:35:41.966293+0000","last_clean":"2024-04-26T12:35:41.966293+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:41.966293+0000","last_undegraded":"2024-04-26T12:35:41.966293+0000","last_fullsized":"2024-04-26T12:35:41.966293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7","last_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_deep_scrub":"80'7","last_deep_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_clean_scrub_stamp":"2024-04-26T12:35:41.966266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:47.286627+0000","scrub_duration":0.011530692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":87,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:50.849528+0000","last_change":"2024-04-26T12:35:50.849631+0000","last_active":"2024-04-26T12:35:50.849528+0000","last_peered":"2024-04-26T12:35:50.849528+0000","last_clean":"2024-04-26T12:35:50.849528+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:50.849528+0000","last_undegraded":"2024-04-26T12:35:50.849528+0000","last_fullsized":"2024-04-26T12:35:50.849528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_clean_scrub_stamp":"2024-04-26T12:35:50.849501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:53.832051+0000","scrub_duration":0.002006037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4192,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.266881+0000","last_change":"2024-04-26T12:36:07.266994+0000","last_active":"2024-04-26T12:36:07.266881+0000","last_peered":"2024-04-26T12:36:07.266881+0000","last_clean":"2024-04-26T12:36:07.266881+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:36:07.266881+0000","last_undegraded":"2024-04-26T12:36:07.266881+0000","last_fullsized":"2024-04-26T12:36:07.266881+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4070","last_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_deep_scrub":"80'4070","last_deep_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.266853+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:12.587214+0000","scrub_duration":0.013959829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"98'6","reported_seq":92,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:08.980159+0000","last_change":"2024-04-26T12:36:08.980266+0000","last_active":"2024-04-26T12:36:08.980159+0000","last_peered":"2024-04-26T12:36:08.980159+0000","last_clean":"2024-04-26T12:36:08.980159+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:36:08.980159+0000","last_undegraded":"2024-04-26T12:36:08.980159+0000","last_fullsized":"2024-04-26T12:36:08.980159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_clean_scrub_stamp":"2024-04-26T12:36:08.980132+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:12.661795+0000","scrub_duration":0.0093908959999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2166,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222234+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:29.222234+0000","last_peered":"2024-04-26T12:35:29.222234+0000","last_clean":"2024-04-26T12:35:29.222234+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:29.222234+0000","last_undegraded":"2024-04-26T12:35:29.222234+0000","last_fullsized":"2024-04-26T12:35:29.222234+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":129,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:12.000137+0000","last_change":"2024-04-26T12:36:12.000253+0000","last_active":"2024-04-26T12:36:12.000137+0000","last_peered":"2024-04-26T12:36:12.000137+0000","last_clean":"2024-04-26T12:36:12.000137+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:36:12.000137+0000","last_undegraded":"2024-04-26T12:36:12.000137+0000","last_fullsized":"2024-04-26T12:36:12.000137+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_clean_scrub_stamp":"2024-04-26T12:36:12.000111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:02.393567+0000","scrub_duration":0.017651467000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.855421+0000","last_change":"2024-04-26T12:35:56.855547+0000","last_active":"2024-04-26T12:35:56.855421+0000","last_peered":"2024-04-26T12:35:56.855421+0000","last_clean":"2024-04-26T12:35:56.855421+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:56.855421+0000","last_undegraded":"2024-04-26T12:35:56.855421+0000","last_fullsized":"2024-04-26T12:35:56.855421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.855396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:59.203820+0000","scrub_duration":0.0078982099999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2028,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222691+0000","last_change":"2024-04-26T12:35:26.169463+0000","last_active":"2024-04-26T12:35:29.222691+0000","last_peered":"2024-04-26T12:35:29.222691+0000","last_clean":"2024-04-26T12:35:29.222691+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:35:29.222691+0000","last_undegraded":"2024-04-26T12:35:29.222691+0000","last_fullsized":"2024-04-26T12:35:29.222691+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2133,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226589+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:29.226589+0000","last_peered":"2024-04-26T12:35:29.226589+0000","last_clean":"2024-04-26T12:35:29.226589+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:29.226589+0000","last_undegraded":"2024-04-26T12:35:29.226589+0000","last_fullsized":"2024-04-26T12:35:29.226589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2138,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222723+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:29.222723+0000","last_peered":"2024-04-26T12:35:29.222723+0000","last_clean":"2024-04-26T12:35:29.222723+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:29.222723+0000","last_undegraded":"2024-04-26T12:35:29.222723+0000","last_fullsized":"2024-04-26T12:35:29.222723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142980,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228860,"statfs":{"total":96636764160,"available":95466352640,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:36:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:35:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42299999999999999,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.63200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42399999999999999,"15min":0.442},"min":{"1min":0.34999999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.57699999999999996}]}]},{"osd":0,"up_from":85,"seq":365072220177,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52660,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319180,"statfs":{"total":96636764160,"available":96582840320,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:36:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:36:02 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.45300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738442,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860676,"statfs":{"total":96636764160,"available":95089332224,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:36:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:35:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.42099999999999999,"15min":0.441},"min":{"1min":0.40699999999999997,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.36899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.64000000000000001,"5min":1.137,"15min":1.137},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:36:18.970 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.970 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.970 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.970 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.971 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.971 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.971 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.971 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.971 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.971 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.971 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.971 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.971 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.972 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.972 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.972 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.972 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.972 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.972 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.972 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.972 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.972 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.973 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.973 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.973 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.973 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.973 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.973 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.973 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.973 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.974 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.974 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.974 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.974 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.974 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.974 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.974 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.974 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.975 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.975 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.975 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.975 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.975 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.976 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.976 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.976 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.976 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.977 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.977 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.977 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.977 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.977 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.977 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.977 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.978 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.978 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.978 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.978 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.978 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.978 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.978 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.978 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.979 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.979 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:18.979 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:36:38.980 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:36:39.365 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:36:39.367 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:36:39.378 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-04-26T12:36:39.067677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119329,"ondisk_log_size":119329,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706804,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408716,"statfs":{"total":289910292480,"available":287138525184,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003053"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2084,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222887+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:29.222887+0000","last_peered":"2024-04-26T12:35:29.222887+0000","last_clean":"2024-04-26T12:35:29.222887+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:29.222887+0000","last_undegraded":"2024-04-26T12:35:29.222887+0000","last_fullsized":"2024-04-26T12:35:29.222887+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":99,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:52.167121+0000","last_change":"2024-04-26T12:35:52.167251+0000","last_active":"2024-04-26T12:35:52.167121+0000","last_peered":"2024-04-26T12:35:52.167121+0000","last_clean":"2024-04-26T12:35:52.167121+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:52.167121+0000","last_undegraded":"2024-04-26T12:35:52.167121+0000","last_fullsized":"2024-04-26T12:35:52.167121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_clean_scrub_stamp":"2024-04-26T12:35:52.167078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.351227+0000","scrub_duration":0.0068001590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4143,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:45.987721+0000","last_change":"2024-04-26T12:35:45.987903+0000","last_active":"2024-04-26T12:35:45.987721+0000","last_peered":"2024-04-26T12:35:45.987721+0000","last_clean":"2024-04-26T12:35:45.987721+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:45.987721+0000","last_undegraded":"2024-04-26T12:35:45.987721+0000","last_fullsized":"2024-04-26T12:35:45.987721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4036","last_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_deep_scrub":"80'4036","last_deep_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_clean_scrub_stamp":"2024-04-26T12:35:45.987680+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:57.838823+0000","scrub_duration":0.014722818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":129,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:51.983250+0000","last_change":"2024-04-26T12:35:51.983250+0000","last_active":"2024-04-26T12:35:51.983250+0000","last_peered":"2024-04-26T12:35:51.983250+0000","last_clean":"2024-04-26T12:35:51.983250+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:51.983250+0000","last_undegraded":"2024-04-26T12:35:51.983250+0000","last_fullsized":"2024-04-26T12:35:51.983250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_clean_scrub_stamp":"2024-04-26T12:35:51.983105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:34.627140+0000","scrub_duration":0.0030895979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2167,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:24.326520+0000","last_change":"2024-04-26T12:36:24.326642+0000","last_active":"2024-04-26T12:36:24.326520+0000","last_peered":"2024-04-26T12:36:24.326520+0000","last_clean":"2024-04-26T12:36:24.326520+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:36:24.326520+0000","last_undegraded":"2024-04-26T12:36:24.326520+0000","last_fullsized":"2024-04-26T12:36:24.326520+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2045","last_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_deep_scrub":"80'2045","last_deep_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_clean_scrub_stamp":"2024-04-26T12:36:24.326492+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:11.354437+0000","scrub_duration":0.011899834999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103322+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:35.103322+0000","last_peered":"2024-04-26T12:35:35.103322+0000","last_clean":"2024-04-26T12:35:35.103322+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:35.103322+0000","last_undegraded":"2024-04-26T12:35:35.103322+0000","last_fullsized":"2024-04-26T12:35:35.103322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":60,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103311+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:35.103311+0000","last_peered":"2024-04-26T12:35:35.103311+0000","last_clean":"2024-04-26T12:35:35.103311+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:35.103311+0000","last_undegraded":"2024-04-26T12:35:35.103311+0000","last_fullsized":"2024-04-26T12:35:35.103311+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8217,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.006065+0000","last_change":"2024-04-26T12:35:38.006208+0000","last_active":"2024-04-26T12:35:38.006065+0000","last_peered":"2024-04-26T12:35:38.006065+0000","last_clean":"2024-04-26T12:35:38.006065+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:38.006065+0000","last_undegraded":"2024-04-26T12:35:38.006065+0000","last_fullsized":"2024-04-26T12:35:38.006065+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8077","last_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_deep_scrub":"80'8077","last_deep_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.006040+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:57.036646+0000","scrub_duration":0.014128129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6180,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227277+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:29.227277+0000","last_peered":"2024-04-26T12:35:29.227277+0000","last_clean":"2024-04-26T12:35:29.227277+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:29.227277+0000","last_undegraded":"2024-04-26T12:35:29.227277+0000","last_fullsized":"2024-04-26T12:35:29.227277+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6252,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.280808+0000","last_change":"2024-04-26T12:35:49.280948+0000","last_active":"2024-04-26T12:35:49.280808+0000","last_peered":"2024-04-26T12:35:49.280808+0000","last_clean":"2024-04-26T12:35:49.280808+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:49.280808+0000","last_undegraded":"2024-04-26T12:35:49.280808+0000","last_fullsized":"2024-04-26T12:35:49.280808+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6120","last_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_deep_scrub":"80'6120","last_deep_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.280781+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:12.424132+0000","scrub_duration":0.01226383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4080,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102734+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:30.102734+0000","last_peered":"2024-04-26T12:35:30.102734+0000","last_clean":"2024-04-26T12:35:30.102734+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:30.102734+0000","last_undegraded":"2024-04-26T12:35:30.102734+0000","last_fullsized":"2024-04-26T12:35:30.102734+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.138480+0000","last_change":"2024-04-26T12:35:56.138597+0000","last_active":"2024-04-26T12:35:56.138480+0000","last_peered":"2024-04-26T12:35:56.138480+0000","last_clean":"2024-04-26T12:35:56.138480+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:56.138480+0000","last_undegraded":"2024-04-26T12:35:56.138480+0000","last_fullsized":"2024-04-26T12:35:56.138480+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2051","last_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_deep_scrub":"80'2051","last_deep_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.138454+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:03.549045+0000","scrub_duration":0.011597293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2150,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.311288+0000","last_change":"2024-04-26T12:36:29.311400+0000","last_active":"2024-04-26T12:36:29.311288+0000","last_peered":"2024-04-26T12:36:29.311288+0000","last_clean":"2024-04-26T12:36:29.311288+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:36:29.311288+0000","last_undegraded":"2024-04-26T12:36:29.311288+0000","last_fullsized":"2024-04-26T12:36:29.311288+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2026","last_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_deep_scrub":"80'2026","last_deep_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.311261+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:55.733965+0000","scrub_duration":0.0058874599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2159,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:57.048226+0000","last_change":"2024-04-26T12:35:57.048340+0000","last_active":"2024-04-26T12:35:57.048226+0000","last_peered":"2024-04-26T12:35:57.048226+0000","last_clean":"2024-04-26T12:35:57.048226+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:57.048226+0000","last_undegraded":"2024-04-26T12:35:57.048226+0000","last_fullsized":"2024-04-26T12:35:57.048226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2052","last_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_deep_scrub":"80'2052","last_deep_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_clean_scrub_stamp":"2024-04-26T12:35:57.048199+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:27.456428+0000","scrub_duration":0.016047618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2178,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:01.108264+0000","last_change":"2024-04-26T12:36:01.108416+0000","last_active":"2024-04-26T12:36:01.108264+0000","last_peered":"2024-04-26T12:36:01.108264+0000","last_clean":"2024-04-26T12:36:01.108264+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:36:01.108264+0000","last_undegraded":"2024-04-26T12:36:01.108264+0000","last_fullsized":"2024-04-26T12:36:01.108264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2071","last_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_deep_scrub":"80'2071","last_deep_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_clean_scrub_stamp":"2024-04-26T12:36:01.108240+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:16.539046+0000","scrub_duration":0.014518568000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102574+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:30.102574+0000","last_peered":"2024-04-26T12:35:30.102574+0000","last_clean":"2024-04-26T12:35:30.102574+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:30.102574+0000","last_undegraded":"2024-04-26T12:35:30.102574+0000","last_fullsized":"2024-04-26T12:35:30.102574+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2119,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227235+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:29.227235+0000","last_peered":"2024-04-26T12:35:29.227235+0000","last_clean":"2024-04-26T12:35:29.227235+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:29.227235+0000","last_undegraded":"2024-04-26T12:35:29.227235+0000","last_fullsized":"2024-04-26T12:35:29.227235+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223130+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:29.223130+0000","last_peered":"2024-04-26T12:35:29.223130+0000","last_clean":"2024-04-26T12:35:29.223130+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:29.223130+0000","last_undegraded":"2024-04-26T12:35:29.223130+0000","last_fullsized":"2024-04-26T12:35:29.223130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4099,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226842+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:29.226842+0000","last_peered":"2024-04-26T12:35:29.226842+0000","last_clean":"2024-04-26T12:35:29.226842+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:29.226842+0000","last_undegraded":"2024-04-26T12:35:29.226842+0000","last_fullsized":"2024-04-26T12:35:29.226842+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4234,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:16.031374+0000","last_change":"2024-04-26T12:36:16.031481+0000","last_active":"2024-04-26T12:36:16.031374+0000","last_peered":"2024-04-26T12:36:16.031374+0000","last_clean":"2024-04-26T12:36:16.031374+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:36:16.031374+0000","last_undegraded":"2024-04-26T12:36:16.031374+0000","last_fullsized":"2024-04-26T12:36:16.031374+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4103","last_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_deep_scrub":"80'4103","last_deep_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_clean_scrub_stamp":"2024-04-26T12:36:16.031346+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:35.734914+0000","scrub_duration":0.0054779479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":120,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240259+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:29.240259+0000","last_peered":"2024-04-26T12:35:29.240259+0000","last_clean":"2024-04-26T12:35:29.240259+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:29.240259+0000","last_undegraded":"2024-04-26T12:35:29.240259+0000","last_fullsized":"2024-04-26T12:35:29.240259+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2117,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222173+0000","last_change":"2024-04-26T12:30:32.614092+0000","last_active":"2024-04-26T12:35:29.222173+0000","last_peered":"2024-04-26T12:35:29.222173+0000","last_clean":"2024-04-26T12:35:29.222173+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:35:29.222173+0000","last_undegraded":"2024-04-26T12:35:29.222173+0000","last_fullsized":"2024-04-26T12:35:29.222173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226240+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:29.226240+0000","last_peered":"2024-04-26T12:35:29.226240+0000","last_clean":"2024-04-26T12:35:29.226240+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:29.226240+0000","last_undegraded":"2024-04-26T12:35:29.226240+0000","last_fullsized":"2024-04-26T12:35:29.226240+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4151,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:03.188978+0000","last_change":"2024-04-26T12:36:03.189097+0000","last_active":"2024-04-26T12:36:03.188978+0000","last_peered":"2024-04-26T12:36:03.188978+0000","last_clean":"2024-04-26T12:36:03.188978+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:36:03.188978+0000","last_undegraded":"2024-04-26T12:36:03.188978+0000","last_fullsized":"2024-04-26T12:36:03.188978+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4067","last_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_deep_scrub":"80'4067","last_deep_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_clean_scrub_stamp":"2024-04-26T12:36:03.188951+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:22.219557+0000","scrub_duration":0.013814754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2153,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.127431+0000","last_change":"2024-04-26T12:35:59.127545+0000","last_active":"2024-04-26T12:35:59.127431+0000","last_peered":"2024-04-26T12:35:59.127431+0000","last_clean":"2024-04-26T12:35:59.127431+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:59.127431+0000","last_undegraded":"2024-04-26T12:35:59.127431+0000","last_fullsized":"2024-04-26T12:35:59.127431+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2053","last_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_deep_scrub":"80'2053","last_deep_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.127404+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:55.177992+0000","scrub_duration":0.018465079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.893685+0000","last_change":"2024-04-26T12:36:17.893816+0000","last_active":"2024-04-26T12:36:17.893685+0000","last_peered":"2024-04-26T12:36:17.893685+0000","last_clean":"2024-04-26T12:36:17.893685+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:36:17.893685+0000","last_undegraded":"2024-04-26T12:36:17.893685+0000","last_fullsized":"2024-04-26T12:36:17.893685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.893660+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:02.255600+0000","scrub_duration":0.0081512219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.999615+0000","last_change":"2024-04-26T12:35:49.999776+0000","last_active":"2024-04-26T12:35:49.999615+0000","last_peered":"2024-04-26T12:35:49.999615+0000","last_clean":"2024-04-26T12:35:49.999615+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:49.999615+0000","last_undegraded":"2024-04-26T12:35:49.999615+0000","last_fullsized":"2024-04-26T12:35:49.999615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2006","last_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_deep_scrub":"80'2006","last_deep_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.999571+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:58.313518+0000","scrub_duration":0.012700795000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.163624+0000","last_change":"2024-04-26T12:35:26.165397+0000","last_active":"2024-04-26T12:35:35.163624+0000","last_peered":"2024-04-26T12:35:35.163624+0000","last_clean":"2024-04-26T12:35:35.163624+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:35:35.163624+0000","last_undegraded":"2024-04-26T12:35:35.163624+0000","last_fullsized":"2024-04-26T12:35:35.163624+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.161522+0000","last_change":"2024-04-26T12:35:38.161638+0000","last_active":"2024-04-26T12:35:38.161522+0000","last_peered":"2024-04-26T12:35:38.161522+0000","last_clean":"2024-04-26T12:35:38.161522+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:38.161522+0000","last_undegraded":"2024-04-26T12:35:38.161522+0000","last_fullsized":"2024-04-26T12:35:38.161522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.161494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:19.249824+0000","scrub_duration":0.014847795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:35.181585+0000","last_change":"2024-04-26T12:36:35.181718+0000","last_active":"2024-04-26T12:36:35.181585+0000","last_peered":"2024-04-26T12:36:35.181585+0000","last_clean":"2024-04-26T12:36:35.181585+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:36:35.181585+0000","last_undegraded":"2024-04-26T12:36:35.181585+0000","last_fullsized":"2024-04-26T12:36:35.181585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_clean_scrub_stamp":"2024-04-26T12:36:35.181561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:15.742099+0000","scrub_duration":0.0020050630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.946133+0000","last_change":"2024-04-26T12:36:07.946252+0000","last_active":"2024-04-26T12:36:07.946133+0000","last_peered":"2024-04-26T12:36:07.946133+0000","last_clean":"2024-04-26T12:36:07.946133+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:36:07.946133+0000","last_undegraded":"2024-04-26T12:36:07.946133+0000","last_fullsized":"2024-04-26T12:36:07.946133+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.946106+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:15.251311+0000","scrub_duration":0.0085133599999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:30.077762+0000","last_change":"2024-04-26T12:36:30.077900+0000","last_active":"2024-04-26T12:36:30.077762+0000","last_peered":"2024-04-26T12:36:30.077762+0000","last_clean":"2024-04-26T12:36:30.077762+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:36:30.077762+0000","last_undegraded":"2024-04-26T12:36:30.077762+0000","last_fullsized":"2024-04-26T12:36:30.077762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_clean_scrub_stamp":"2024-04-26T12:36:30.077735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:09.005584+0000","scrub_duration":0.0019678730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223197+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:29.223197+0000","last_peered":"2024-04-26T12:35:29.223197+0000","last_clean":"2024-04-26T12:35:29.223197+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:29.223197+0000","last_undegraded":"2024-04-26T12:35:29.223197+0000","last_fullsized":"2024-04-26T12:35:29.223197+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227029+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:29.227029+0000","last_peered":"2024-04-26T12:35:29.227029+0000","last_clean":"2024-04-26T12:35:29.227029+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:29.227029+0000","last_undegraded":"2024-04-26T12:35:29.227029+0000","last_fullsized":"2024-04-26T12:35:29.227029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:46.789110+0000","last_change":"2024-04-26T12:35:46.789233+0000","last_active":"2024-04-26T12:35:46.789110+0000","last_peered":"2024-04-26T12:35:46.789110+0000","last_clean":"2024-04-26T12:35:46.789110+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:46.789110+0000","last_undegraded":"2024-04-26T12:35:46.789110+0000","last_fullsized":"2024-04-26T12:35:46.789110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_clean_scrub_stamp":"2024-04-26T12:35:46.789065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:51.542684+0000","scrub_duration":0.010829827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102784+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:30.102784+0000","last_peered":"2024-04-26T12:35:30.102784+0000","last_clean":"2024-04-26T12:35:30.102784+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:30.102784+0000","last_undegraded":"2024-04-26T12:35:30.102784+0000","last_fullsized":"2024-04-26T12:35:30.102784+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226290+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:29.226290+0000","last_peered":"2024-04-26T12:35:29.226290+0000","last_clean":"2024-04-26T12:35:29.226290+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:29.226290+0000","last_undegraded":"2024-04-26T12:35:29.226290+0000","last_fullsized":"2024-04-26T12:35:29.226290+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223086+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:29.223086+0000","last_peered":"2024-04-26T12:35:29.223086+0000","last_clean":"2024-04-26T12:35:29.223086+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:29.223086+0000","last_undegraded":"2024-04-26T12:35:29.223086+0000","last_fullsized":"2024-04-26T12:35:29.223086+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:42.691761+0000","last_change":"2024-04-26T12:35:42.691943+0000","last_active":"2024-04-26T12:35:42.691761+0000","last_peered":"2024-04-26T12:35:42.691761+0000","last_clean":"2024-04-26T12:35:42.691761+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:42.691761+0000","last_undegraded":"2024-04-26T12:35:42.691761+0000","last_fullsized":"2024-04-26T12:35:42.691761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4058","last_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_deep_scrub":"80'4058","last_deep_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_clean_scrub_stamp":"2024-04-26T12:35:42.691721+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:59.851784+0000","scrub_duration":0.010224120999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"81'96","reported_seq":193,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240550+0000","last_change":"2024-04-26T12:30:32.159065+0000","last_active":"2024-04-26T12:35:29.240550+0000","last_peered":"2024-04-26T12:35:29.240550+0000","last_clean":"2024-04-26T12:35:29.240550+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:35:29.240550+0000","last_undegraded":"2024-04-26T12:35:29.240550+0000","last_fullsized":"2024-04-26T12:35:29.240550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4201,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.099299+0000","last_change":"2024-04-26T12:35:59.099460+0000","last_active":"2024-04-26T12:35:59.099299+0000","last_peered":"2024-04-26T12:35:59.099299+0000","last_clean":"2024-04-26T12:35:59.099299+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:59.099299+0000","last_undegraded":"2024-04-26T12:35:59.099299+0000","last_fullsized":"2024-04-26T12:35:59.099299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4094","last_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_deep_scrub":"80'4094","last_deep_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.099256+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:46.127201+0000","scrub_duration":0.013902207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"98'4","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:10.954307+0000","last_change":"2024-04-26T12:36:10.954415+0000","last_active":"2024-04-26T12:36:10.954307+0000","last_peered":"2024-04-26T12:36:10.954307+0000","last_clean":"2024-04-26T12:36:10.954307+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:36:10.954307+0000","last_undegraded":"2024-04-26T12:36:10.954307+0000","last_fullsized":"2024-04-26T12:36:10.954307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_clean_scrub_stamp":"2024-04-26T12:36:10.954281+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:30.939529+0000","scrub_duration":0.0038576499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2093,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.082461+0000","last_change":"2024-04-26T12:36:00.082579+0000","last_active":"2024-04-26T12:36:00.082461+0000","last_peered":"2024-04-26T12:36:00.082461+0000","last_clean":"2024-04-26T12:36:00.082461+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:36:00.082461+0000","last_undegraded":"2024-04-26T12:36:00.082461+0000","last_fullsized":"2024-04-26T12:36:00.082461+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1968","last_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_deep_scrub":"80'1968","last_deep_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.082433+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.908109+0000","scrub_duration":0.011161457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226184+0000","last_change":"2024-04-26T12:35:03.177706+0000","last_active":"2024-04-26T12:35:29.226184+0000","last_peered":"2024-04-26T12:35:29.226184+0000","last_clean":"2024-04-26T12:35:29.226184+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:35:29.226184+0000","last_undegraded":"2024-04-26T12:35:29.226184+0000","last_fullsized":"2024-04-26T12:35:29.226184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223191+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:29.223191+0000","last_peered":"2024-04-26T12:35:29.223191+0000","last_clean":"2024-04-26T12:35:29.223191+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:29.223191+0000","last_undegraded":"2024-04-26T12:35:29.223191+0000","last_fullsized":"2024-04-26T12:35:29.223191+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.344225+0000","last_change":"2024-04-26T12:36:17.344357+0000","last_active":"2024-04-26T12:36:17.344225+0000","last_peered":"2024-04-26T12:36:17.344225+0000","last_clean":"2024-04-26T12:36:17.344225+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:36:17.344225+0000","last_undegraded":"2024-04-26T12:36:17.344225+0000","last_fullsized":"2024-04-26T12:36:17.344225+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.344200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:59.988235+0000","scrub_duration":0.0016444610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:23.003025+0000","last_change":"2024-04-26T12:36:23.003182+0000","last_active":"2024-04-26T12:36:23.003025+0000","last_peered":"2024-04-26T12:36:23.003025+0000","last_clean":"2024-04-26T12:36:23.003025+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:36:23.003025+0000","last_undegraded":"2024-04-26T12:36:23.003025+0000","last_fullsized":"2024-04-26T12:36:23.003025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_clean_scrub_stamp":"2024-04-26T12:36:23.002980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:24.050905+0000","scrub_duration":0.008324517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":106,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240129+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:29.240129+0000","last_peered":"2024-04-26T12:35:29.240129+0000","last_clean":"2024-04-26T12:35:29.240129+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:29.240129+0000","last_undegraded":"2024-04-26T12:35:29.240129+0000","last_fullsized":"2024-04-26T12:35:29.240129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227218+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:29.227218+0000","last_peered":"2024-04-26T12:35:29.227218+0000","last_clean":"2024-04-26T12:35:29.227218+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:29.227218+0000","last_undegraded":"2024-04-26T12:35:29.227218+0000","last_fullsized":"2024-04-26T12:35:29.227218+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"98'2","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:34.866882+0000","last_change":"2024-04-26T12:36:34.867018+0000","last_active":"2024-04-26T12:36:34.866882+0000","last_peered":"2024-04-26T12:36:34.866882+0000","last_clean":"2024-04-26T12:36:34.866882+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:36:34.866882+0000","last_undegraded":"2024-04-26T12:36:34.866882+0000","last_fullsized":"2024-04-26T12:36:34.866882+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_clean_scrub_stamp":"2024-04-26T12:36:34.866855+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:44.780097+0000","scrub_duration":0.0056431429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2096,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222476+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:29.222476+0000","last_peered":"2024-04-26T12:35:29.222476+0000","last_clean":"2024-04-26T12:35:29.222476+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:29.222476+0000","last_undegraded":"2024-04-26T12:35:29.222476+0000","last_fullsized":"2024-04-26T12:35:29.222476+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222921+0000","last_change":"2024-04-26T12:30:32.155683+0000","last_active":"2024-04-26T12:35:29.222921+0000","last_peered":"2024-04-26T12:35:29.222921+0000","last_clean":"2024-04-26T12:35:29.222921+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:35:29.222921+0000","last_undegraded":"2024-04-26T12:35:29.222921+0000","last_fullsized":"2024-04-26T12:35:29.222921+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:40.208916+0000","last_change":"2024-04-26T12:35:40.209064+0000","last_active":"2024-04-26T12:35:40.208916+0000","last_peered":"2024-04-26T12:35:40.208916+0000","last_clean":"2024-04-26T12:35:40.208916+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:40.208916+0000","last_undegraded":"2024-04-26T12:35:40.208916+0000","last_fullsized":"2024-04-26T12:35:40.208916+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_clean_scrub_stamp":"2024-04-26T12:35:40.208887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:37.520324+0000","scrub_duration":0.016687707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":31,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102753+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:30.102753+0000","last_peered":"2024-04-26T12:35:30.102753+0000","last_clean":"2024-04-26T12:35:30.102753+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:30.102753+0000","last_undegraded":"2024-04-26T12:35:30.102753+0000","last_fullsized":"2024-04-26T12:35:30.102753+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240669+0000","last_change":"2024-04-26T12:35:05.900420+0000","last_active":"2024-04-26T12:35:29.240669+0000","last_peered":"2024-04-26T12:35:29.240669+0000","last_clean":"2024-04-26T12:35:29.240669+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:35:29.240669+0000","last_undegraded":"2024-04-26T12:35:29.240669+0000","last_fullsized":"2024-04-26T12:35:29.240669+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":121,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.982136+0000","last_change":"2024-04-26T12:36:14.982242+0000","last_active":"2024-04-26T12:36:14.982136+0000","last_peered":"2024-04-26T12:36:14.982136+0000","last_clean":"2024-04-26T12:36:14.982136+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:36:14.982136+0000","last_undegraded":"2024-04-26T12:36:14.982136+0000","last_fullsized":"2024-04-26T12:36:14.982136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.982103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.704809+0000","scrub_duration":0.0018977480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:20.998383+0000","last_change":"2024-04-26T12:36:20.998503+0000","last_active":"2024-04-26T12:36:20.998383+0000","last_peered":"2024-04-26T12:36:20.998383+0000","last_clean":"2024-04-26T12:36:20.998383+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:36:20.998383+0000","last_undegraded":"2024-04-26T12:36:20.998383+0000","last_fullsized":"2024-04-26T12:36:20.998383+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_clean_scrub_stamp":"2024-04-26T12:36:20.998357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.004150+0000","scrub_duration":0.0052206129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"79'3","reported_seq":77,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226393+0000","last_change":"2024-04-26T12:35:03.161005+0000","last_active":"2024-04-26T12:35:29.226393+0000","last_peered":"2024-04-26T12:35:29.226393+0000","last_clean":"2024-04-26T12:35:29.226393+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:35:29.226393+0000","last_undegraded":"2024-04-26T12:35:29.226393+0000","last_fullsized":"2024-04-26T12:35:29.226393+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.017218+0000","last_change":"2024-04-26T12:35:56.017326+0000","last_active":"2024-04-26T12:35:56.017218+0000","last_peered":"2024-04-26T12:35:56.017218+0000","last_clean":"2024-04-26T12:35:56.017218+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:56.017218+0000","last_undegraded":"2024-04-26T12:35:56.017218+0000","last_fullsized":"2024-04-26T12:35:56.017218+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1980","last_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_deep_scrub":"80'1980","last_deep_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.017191+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:19.910231+0000","scrub_duration":0.0081651450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240317+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:29.240317+0000","last_peered":"2024-04-26T12:35:29.240317+0000","last_clean":"2024-04-26T12:35:29.240317+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:29.240317+0000","last_undegraded":"2024-04-26T12:35:29.240317+0000","last_fullsized":"2024-04-26T12:35:29.240317+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2146,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:04.058960+0000","last_change":"2024-04-26T12:36:04.059101+0000","last_active":"2024-04-26T12:36:04.058960+0000","last_peered":"2024-04-26T12:36:04.058960+0000","last_clean":"2024-04-26T12:36:04.058960+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:36:04.058960+0000","last_undegraded":"2024-04-26T12:36:04.058960+0000","last_fullsized":"2024-04-26T12:36:04.058960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2039","last_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_deep_scrub":"80'2039","last_deep_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_clean_scrub_stamp":"2024-04-26T12:36:04.058924+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:30.481629+0000","scrub_duration":0.012146647999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":59,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222113+0000","last_change":"2024-04-26T12:35:26.161621+0000","last_active":"2024-04-26T12:35:29.222113+0000","last_peered":"2024-04-26T12:35:29.222113+0000","last_clean":"2024-04-26T12:35:29.222113+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:35:29.222113+0000","last_undegraded":"2024-04-26T12:35:29.222113+0000","last_fullsized":"2024-04-26T12:35:29.222113+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.984844+0000","last_change":"2024-04-26T12:36:09.984957+0000","last_active":"2024-04-26T12:36:09.984844+0000","last_peered":"2024-04-26T12:36:09.984844+0000","last_clean":"2024-04-26T12:36:09.984844+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:36:09.984844+0000","last_undegraded":"2024-04-26T12:36:09.984844+0000","last_fullsized":"2024-04-26T12:36:09.984844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2065","last_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_deep_scrub":"80'2065","last_deep_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.984820+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:04.882200+0000","scrub_duration":0.013017881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":96,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.285614+0000","last_change":"2024-04-26T12:36:14.285733+0000","last_active":"2024-04-26T12:36:14.285614+0000","last_peered":"2024-04-26T12:36:14.285614+0000","last_clean":"2024-04-26T12:36:14.285614+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:36:14.285614+0000","last_undegraded":"2024-04-26T12:36:14.285614+0000","last_fullsized":"2024-04-26T12:36:14.285614+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.285570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:22.599518+0000","scrub_duration":0.0020305150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227148+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:29.227148+0000","last_peered":"2024-04-26T12:35:29.227148+0000","last_clean":"2024-04-26T12:35:29.227148+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:29.227148+0000","last_undegraded":"2024-04-26T12:35:29.227148+0000","last_fullsized":"2024-04-26T12:35:29.227148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:54.828629+0000","last_change":"2024-04-26T12:35:54.828732+0000","last_active":"2024-04-26T12:35:54.828629+0000","last_peered":"2024-04-26T12:35:54.828629+0000","last_clean":"2024-04-26T12:35:54.828629+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:54.828629+0000","last_undegraded":"2024-04-26T12:35:54.828629+0000","last_fullsized":"2024-04-26T12:35:54.828629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_clean_scrub_stamp":"2024-04-26T12:35:54.828605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:29.226278+0000","scrub_duration":0.001515267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":121,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.033644+0000","last_change":"2024-04-26T12:36:22.033778+0000","last_active":"2024-04-26T12:36:22.033644+0000","last_peered":"2024-04-26T12:36:22.033644+0000","last_clean":"2024-04-26T12:36:22.033644+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:36:22.033644+0000","last_undegraded":"2024-04-26T12:36:22.033644+0000","last_fullsized":"2024-04-26T12:36:22.033644+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.033620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:08.740609+0000","scrub_duration":0.0020642659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:21.254921+0000","last_change":"2024-04-26T12:36:21.255056+0000","last_active":"2024-04-26T12:36:21.254921+0000","last_peered":"2024-04-26T12:36:21.254921+0000","last_clean":"2024-04-26T12:36:21.254921+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:36:21.254921+0000","last_undegraded":"2024-04-26T12:36:21.254921+0000","last_fullsized":"2024-04-26T12:36:21.254921+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_clean_scrub_stamp":"2024-04-26T12:36:21.254895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:45.147934+0000","scrub_duration":0.0093846899999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240831+0000","last_change":"2024-04-26T12:35:03.180657+0000","last_active":"2024-04-26T12:35:29.240831+0000","last_peered":"2024-04-26T12:35:29.240831+0000","last_clean":"2024-04-26T12:35:29.240831+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:35:29.240831+0000","last_undegraded":"2024-04-26T12:35:29.240831+0000","last_fullsized":"2024-04-26T12:35:29.240831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240376+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:29.240376+0000","last_peered":"2024-04-26T12:35:29.240376+0000","last_clean":"2024-04-26T12:35:29.240376+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:29.240376+0000","last_undegraded":"2024-04-26T12:35:29.240376+0000","last_fullsized":"2024-04-26T12:35:29.240376+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226341+0000","last_change":"2024-04-26T12:35:03.188570+0000","last_active":"2024-04-26T12:35:29.226341+0000","last_peered":"2024-04-26T12:35:29.226341+0000","last_clean":"2024-04-26T12:35:29.226341+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:35:29.226341+0000","last_undegraded":"2024-04-26T12:35:29.226341+0000","last_fullsized":"2024-04-26T12:35:29.226341+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.903377+0000","last_change":"2024-04-26T12:36:14.903484+0000","last_active":"2024-04-26T12:36:14.903377+0000","last_peered":"2024-04-26T12:36:14.903377+0000","last_clean":"2024-04-26T12:36:14.903377+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:36:14.903377+0000","last_undegraded":"2024-04-26T12:36:14.903377+0000","last_fullsized":"2024-04-26T12:36:14.903377+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.903354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:16.770079+0000","scrub_duration":0.0017945649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:31.324893+0000","last_change":"2024-04-26T12:36:31.324893+0000","last_active":"2024-04-26T12:36:31.324893+0000","last_peered":"2024-04-26T12:36:31.324893+0000","last_clean":"2024-04-26T12:36:31.324893+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:36:31.324893+0000","last_undegraded":"2024-04-26T12:36:31.324893+0000","last_fullsized":"2024-04-26T12:36:31.324893+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_clean_scrub_stamp":"2024-04-26T12:36:31.324737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:42.977856+0000","scrub_duration":0.0020696540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:25.039446+0000","last_change":"2024-04-26T12:36:25.039601+0000","last_active":"2024-04-26T12:36:25.039446+0000","last_peered":"2024-04-26T12:36:25.039446+0000","last_clean":"2024-04-26T12:36:25.039446+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:36:25.039446+0000","last_undegraded":"2024-04-26T12:36:25.039446+0000","last_fullsized":"2024-04-26T12:36:25.039446+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_clean_scrub_stamp":"2024-04-26T12:36:25.039404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:58.902069+0000","scrub_duration":0.0099267869999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240493+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:29.240493+0000","last_peered":"2024-04-26T12:35:29.240493+0000","last_clean":"2024-04-26T12:35:29.240493+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:29.240493+0000","last_undegraded":"2024-04-26T12:35:29.240493+0000","last_fullsized":"2024-04-26T12:35:29.240493+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":297,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:37.734223+0000","last_change":"2024-04-26T12:30:26.800716+0000","last_active":"2024-04-26T12:35:37.734223+0000","last_peered":"2024-04-26T12:35:37.734223+0000","last_clean":"2024-04-26T12:35:37.734223+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:35:37.734223+0000","last_undegraded":"2024-04-26T12:35:37.734223+0000","last_fullsized":"2024-04-26T12:35:37.734223+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.886236+0000","last_change":"2024-04-26T12:36:00.886361+0000","last_active":"2024-04-26T12:36:00.886236+0000","last_peered":"2024-04-26T12:36:00.886236+0000","last_clean":"2024-04-26T12:36:00.886236+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:36:00.886236+0000","last_undegraded":"2024-04-26T12:36:00.886236+0000","last_fullsized":"2024-04-26T12:36:00.886236+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.886200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.777562+0000","scrub_duration":0.0021566559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":84,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240750+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:29.240750+0000","last_peered":"2024-04-26T12:35:29.240750+0000","last_clean":"2024-04-26T12:35:29.240750+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:29.240750+0000","last_undegraded":"2024-04-26T12:35:29.240750+0000","last_fullsized":"2024-04-26T12:35:29.240750+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:37.734330+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:37.734330+0000","last_peered":"2024-04-26T12:35:37.734330+0000","last_clean":"2024-04-26T12:35:37.734330+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:37.734330+0000","last_undegraded":"2024-04-26T12:35:37.734330+0000","last_fullsized":"2024-04-26T12:35:37.734330+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.833477+0000","last_change":"2024-04-26T12:35:55.833616+0000","last_active":"2024-04-26T12:35:55.833477+0000","last_peered":"2024-04-26T12:35:55.833477+0000","last_clean":"2024-04-26T12:35:55.833477+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:55.833477+0000","last_undegraded":"2024-04-26T12:35:55.833477+0000","last_fullsized":"2024-04-26T12:35:55.833477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.833451+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:41.021792+0000","scrub_duration":0.003578328,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8090,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223077+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:29.223077+0000","last_peered":"2024-04-26T12:35:29.223077+0000","last_clean":"2024-04-26T12:35:29.223077+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:29.223077+0000","last_undegraded":"2024-04-26T12:35:29.223077+0000","last_fullsized":"2024-04-26T12:35:29.223077+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:43.256681+0000","last_change":"2024-04-26T12:35:43.256815+0000","last_active":"2024-04-26T12:35:43.256681+0000","last_peered":"2024-04-26T12:35:43.256681+0000","last_clean":"2024-04-26T12:35:43.256681+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:43.256681+0000","last_undegraded":"2024-04-26T12:35:43.256681+0000","last_fullsized":"2024-04-26T12:35:43.256681+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_clean_scrub_stamp":"2024-04-26T12:35:43.256655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:10.856381+0000","scrub_duration":0.001974197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.839712+0000","last_change":"2024-04-26T12:35:59.839864+0000","last_active":"2024-04-26T12:35:59.839712+0000","last_peered":"2024-04-26T12:35:59.839712+0000","last_clean":"2024-04-26T12:35:59.839712+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:59.839712+0000","last_undegraded":"2024-04-26T12:35:59.839712+0000","last_fullsized":"2024-04-26T12:35:59.839712+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.839691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:13.298302+0000","scrub_duration":0.0019804599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.150119+0000","last_change":"2024-04-26T12:35:55.150310+0000","last_active":"2024-04-26T12:35:55.150119+0000","last_peered":"2024-04-26T12:35:55.150119+0000","last_clean":"2024-04-26T12:35:55.150119+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:55.150119+0000","last_undegraded":"2024-04-26T12:35:55.150119+0000","last_fullsized":"2024-04-26T12:35:55.150119+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.150079+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.249254+0000","scrub_duration":0.011542274999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":77,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226935+0000","last_change":"2024-04-26T12:35:03.194967+0000","last_active":"2024-04-26T12:35:29.226935+0000","last_peered":"2024-04-26T12:35:29.226935+0000","last_clean":"2024-04-26T12:35:29.226935+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:35:29.226935+0000","last_undegraded":"2024-04-26T12:35:29.226935+0000","last_fullsized":"2024-04-26T12:35:29.226935+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.880037+0000","last_change":"2024-04-26T12:35:49.880182+0000","last_active":"2024-04-26T12:35:49.880037+0000","last_peered":"2024-04-26T12:35:49.880037+0000","last_clean":"2024-04-26T12:35:49.880037+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:49.880037+0000","last_undegraded":"2024-04-26T12:35:49.880037+0000","last_fullsized":"2024-04-26T12:35:49.880037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.880012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.320847+0000","scrub_duration":0.0019327299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226034+0000","last_change":"2024-04-26T12:35:03.177978+0000","last_active":"2024-04-26T12:35:29.226034+0000","last_peered":"2024-04-26T12:35:29.226034+0000","last_clean":"2024-04-26T12:35:29.226034+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:35:29.226034+0000","last_undegraded":"2024-04-26T12:35:29.226034+0000","last_fullsized":"2024-04-26T12:35:29.226034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240749+0000","last_change":"2024-04-26T12:30:26.798669+0000","last_active":"2024-04-26T12:35:29.240749+0000","last_peered":"2024-04-26T12:35:29.240749+0000","last_clean":"2024-04-26T12:35:29.240749+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:35:29.240749+0000","last_undegraded":"2024-04-26T12:35:29.240749+0000","last_fullsized":"2024-04-26T12:35:29.240749+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"98'9","reported_seq":95,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:13.902533+0000","last_change":"2024-04-26T12:36:13.902674+0000","last_active":"2024-04-26T12:36:13.902533+0000","last_peered":"2024-04-26T12:36:13.902533+0000","last_clean":"2024-04-26T12:36:13.902533+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:36:13.902533+0000","last_undegraded":"2024-04-26T12:36:13.902533+0000","last_fullsized":"2024-04-26T12:36:13.902533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_deep_scrub":"98'9","last_deep_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_clean_scrub_stamp":"2024-04-26T12:36:13.902508+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:02.310643+0000","scrub_duration":0.0037104799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":99,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222677+0000","last_change":"2024-04-26T12:30:32.608671+0000","last_active":"2024-04-26T12:35:29.222677+0000","last_peered":"2024-04-26T12:35:29.222677+0000","last_clean":"2024-04-26T12:35:29.222677+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:35:29.222677+0000","last_undegraded":"2024-04-26T12:35:29.222677+0000","last_fullsized":"2024-04-26T12:35:29.222677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.273898+0000","last_change":"2024-04-26T12:36:22.274010+0000","last_active":"2024-04-26T12:36:22.273898+0000","last_peered":"2024-04-26T12:36:22.273898+0000","last_clean":"2024-04-26T12:36:22.273898+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:36:22.273898+0000","last_undegraded":"2024-04-26T12:36:22.273898+0000","last_fullsized":"2024-04-26T12:36:22.273898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.273870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:52.682099+0000","scrub_duration":0.0016147990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2132,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.254488+0000","last_change":"2024-04-26T12:36:09.254596+0000","last_active":"2024-04-26T12:36:09.254488+0000","last_peered":"2024-04-26T12:36:09.254488+0000","last_clean":"2024-04-26T12:36:09.254488+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:36:09.254488+0000","last_undegraded":"2024-04-26T12:36:09.254488+0000","last_fullsized":"2024-04-26T12:36:09.254488+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2049","last_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_deep_scrub":"80'2049","last_deep_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.254461+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:25.158195+0000","scrub_duration":0.0084966799999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"98'3","reported_seq":124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:06.029049+0000","last_change":"2024-04-26T12:36:06.029182+0000","last_active":"2024-04-26T12:36:06.029049+0000","last_peered":"2024-04-26T12:36:06.029049+0000","last_clean":"2024-04-26T12:36:06.029049+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:36:06.029049+0000","last_undegraded":"2024-04-26T12:36:06.029049+0000","last_fullsized":"2024-04-26T12:36:06.029049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_clean_scrub_stamp":"2024-04-26T12:36:06.029025+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:17.682144+0000","scrub_duration":0.0034148149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.961730+0000","last_change":"2024-04-26T12:36:29.961845+0000","last_active":"2024-04-26T12:36:29.961730+0000","last_peered":"2024-04-26T12:36:29.961730+0000","last_clean":"2024-04-26T12:36:29.961730+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:36:29.961730+0000","last_undegraded":"2024-04-26T12:36:29.961730+0000","last_fullsized":"2024-04-26T12:36:29.961730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2040","last_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_deep_scrub":"80'2040","last_deep_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.961702+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:33.150927+0000","scrub_duration":0.0070304959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223153+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:29.223153+0000","last_peered":"2024-04-26T12:35:29.223153+0000","last_clean":"2024-04-26T12:35:29.223153+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:29.223153+0000","last_undegraded":"2024-04-26T12:35:29.223153+0000","last_fullsized":"2024-04-26T12:35:29.223153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":127,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:41.966293+0000","last_change":"2024-04-26T12:35:41.966428+0000","last_active":"2024-04-26T12:35:41.966293+0000","last_peered":"2024-04-26T12:35:41.966293+0000","last_clean":"2024-04-26T12:35:41.966293+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:41.966293+0000","last_undegraded":"2024-04-26T12:35:41.966293+0000","last_fullsized":"2024-04-26T12:35:41.966293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7","last_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_deep_scrub":"80'7","last_deep_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_clean_scrub_stamp":"2024-04-26T12:35:41.966266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:47.286627+0000","scrub_duration":0.011530692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":87,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:50.849528+0000","last_change":"2024-04-26T12:35:50.849631+0000","last_active":"2024-04-26T12:35:50.849528+0000","last_peered":"2024-04-26T12:35:50.849528+0000","last_clean":"2024-04-26T12:35:50.849528+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:50.849528+0000","last_undegraded":"2024-04-26T12:35:50.849528+0000","last_fullsized":"2024-04-26T12:35:50.849528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_clean_scrub_stamp":"2024-04-26T12:35:50.849501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:53.832051+0000","scrub_duration":0.002006037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4192,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.266881+0000","last_change":"2024-04-26T12:36:07.266994+0000","last_active":"2024-04-26T12:36:07.266881+0000","last_peered":"2024-04-26T12:36:07.266881+0000","last_clean":"2024-04-26T12:36:07.266881+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:36:07.266881+0000","last_undegraded":"2024-04-26T12:36:07.266881+0000","last_fullsized":"2024-04-26T12:36:07.266881+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4070","last_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_deep_scrub":"80'4070","last_deep_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.266853+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:12.587214+0000","scrub_duration":0.013959829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"98'6","reported_seq":92,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:08.980159+0000","last_change":"2024-04-26T12:36:08.980266+0000","last_active":"2024-04-26T12:36:08.980159+0000","last_peered":"2024-04-26T12:36:08.980159+0000","last_clean":"2024-04-26T12:36:08.980159+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:36:08.980159+0000","last_undegraded":"2024-04-26T12:36:08.980159+0000","last_fullsized":"2024-04-26T12:36:08.980159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_clean_scrub_stamp":"2024-04-26T12:36:08.980132+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:12.661795+0000","scrub_duration":0.0093908959999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2166,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222234+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:29.222234+0000","last_peered":"2024-04-26T12:35:29.222234+0000","last_clean":"2024-04-26T12:35:29.222234+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:29.222234+0000","last_undegraded":"2024-04-26T12:35:29.222234+0000","last_fullsized":"2024-04-26T12:35:29.222234+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":129,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:12.000137+0000","last_change":"2024-04-26T12:36:12.000253+0000","last_active":"2024-04-26T12:36:12.000137+0000","last_peered":"2024-04-26T12:36:12.000137+0000","last_clean":"2024-04-26T12:36:12.000137+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:36:12.000137+0000","last_undegraded":"2024-04-26T12:36:12.000137+0000","last_fullsized":"2024-04-26T12:36:12.000137+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_clean_scrub_stamp":"2024-04-26T12:36:12.000111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:02.393567+0000","scrub_duration":0.017651467000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.855421+0000","last_change":"2024-04-26T12:35:56.855547+0000","last_active":"2024-04-26T12:35:56.855421+0000","last_peered":"2024-04-26T12:35:56.855421+0000","last_clean":"2024-04-26T12:35:56.855421+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:56.855421+0000","last_undegraded":"2024-04-26T12:35:56.855421+0000","last_fullsized":"2024-04-26T12:35:56.855421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.855396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:59.203820+0000","scrub_duration":0.0078982099999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2039,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:26.308848+0000","last_change":"2024-04-26T12:36:26.308957+0000","last_active":"2024-04-26T12:36:26.308848+0000","last_peered":"2024-04-26T12:36:26.308848+0000","last_clean":"2024-04-26T12:36:26.308848+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:36:26.308848+0000","last_undegraded":"2024-04-26T12:36:26.308848+0000","last_fullsized":"2024-04-26T12:36:26.308848+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1986","last_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_deep_scrub":"80'1986","last_deep_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_clean_scrub_stamp":"2024-04-26T12:36:26.308823+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:41.739629+0000","scrub_duration":0.010363702000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2133,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226589+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:29.226589+0000","last_peered":"2024-04-26T12:35:29.226589+0000","last_clean":"2024-04-26T12:35:29.226589+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:29.226589+0000","last_undegraded":"2024-04-26T12:35:29.226589+0000","last_fullsized":"2024-04-26T12:35:29.226589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2138,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222723+0000","last_change":"2024-04-26T12:30:32.614468+0000","last_active":"2024-04-26T12:35:29.222723+0000","last_peered":"2024-04-26T12:35:29.222723+0000","last_clean":"2024-04-26T12:35:29.222723+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:35:29.222723+0000","last_undegraded":"2024-04-26T12:35:29.222723+0000","last_fullsized":"2024-04-26T12:35:29.222723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738445,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142980,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228860,"statfs":{"total":96636764160,"available":95466352640,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:36:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Apr 26 12:35:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42299999999999999,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.63200000000000001,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.625},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42399999999999999,"15min":0.442},"min":{"1min":0.34999999999999998,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.65600000000000003}]}]},{"osd":0,"up_from":85,"seq":365072220181,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52660,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319180,"statfs":{"total":96636764160,"available":96582840320,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:36:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.37},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:36:02 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.31900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738446,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860676,"statfs":{"total":96636764160,"available":95089332224,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:36:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42799999999999999,"15min":0.443},"min":{"1min":0.37,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.35899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.623,"5min":1.137,"15min":1.137},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:36:39.387 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.387 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.387 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.388 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.388 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.388 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.389 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.389 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.389 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.389 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.389 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.390 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.390 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.390 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.390 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.390 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.390 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.390 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.391 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.391 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.391 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.391 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.391 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.391 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.391 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.391 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.392 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.392 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.392 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.392 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.392 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.392 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.392 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.392 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.393 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.393 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.393 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.393 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.393 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.393 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.393 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.393 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.394 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.394 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.394 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.394 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.394 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:39.394 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:36:59.395 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:36:59.775 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:36:59.777 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:36:59.789 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-04-26T12:36:59.072858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119338,"ondisk_log_size":119338,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706804,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408716,"statfs":{"total":289910292480,"available":287138525184,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003301"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2085,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:37.174001+0000","last_change":"2024-04-26T12:35:26.168928+0000","last_active":"2024-04-26T12:35:37.174001+0000","last_peered":"2024-04-26T12:35:37.174001+0000","last_clean":"2024-04-26T12:35:37.174001+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:35:37.174001+0000","last_undegraded":"2024-04-26T12:35:37.174001+0000","last_fullsized":"2024-04-26T12:35:37.174001+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:52.167251+0000","last_change":"2024-04-26T12:35:52.167251+0000","last_active":"2024-04-26T12:35:52.167251+0000","last_peered":"2024-04-26T12:35:52.167251+0000","last_clean":"2024-04-26T12:35:52.167251+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:52.167251+0000","last_undegraded":"2024-04-26T12:35:52.167251+0000","last_fullsized":"2024-04-26T12:35:52.167251+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_clean_scrub_stamp":"2024-04-26T12:35:52.167078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.351227+0000","scrub_duration":0.0068001590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4144,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:45.987903+0000","last_change":"2024-04-26T12:35:45.987903+0000","last_active":"2024-04-26T12:35:45.987903+0000","last_peered":"2024-04-26T12:35:45.987903+0000","last_clean":"2024-04-26T12:35:45.987903+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:45.987903+0000","last_undegraded":"2024-04-26T12:35:45.987903+0000","last_fullsized":"2024-04-26T12:35:45.987903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4036","last_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_deep_scrub":"80'4036","last_deep_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_clean_scrub_stamp":"2024-04-26T12:35:45.987680+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:57.838823+0000","scrub_duration":0.014722818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":129,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:51.983250+0000","last_change":"2024-04-26T12:35:51.983250+0000","last_active":"2024-04-26T12:35:51.983250+0000","last_peered":"2024-04-26T12:35:51.983250+0000","last_clean":"2024-04-26T12:35:51.983250+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:51.983250+0000","last_undegraded":"2024-04-26T12:35:51.983250+0000","last_fullsized":"2024-04-26T12:35:51.983250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_clean_scrub_stamp":"2024-04-26T12:35:51.983105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:34.627140+0000","scrub_duration":0.0030895979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2167,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:24.326520+0000","last_change":"2024-04-26T12:36:24.326642+0000","last_active":"2024-04-26T12:36:24.326520+0000","last_peered":"2024-04-26T12:36:24.326520+0000","last_clean":"2024-04-26T12:36:24.326520+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:36:24.326520+0000","last_undegraded":"2024-04-26T12:36:24.326520+0000","last_fullsized":"2024-04-26T12:36:24.326520+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2045","last_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_deep_scrub":"80'2045","last_deep_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_clean_scrub_stamp":"2024-04-26T12:36:24.326492+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:11.354437+0000","scrub_duration":0.011899834999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103322+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:35.103322+0000","last_peered":"2024-04-26T12:35:35.103322+0000","last_clean":"2024-04-26T12:35:35.103322+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:35.103322+0000","last_undegraded":"2024-04-26T12:35:35.103322+0000","last_fullsized":"2024-04-26T12:35:35.103322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":60,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103311+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:35.103311+0000","last_peered":"2024-04-26T12:35:35.103311+0000","last_clean":"2024-04-26T12:35:35.103311+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:35.103311+0000","last_undegraded":"2024-04-26T12:35:35.103311+0000","last_fullsized":"2024-04-26T12:35:35.103311+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8217,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.006065+0000","last_change":"2024-04-26T12:35:38.006208+0000","last_active":"2024-04-26T12:35:38.006065+0000","last_peered":"2024-04-26T12:35:38.006065+0000","last_clean":"2024-04-26T12:35:38.006065+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:38.006065+0000","last_undegraded":"2024-04-26T12:35:38.006065+0000","last_fullsized":"2024-04-26T12:35:38.006065+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8077","last_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_deep_scrub":"80'8077","last_deep_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.006040+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:57.036646+0000","scrub_duration":0.014128129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6180,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227277+0000","last_change":"2024-04-26T12:35:06.902705+0000","last_active":"2024-04-26T12:35:29.227277+0000","last_peered":"2024-04-26T12:35:29.227277+0000","last_clean":"2024-04-26T12:35:29.227277+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:35:29.227277+0000","last_undegraded":"2024-04-26T12:35:29.227277+0000","last_fullsized":"2024-04-26T12:35:29.227277+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6252,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.280808+0000","last_change":"2024-04-26T12:35:49.280948+0000","last_active":"2024-04-26T12:35:49.280808+0000","last_peered":"2024-04-26T12:35:49.280808+0000","last_clean":"2024-04-26T12:35:49.280808+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:49.280808+0000","last_undegraded":"2024-04-26T12:35:49.280808+0000","last_fullsized":"2024-04-26T12:35:49.280808+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6120","last_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_deep_scrub":"80'6120","last_deep_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.280781+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:12.424132+0000","scrub_duration":0.01226383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4080,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102734+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:30.102734+0000","last_peered":"2024-04-26T12:35:30.102734+0000","last_clean":"2024-04-26T12:35:30.102734+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:30.102734+0000","last_undegraded":"2024-04-26T12:35:30.102734+0000","last_fullsized":"2024-04-26T12:35:30.102734+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.138480+0000","last_change":"2024-04-26T12:35:56.138597+0000","last_active":"2024-04-26T12:35:56.138480+0000","last_peered":"2024-04-26T12:35:56.138480+0000","last_clean":"2024-04-26T12:35:56.138480+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:56.138480+0000","last_undegraded":"2024-04-26T12:35:56.138480+0000","last_fullsized":"2024-04-26T12:35:56.138480+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2051","last_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_deep_scrub":"80'2051","last_deep_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.138454+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:03.549045+0000","scrub_duration":0.011597293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2150,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.311288+0000","last_change":"2024-04-26T12:36:29.311400+0000","last_active":"2024-04-26T12:36:29.311288+0000","last_peered":"2024-04-26T12:36:29.311288+0000","last_clean":"2024-04-26T12:36:29.311288+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:36:29.311288+0000","last_undegraded":"2024-04-26T12:36:29.311288+0000","last_fullsized":"2024-04-26T12:36:29.311288+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2026","last_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_deep_scrub":"80'2026","last_deep_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.311261+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:55.733965+0000","scrub_duration":0.0058874599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2159,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:57.048226+0000","last_change":"2024-04-26T12:35:57.048340+0000","last_active":"2024-04-26T12:35:57.048226+0000","last_peered":"2024-04-26T12:35:57.048226+0000","last_clean":"2024-04-26T12:35:57.048226+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:57.048226+0000","last_undegraded":"2024-04-26T12:35:57.048226+0000","last_fullsized":"2024-04-26T12:35:57.048226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2052","last_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_deep_scrub":"80'2052","last_deep_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_clean_scrub_stamp":"2024-04-26T12:35:57.048199+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:27.456428+0000","scrub_duration":0.016047618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2178,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:01.108264+0000","last_change":"2024-04-26T12:36:01.108416+0000","last_active":"2024-04-26T12:36:01.108264+0000","last_peered":"2024-04-26T12:36:01.108264+0000","last_clean":"2024-04-26T12:36:01.108264+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:36:01.108264+0000","last_undegraded":"2024-04-26T12:36:01.108264+0000","last_fullsized":"2024-04-26T12:36:01.108264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2071","last_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_deep_scrub":"80'2071","last_deep_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_clean_scrub_stamp":"2024-04-26T12:36:01.108240+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:16.539046+0000","scrub_duration":0.014518568000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102574+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:30.102574+0000","last_peered":"2024-04-26T12:35:30.102574+0000","last_clean":"2024-04-26T12:35:30.102574+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:30.102574+0000","last_undegraded":"2024-04-26T12:35:30.102574+0000","last_fullsized":"2024-04-26T12:35:30.102574+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2119,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227235+0000","last_change":"2024-04-26T12:35:06.901285+0000","last_active":"2024-04-26T12:35:29.227235+0000","last_peered":"2024-04-26T12:35:29.227235+0000","last_clean":"2024-04-26T12:35:29.227235+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:35:29.227235+0000","last_undegraded":"2024-04-26T12:35:29.227235+0000","last_fullsized":"2024-04-26T12:35:29.227235+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223130+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:29.223130+0000","last_peered":"2024-04-26T12:35:29.223130+0000","last_clean":"2024-04-26T12:35:29.223130+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:29.223130+0000","last_undegraded":"2024-04-26T12:35:29.223130+0000","last_fullsized":"2024-04-26T12:35:29.223130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4099,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226842+0000","last_change":"2024-04-26T12:35:06.899173+0000","last_active":"2024-04-26T12:35:29.226842+0000","last_peered":"2024-04-26T12:35:29.226842+0000","last_clean":"2024-04-26T12:35:29.226842+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:35:29.226842+0000","last_undegraded":"2024-04-26T12:35:29.226842+0000","last_fullsized":"2024-04-26T12:35:29.226842+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4234,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:16.031374+0000","last_change":"2024-04-26T12:36:16.031481+0000","last_active":"2024-04-26T12:36:16.031374+0000","last_peered":"2024-04-26T12:36:16.031374+0000","last_clean":"2024-04-26T12:36:16.031374+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:36:16.031374+0000","last_undegraded":"2024-04-26T12:36:16.031374+0000","last_fullsized":"2024-04-26T12:36:16.031374+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4103","last_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_deep_scrub":"80'4103","last_deep_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_clean_scrub_stamp":"2024-04-26T12:36:16.031346+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:35.734914+0000","scrub_duration":0.0054779479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":120,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240259+0000","last_change":"2024-04-26T12:35:03.184990+0000","last_active":"2024-04-26T12:35:29.240259+0000","last_peered":"2024-04-26T12:35:29.240259+0000","last_clean":"2024-04-26T12:35:29.240259+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:35:29.240259+0000","last_undegraded":"2024-04-26T12:35:29.240259+0000","last_fullsized":"2024-04-26T12:35:29.240259+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2128,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:40.305677+0000","last_change":"2024-04-26T12:36:40.305800+0000","last_active":"2024-04-26T12:36:40.305677+0000","last_peered":"2024-04-26T12:36:40.305677+0000","last_clean":"2024-04-26T12:36:40.305677+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:36:40.305677+0000","last_undegraded":"2024-04-26T12:36:40.305677+0000","last_fullsized":"2024-04-26T12:36:40.305677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2023","last_scrub_stamp":"2024-04-26T12:36:40.305650+0000","last_deep_scrub":"80'2023","last_deep_scrub_stamp":"2024-04-26T12:36:40.305650+0000","last_clean_scrub_stamp":"2024-04-26T12:36:40.305650+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:59.028356+0000","scrub_duration":0.019539554000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226240+0000","last_change":"2024-04-26T12:35:05.897472+0000","last_active":"2024-04-26T12:35:29.226240+0000","last_peered":"2024-04-26T12:35:29.226240+0000","last_clean":"2024-04-26T12:35:29.226240+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:35:29.226240+0000","last_undegraded":"2024-04-26T12:35:29.226240+0000","last_fullsized":"2024-04-26T12:35:29.226240+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4151,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:03.188978+0000","last_change":"2024-04-26T12:36:03.189097+0000","last_active":"2024-04-26T12:36:03.188978+0000","last_peered":"2024-04-26T12:36:03.188978+0000","last_clean":"2024-04-26T12:36:03.188978+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:36:03.188978+0000","last_undegraded":"2024-04-26T12:36:03.188978+0000","last_fullsized":"2024-04-26T12:36:03.188978+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4067","last_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_deep_scrub":"80'4067","last_deep_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_clean_scrub_stamp":"2024-04-26T12:36:03.188951+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:22.219557+0000","scrub_duration":0.013814754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2153,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.127431+0000","last_change":"2024-04-26T12:35:59.127545+0000","last_active":"2024-04-26T12:35:59.127431+0000","last_peered":"2024-04-26T12:35:59.127431+0000","last_clean":"2024-04-26T12:35:59.127431+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:59.127431+0000","last_undegraded":"2024-04-26T12:35:59.127431+0000","last_fullsized":"2024-04-26T12:35:59.127431+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2053","last_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_deep_scrub":"80'2053","last_deep_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.127404+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:55.177992+0000","scrub_duration":0.018465079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.893685+0000","last_change":"2024-04-26T12:36:17.893816+0000","last_active":"2024-04-26T12:36:17.893685+0000","last_peered":"2024-04-26T12:36:17.893685+0000","last_clean":"2024-04-26T12:36:17.893685+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:36:17.893685+0000","last_undegraded":"2024-04-26T12:36:17.893685+0000","last_fullsized":"2024-04-26T12:36:17.893685+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.893660+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:02.255600+0000","scrub_duration":0.0081512219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2113,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.999615+0000","last_change":"2024-04-26T12:35:49.999776+0000","last_active":"2024-04-26T12:35:49.999615+0000","last_peered":"2024-04-26T12:35:49.999615+0000","last_clean":"2024-04-26T12:35:49.999615+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:49.999615+0000","last_undegraded":"2024-04-26T12:35:49.999615+0000","last_fullsized":"2024-04-26T12:35:49.999615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2006","last_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_deep_scrub":"80'2006","last_deep_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.999571+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:58.313518+0000","scrub_duration":0.012700795000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:47.311342+0000","last_change":"2024-04-26T12:36:47.311461+0000","last_active":"2024-04-26T12:36:47.311342+0000","last_peered":"2024-04-26T12:36:47.311342+0000","last_clean":"2024-04-26T12:36:47.311342+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:36:47.311342+0000","last_undegraded":"2024-04-26T12:36:47.311342+0000","last_fullsized":"2024-04-26T12:36:47.311342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:36:47.311317+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:36:47.311317+0000","last_clean_scrub_stamp":"2024-04-26T12:36:47.311317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:34.018306+0000","scrub_duration":0.002254729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.161522+0000","last_change":"2024-04-26T12:35:38.161638+0000","last_active":"2024-04-26T12:35:38.161522+0000","last_peered":"2024-04-26T12:35:38.161522+0000","last_clean":"2024-04-26T12:35:38.161522+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:38.161522+0000","last_undegraded":"2024-04-26T12:35:38.161522+0000","last_fullsized":"2024-04-26T12:35:38.161522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.161494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:19.249824+0000","scrub_duration":0.014847795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:35.181585+0000","last_change":"2024-04-26T12:36:35.181718+0000","last_active":"2024-04-26T12:36:35.181585+0000","last_peered":"2024-04-26T12:36:35.181585+0000","last_clean":"2024-04-26T12:36:35.181585+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:36:35.181585+0000","last_undegraded":"2024-04-26T12:36:35.181585+0000","last_fullsized":"2024-04-26T12:36:35.181585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_clean_scrub_stamp":"2024-04-26T12:36:35.181561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:15.742099+0000","scrub_duration":0.0020050630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.946133+0000","last_change":"2024-04-26T12:36:07.946252+0000","last_active":"2024-04-26T12:36:07.946133+0000","last_peered":"2024-04-26T12:36:07.946133+0000","last_clean":"2024-04-26T12:36:07.946133+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:36:07.946133+0000","last_undegraded":"2024-04-26T12:36:07.946133+0000","last_fullsized":"2024-04-26T12:36:07.946133+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.946106+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:15.251311+0000","scrub_duration":0.0085133599999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:30.077762+0000","last_change":"2024-04-26T12:36:30.077900+0000","last_active":"2024-04-26T12:36:30.077762+0000","last_peered":"2024-04-26T12:36:30.077762+0000","last_clean":"2024-04-26T12:36:30.077762+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:36:30.077762+0000","last_undegraded":"2024-04-26T12:36:30.077762+0000","last_fullsized":"2024-04-26T12:36:30.077762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_clean_scrub_stamp":"2024-04-26T12:36:30.077735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:09.005584+0000","scrub_duration":0.0019678730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223197+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:29.223197+0000","last_peered":"2024-04-26T12:35:29.223197+0000","last_clean":"2024-04-26T12:35:29.223197+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:29.223197+0000","last_undegraded":"2024-04-26T12:35:29.223197+0000","last_fullsized":"2024-04-26T12:35:29.223197+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227029+0000","last_change":"2024-04-26T12:35:03.195648+0000","last_active":"2024-04-26T12:35:29.227029+0000","last_peered":"2024-04-26T12:35:29.227029+0000","last_clean":"2024-04-26T12:35:29.227029+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:35:29.227029+0000","last_undegraded":"2024-04-26T12:35:29.227029+0000","last_fullsized":"2024-04-26T12:35:29.227029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:46.789110+0000","last_change":"2024-04-26T12:35:46.789233+0000","last_active":"2024-04-26T12:35:46.789110+0000","last_peered":"2024-04-26T12:35:46.789110+0000","last_clean":"2024-04-26T12:35:46.789110+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:46.789110+0000","last_undegraded":"2024-04-26T12:35:46.789110+0000","last_fullsized":"2024-04-26T12:35:46.789110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_clean_scrub_stamp":"2024-04-26T12:35:46.789065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:51.542684+0000","scrub_duration":0.010829827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102784+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:30.102784+0000","last_peered":"2024-04-26T12:35:30.102784+0000","last_clean":"2024-04-26T12:35:30.102784+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:30.102784+0000","last_undegraded":"2024-04-26T12:35:30.102784+0000","last_fullsized":"2024-04-26T12:35:30.102784+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6183,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226290+0000","last_change":"2024-04-26T12:35:06.901985+0000","last_active":"2024-04-26T12:35:29.226290+0000","last_peered":"2024-04-26T12:35:29.226290+0000","last_clean":"2024-04-26T12:35:29.226290+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:35:29.226290+0000","last_undegraded":"2024-04-26T12:35:29.226290+0000","last_fullsized":"2024-04-26T12:35:29.226290+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":62,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223086+0000","last_change":"2024-04-26T12:35:26.168076+0000","last_active":"2024-04-26T12:35:29.223086+0000","last_peered":"2024-04-26T12:35:29.223086+0000","last_clean":"2024-04-26T12:35:29.223086+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:35:29.223086+0000","last_undegraded":"2024-04-26T12:35:29.223086+0000","last_fullsized":"2024-04-26T12:35:29.223086+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:42.691761+0000","last_change":"2024-04-26T12:35:42.691943+0000","last_active":"2024-04-26T12:35:42.691761+0000","last_peered":"2024-04-26T12:35:42.691761+0000","last_clean":"2024-04-26T12:35:42.691761+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:42.691761+0000","last_undegraded":"2024-04-26T12:35:42.691761+0000","last_fullsized":"2024-04-26T12:35:42.691761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4058","last_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_deep_scrub":"80'4058","last_deep_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_clean_scrub_stamp":"2024-04-26T12:35:42.691721+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:59.851784+0000","scrub_duration":0.010224120999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"98'100","reported_seq":208,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.932551+0000","last_change":"2024-04-26T12:36:41.932662+0000","last_active":"2024-04-26T12:36:41.932551+0000","last_peered":"2024-04-26T12:36:41.932551+0000","last_clean":"2024-04-26T12:36:41.932551+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:36:41.932551+0000","last_undegraded":"2024-04-26T12:36:41.932551+0000","last_fullsized":"2024-04-26T12:36:41.932551+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'100","last_scrub_stamp":"2024-04-26T12:36:41.932523+0000","last_deep_scrub":"98'100","last_deep_scrub_stamp":"2024-04-26T12:36:41.932523+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.932523+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:04.155704+0000","scrub_duration":0.0057948440000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4201,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.099299+0000","last_change":"2024-04-26T12:35:59.099460+0000","last_active":"2024-04-26T12:35:59.099299+0000","last_peered":"2024-04-26T12:35:59.099299+0000","last_clean":"2024-04-26T12:35:59.099299+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:59.099299+0000","last_undegraded":"2024-04-26T12:35:59.099299+0000","last_fullsized":"2024-04-26T12:35:59.099299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4094","last_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_deep_scrub":"80'4094","last_deep_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.099256+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:46.127201+0000","scrub_duration":0.013902207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"98'4","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:10.954307+0000","last_change":"2024-04-26T12:36:10.954415+0000","last_active":"2024-04-26T12:36:10.954307+0000","last_peered":"2024-04-26T12:36:10.954307+0000","last_clean":"2024-04-26T12:36:10.954307+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:36:10.954307+0000","last_undegraded":"2024-04-26T12:36:10.954307+0000","last_fullsized":"2024-04-26T12:36:10.954307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_clean_scrub_stamp":"2024-04-26T12:36:10.954281+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:30.939529+0000","scrub_duration":0.0038576499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2093,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.082461+0000","last_change":"2024-04-26T12:36:00.082579+0000","last_active":"2024-04-26T12:36:00.082461+0000","last_peered":"2024-04-26T12:36:00.082461+0000","last_clean":"2024-04-26T12:36:00.082461+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:36:00.082461+0000","last_undegraded":"2024-04-26T12:36:00.082461+0000","last_fullsized":"2024-04-26T12:36:00.082461+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1968","last_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_deep_scrub":"80'1968","last_deep_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.082433+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.908109+0000","scrub_duration":0.011161457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:51.233837+0000","last_change":"2024-04-26T12:36:51.234006+0000","last_active":"2024-04-26T12:36:51.233837+0000","last_peered":"2024-04-26T12:36:51.233837+0000","last_clean":"2024-04-26T12:36:51.233837+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:36:51.233837+0000","last_undegraded":"2024-04-26T12:36:51.233837+0000","last_fullsized":"2024-04-26T12:36:51.233837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:51.233800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:51.233800+0000","last_clean_scrub_stamp":"2024-04-26T12:36:51.233800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:27.209478+0000","scrub_duration":0.0021296700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223191+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:29.223191+0000","last_peered":"2024-04-26T12:35:29.223191+0000","last_clean":"2024-04-26T12:35:29.223191+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:29.223191+0000","last_undegraded":"2024-04-26T12:35:29.223191+0000","last_fullsized":"2024-04-26T12:35:29.223191+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.344225+0000","last_change":"2024-04-26T12:36:17.344357+0000","last_active":"2024-04-26T12:36:17.344225+0000","last_peered":"2024-04-26T12:36:17.344225+0000","last_clean":"2024-04-26T12:36:17.344225+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:36:17.344225+0000","last_undegraded":"2024-04-26T12:36:17.344225+0000","last_fullsized":"2024-04-26T12:36:17.344225+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.344200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:59.988235+0000","scrub_duration":0.0016444610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:23.003025+0000","last_change":"2024-04-26T12:36:23.003182+0000","last_active":"2024-04-26T12:36:23.003025+0000","last_peered":"2024-04-26T12:36:23.003025+0000","last_clean":"2024-04-26T12:36:23.003025+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:36:23.003025+0000","last_undegraded":"2024-04-26T12:36:23.003025+0000","last_fullsized":"2024-04-26T12:36:23.003025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_clean_scrub_stamp":"2024-04-26T12:36:23.002980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:24.050905+0000","scrub_duration":0.008324517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"80'9","reported_seq":106,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240129+0000","last_change":"2024-04-26T12:30:32.158074+0000","last_active":"2024-04-26T12:35:29.240129+0000","last_peered":"2024-04-26T12:35:29.240129+0000","last_clean":"2024-04-26T12:35:29.240129+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:35:29.240129+0000","last_undegraded":"2024-04-26T12:35:29.240129+0000","last_fullsized":"2024-04-26T12:35:29.240129+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227218+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:29.227218+0000","last_peered":"2024-04-26T12:35:29.227218+0000","last_clean":"2024-04-26T12:35:29.227218+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:29.227218+0000","last_undegraded":"2024-04-26T12:35:29.227218+0000","last_fullsized":"2024-04-26T12:35:29.227218+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"98'2","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:34.866882+0000","last_change":"2024-04-26T12:36:34.867018+0000","last_active":"2024-04-26T12:36:34.866882+0000","last_peered":"2024-04-26T12:36:34.866882+0000","last_clean":"2024-04-26T12:36:34.866882+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:36:34.866882+0000","last_undegraded":"2024-04-26T12:36:34.866882+0000","last_fullsized":"2024-04-26T12:36:34.866882+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_clean_scrub_stamp":"2024-04-26T12:36:34.866855+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:44.780097+0000","scrub_duration":0.0056431429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2096,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222476+0000","last_change":"2024-04-26T12:35:26.170643+0000","last_active":"2024-04-26T12:35:29.222476+0000","last_peered":"2024-04-26T12:35:29.222476+0000","last_clean":"2024-04-26T12:35:29.222476+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:35:29.222476+0000","last_undegraded":"2024-04-26T12:35:29.222476+0000","last_fullsized":"2024-04-26T12:35:29.222476+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"98'3","reported_seq":109,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:35.331048+0000","last_change":"2024-04-26T12:36:35.331158+0000","last_active":"2024-04-26T12:36:35.331048+0000","last_peered":"2024-04-26T12:36:35.331048+0000","last_clean":"2024-04-26T12:36:35.331048+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:36:35.331048+0000","last_undegraded":"2024-04-26T12:36:35.331048+0000","last_fullsized":"2024-04-26T12:36:35.331048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:35.331023+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:35.331023+0000","last_clean_scrub_stamp":"2024-04-26T12:36:35.331023+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:30.228403+0000","scrub_duration":0.0034488190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:40.208916+0000","last_change":"2024-04-26T12:35:40.209064+0000","last_active":"2024-04-26T12:35:40.208916+0000","last_peered":"2024-04-26T12:35:40.208916+0000","last_clean":"2024-04-26T12:35:40.208916+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:40.208916+0000","last_undegraded":"2024-04-26T12:35:40.208916+0000","last_fullsized":"2024-04-26T12:35:40.208916+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_clean_scrub_stamp":"2024-04-26T12:35:40.208887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:37.520324+0000","scrub_duration":0.016687707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":31,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102753+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:30.102753+0000","last_peered":"2024-04-26T12:35:30.102753+0000","last_clean":"2024-04-26T12:35:30.102753+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:30.102753+0000","last_undegraded":"2024-04-26T12:35:30.102753+0000","last_fullsized":"2024-04-26T12:35:30.102753+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2123,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:39.969199+0000","last_change":"2024-04-26T12:36:39.969333+0000","last_active":"2024-04-26T12:36:39.969199+0000","last_peered":"2024-04-26T12:36:39.969199+0000","last_clean":"2024-04-26T12:36:39.969199+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:36:39.969199+0000","last_undegraded":"2024-04-26T12:36:39.969199+0000","last_fullsized":"2024-04-26T12:36:39.969199+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1991","last_scrub_stamp":"2024-04-26T12:36:39.969173+0000","last_deep_scrub":"80'1991","last_deep_scrub_stamp":"2024-04-26T12:36:39.969173+0000","last_clean_scrub_stamp":"2024-04-26T12:36:39.969173+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.633864+0000","scrub_duration":0.011084973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":121,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.982136+0000","last_change":"2024-04-26T12:36:14.982242+0000","last_active":"2024-04-26T12:36:14.982136+0000","last_peered":"2024-04-26T12:36:14.982136+0000","last_clean":"2024-04-26T12:36:14.982136+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:36:14.982136+0000","last_undegraded":"2024-04-26T12:36:14.982136+0000","last_fullsized":"2024-04-26T12:36:14.982136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.982103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.704809+0000","scrub_duration":0.0018977480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:20.998383+0000","last_change":"2024-04-26T12:36:20.998503+0000","last_active":"2024-04-26T12:36:20.998383+0000","last_peered":"2024-04-26T12:36:20.998383+0000","last_clean":"2024-04-26T12:36:20.998383+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:36:20.998383+0000","last_undegraded":"2024-04-26T12:36:20.998383+0000","last_fullsized":"2024-04-26T12:36:20.998383+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_clean_scrub_stamp":"2024-04-26T12:36:20.998357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.004150+0000","scrub_duration":0.0052206129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"98'4","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:37.185257+0000","last_change":"2024-04-26T12:36:37.185388+0000","last_active":"2024-04-26T12:36:37.185257+0000","last_peered":"2024-04-26T12:36:37.185257+0000","last_clean":"2024-04-26T12:36:37.185257+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:36:37.185257+0000","last_undegraded":"2024-04-26T12:36:37.185257+0000","last_fullsized":"2024-04-26T12:36:37.185257+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:37.185231+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:37.185231+0000","last_clean_scrub_stamp":"2024-04-26T12:36:37.185231+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:12.684695+0000","scrub_duration":0.0035423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.017218+0000","last_change":"2024-04-26T12:35:56.017326+0000","last_active":"2024-04-26T12:35:56.017218+0000","last_peered":"2024-04-26T12:35:56.017218+0000","last_clean":"2024-04-26T12:35:56.017218+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:56.017218+0000","last_undegraded":"2024-04-26T12:35:56.017218+0000","last_fullsized":"2024-04-26T12:35:56.017218+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1980","last_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_deep_scrub":"80'1980","last_deep_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.017191+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:19.910231+0000","scrub_duration":0.0081651450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.240317+0000","last_change":"2024-04-26T12:35:03.180398+0000","last_active":"2024-04-26T12:35:29.240317+0000","last_peered":"2024-04-26T12:35:29.240317+0000","last_clean":"2024-04-26T12:35:29.240317+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:35:29.240317+0000","last_undegraded":"2024-04-26T12:35:29.240317+0000","last_fullsized":"2024-04-26T12:35:29.240317+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2146,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:04.058960+0000","last_change":"2024-04-26T12:36:04.059101+0000","last_active":"2024-04-26T12:36:04.058960+0000","last_peered":"2024-04-26T12:36:04.058960+0000","last_clean":"2024-04-26T12:36:04.058960+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:36:04.058960+0000","last_undegraded":"2024-04-26T12:36:04.058960+0000","last_fullsized":"2024-04-26T12:36:04.058960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2039","last_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_deep_scrub":"80'2039","last_deep_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_clean_scrub_stamp":"2024-04-26T12:36:04.058924+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:30.481629+0000","scrub_duration":0.012146647999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.322623+0000","last_change":"2024-04-26T12:36:41.322735+0000","last_active":"2024-04-26T12:36:41.322623+0000","last_peered":"2024-04-26T12:36:41.322623+0000","last_clean":"2024-04-26T12:36:41.322623+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:36:41.322623+0000","last_undegraded":"2024-04-26T12:36:41.322623+0000","last_fullsized":"2024-04-26T12:36:41.322623+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:41.322599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:41.322599+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.322599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:01.026167+0000","scrub_duration":0.0017738890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.984844+0000","last_change":"2024-04-26T12:36:09.984957+0000","last_active":"2024-04-26T12:36:09.984844+0000","last_peered":"2024-04-26T12:36:09.984844+0000","last_clean":"2024-04-26T12:36:09.984844+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:36:09.984844+0000","last_undegraded":"2024-04-26T12:36:09.984844+0000","last_fullsized":"2024-04-26T12:36:09.984844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2065","last_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_deep_scrub":"80'2065","last_deep_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.984820+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:04.882200+0000","scrub_duration":0.013017881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":96,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.285614+0000","last_change":"2024-04-26T12:36:14.285733+0000","last_active":"2024-04-26T12:36:14.285614+0000","last_peered":"2024-04-26T12:36:14.285614+0000","last_clean":"2024-04-26T12:36:14.285614+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:36:14.285614+0000","last_undegraded":"2024-04-26T12:36:14.285614+0000","last_fullsized":"2024-04-26T12:36:14.285614+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.285570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:22.599518+0000","scrub_duration":0.0020305150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6185,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227148+0000","last_change":"2024-04-26T12:35:06.903035+0000","last_active":"2024-04-26T12:35:29.227148+0000","last_peered":"2024-04-26T12:35:29.227148+0000","last_clean":"2024-04-26T12:35:29.227148+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:35:29.227148+0000","last_undegraded":"2024-04-26T12:35:29.227148+0000","last_fullsized":"2024-04-26T12:35:29.227148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:54.828629+0000","last_change":"2024-04-26T12:35:54.828732+0000","last_active":"2024-04-26T12:35:54.828629+0000","last_peered":"2024-04-26T12:35:54.828629+0000","last_clean":"2024-04-26T12:35:54.828629+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:54.828629+0000","last_undegraded":"2024-04-26T12:35:54.828629+0000","last_fullsized":"2024-04-26T12:35:54.828629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_clean_scrub_stamp":"2024-04-26T12:35:54.828605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:29.226278+0000","scrub_duration":0.001515267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.033778+0000","last_change":"2024-04-26T12:36:22.033778+0000","last_active":"2024-04-26T12:36:22.033778+0000","last_peered":"2024-04-26T12:36:22.033778+0000","last_clean":"2024-04-26T12:36:22.033778+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:36:22.033778+0000","last_undegraded":"2024-04-26T12:36:22.033778+0000","last_fullsized":"2024-04-26T12:36:22.033778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.033620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:08.740609+0000","scrub_duration":0.0020642659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:21.254921+0000","last_change":"2024-04-26T12:36:21.255056+0000","last_active":"2024-04-26T12:36:21.254921+0000","last_peered":"2024-04-26T12:36:21.254921+0000","last_clean":"2024-04-26T12:36:21.254921+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:36:21.254921+0000","last_undegraded":"2024-04-26T12:36:21.254921+0000","last_fullsized":"2024-04-26T12:36:21.254921+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_clean_scrub_stamp":"2024-04-26T12:36:21.254895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:45.147934+0000","scrub_duration":0.0093846899999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:54.092774+0000","last_change":"2024-04-26T12:36:54.092893+0000","last_active":"2024-04-26T12:36:54.092774+0000","last_peered":"2024-04-26T12:36:54.092774+0000","last_clean":"2024-04-26T12:36:54.092774+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:36:54.092774+0000","last_undegraded":"2024-04-26T12:36:54.092774+0000","last_fullsized":"2024-04-26T12:36:54.092774+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:54.092735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:54.092735+0000","last_clean_scrub_stamp":"2024-04-26T12:36:54.092735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:40.809083+0000","scrub_duration":0.001976303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:37.734205+0000","last_change":"2024-04-26T12:35:03.185008+0000","last_active":"2024-04-26T12:35:37.734205+0000","last_peered":"2024-04-26T12:35:37.734205+0000","last_clean":"2024-04-26T12:35:37.734205+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:35:37.734205+0000","last_undegraded":"2024-04-26T12:35:37.734205+0000","last_fullsized":"2024-04-26T12:35:37.734205+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:49.289504+0000","last_change":"2024-04-26T12:36:49.289630+0000","last_active":"2024-04-26T12:36:49.289504+0000","last_peered":"2024-04-26T12:36:49.289504+0000","last_clean":"2024-04-26T12:36:49.289504+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:36:49.289504+0000","last_undegraded":"2024-04-26T12:36:49.289504+0000","last_fullsized":"2024-04-26T12:36:49.289504+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:49.289463+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:49.289463+0000","last_clean_scrub_stamp":"2024-04-26T12:36:49.289463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:56.753704+0000","scrub_duration":0.0072399329999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.903377+0000","last_change":"2024-04-26T12:36:14.903484+0000","last_active":"2024-04-26T12:36:14.903377+0000","last_peered":"2024-04-26T12:36:14.903377+0000","last_clean":"2024-04-26T12:36:14.903377+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:36:14.903377+0000","last_undegraded":"2024-04-26T12:36:14.903377+0000","last_fullsized":"2024-04-26T12:36:14.903377+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.903354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:16.770079+0000","scrub_duration":0.0017945649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:31.324893+0000","last_change":"2024-04-26T12:36:31.324893+0000","last_active":"2024-04-26T12:36:31.324893+0000","last_peered":"2024-04-26T12:36:31.324893+0000","last_clean":"2024-04-26T12:36:31.324893+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:36:31.324893+0000","last_undegraded":"2024-04-26T12:36:31.324893+0000","last_fullsized":"2024-04-26T12:36:31.324893+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_clean_scrub_stamp":"2024-04-26T12:36:31.324737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:42.977856+0000","scrub_duration":0.0020696540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:25.039446+0000","last_change":"2024-04-26T12:36:25.039601+0000","last_active":"2024-04-26T12:36:25.039446+0000","last_peered":"2024-04-26T12:36:25.039446+0000","last_clean":"2024-04-26T12:36:25.039446+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:36:25.039446+0000","last_undegraded":"2024-04-26T12:36:25.039446+0000","last_fullsized":"2024-04-26T12:36:25.039446+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_clean_scrub_stamp":"2024-04-26T12:36:25.039404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:58.902069+0000","scrub_duration":0.0099267869999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":114,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:37.734222+0000","last_change":"2024-04-26T12:35:03.184524+0000","last_active":"2024-04-26T12:35:37.734222+0000","last_peered":"2024-04-26T12:35:37.734222+0000","last_clean":"2024-04-26T12:35:37.734222+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:35:37.734222+0000","last_undegraded":"2024-04-26T12:35:37.734222+0000","last_fullsized":"2024-04-26T12:35:37.734222+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"98'159","reported_seq":310,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:48.982871+0000","last_change":"2024-04-26T12:36:48.982998+0000","last_active":"2024-04-26T12:36:48.982871+0000","last_peered":"2024-04-26T12:36:48.982871+0000","last_clean":"2024-04-26T12:36:48.982871+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:36:48.982871+0000","last_undegraded":"2024-04-26T12:36:48.982871+0000","last_fullsized":"2024-04-26T12:36:48.982871+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'159","last_scrub_stamp":"2024-04-26T12:36:48.982845+0000","last_deep_scrub":"98'159","last_deep_scrub_stamp":"2024-04-26T12:36:48.982845+0000","last_clean_scrub_stamp":"2024-04-26T12:36:48.982845+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:53.161246+0000","scrub_duration":0.0049176230000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.886236+0000","last_change":"2024-04-26T12:36:00.886361+0000","last_active":"2024-04-26T12:36:00.886236+0000","last_peered":"2024-04-26T12:36:00.886236+0000","last_clean":"2024-04-26T12:36:00.886236+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:36:00.886236+0000","last_undegraded":"2024-04-26T12:36:00.886236+0000","last_fullsized":"2024-04-26T12:36:00.886236+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.886200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.777562+0000","scrub_duration":0.0021566559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:37.734450+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:37.734450+0000","last_peered":"2024-04-26T12:35:37.734450+0000","last_clean":"2024-04-26T12:35:37.734450+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:37.734450+0000","last_undegraded":"2024-04-26T12:35:37.734450+0000","last_fullsized":"2024-04-26T12:35:37.734450+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:37.734330+0000","last_change":"2024-04-26T12:30:26.800588+0000","last_active":"2024-04-26T12:35:37.734330+0000","last_peered":"2024-04-26T12:35:37.734330+0000","last_clean":"2024-04-26T12:35:37.734330+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:35:37.734330+0000","last_undegraded":"2024-04-26T12:35:37.734330+0000","last_fullsized":"2024-04-26T12:35:37.734330+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:25.764494+0000","last_clean_scrub_stamp":"2024-04-26T12:30:25.764494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.833477+0000","last_change":"2024-04-26T12:35:55.833616+0000","last_active":"2024-04-26T12:35:55.833477+0000","last_peered":"2024-04-26T12:35:55.833477+0000","last_clean":"2024-04-26T12:35:55.833477+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:55.833477+0000","last_undegraded":"2024-04-26T12:35:55.833477+0000","last_fullsized":"2024-04-26T12:35:55.833477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.833451+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:41.021792+0000","scrub_duration":0.003578328,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8090,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223077+0000","last_change":"2024-04-26T12:35:26.171354+0000","last_active":"2024-04-26T12:35:29.223077+0000","last_peered":"2024-04-26T12:35:29.223077+0000","last_clean":"2024-04-26T12:35:29.223077+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:35:29.223077+0000","last_undegraded":"2024-04-26T12:35:29.223077+0000","last_fullsized":"2024-04-26T12:35:29.223077+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:43.256815+0000","last_change":"2024-04-26T12:35:43.256815+0000","last_active":"2024-04-26T12:35:43.256815+0000","last_peered":"2024-04-26T12:35:43.256815+0000","last_clean":"2024-04-26T12:35:43.256815+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:43.256815+0000","last_undegraded":"2024-04-26T12:35:43.256815+0000","last_fullsized":"2024-04-26T12:35:43.256815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_clean_scrub_stamp":"2024-04-26T12:35:43.256655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:10.856381+0000","scrub_duration":0.001974197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.839712+0000","last_change":"2024-04-26T12:35:59.839864+0000","last_active":"2024-04-26T12:35:59.839712+0000","last_peered":"2024-04-26T12:35:59.839712+0000","last_clean":"2024-04-26T12:35:59.839712+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:59.839712+0000","last_undegraded":"2024-04-26T12:35:59.839712+0000","last_fullsized":"2024-04-26T12:35:59.839712+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.839691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:13.298302+0000","scrub_duration":0.0019804599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.150119+0000","last_change":"2024-04-26T12:35:55.150310+0000","last_active":"2024-04-26T12:35:55.150119+0000","last_peered":"2024-04-26T12:35:55.150119+0000","last_clean":"2024-04-26T12:35:55.150119+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:55.150119+0000","last_undegraded":"2024-04-26T12:35:55.150119+0000","last_fullsized":"2024-04-26T12:35:55.150119+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.150079+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.249254+0000","scrub_duration":0.011542274999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"98'4","reported_seq":89,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.259866+0000","last_change":"2024-04-26T12:36:41.260010+0000","last_active":"2024-04-26T12:36:41.259866+0000","last_peered":"2024-04-26T12:36:41.259866+0000","last_clean":"2024-04-26T12:36:41.259866+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:36:41.259866+0000","last_undegraded":"2024-04-26T12:36:41.259866+0000","last_fullsized":"2024-04-26T12:36:41.259866+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:41.259810+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:41.259810+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.259810+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:21.428799+0000","scrub_duration":0.003236708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.880037+0000","last_change":"2024-04-26T12:35:49.880182+0000","last_active":"2024-04-26T12:35:49.880037+0000","last_peered":"2024-04-26T12:35:49.880037+0000","last_clean":"2024-04-26T12:35:49.880037+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:49.880037+0000","last_undegraded":"2024-04-26T12:35:49.880037+0000","last_fullsized":"2024-04-26T12:35:49.880037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.880012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.320847+0000","scrub_duration":0.0019327299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:43.274831+0000","last_change":"2024-04-26T12:36:43.274955+0000","last_active":"2024-04-26T12:36:43.274831+0000","last_peered":"2024-04-26T12:36:43.274831+0000","last_clean":"2024-04-26T12:36:43.274831+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:36:43.274831+0000","last_undegraded":"2024-04-26T12:36:43.274831+0000","last_fullsized":"2024-04-26T12:36:43.274831+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:43.274807+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:43.274807+0000","last_clean_scrub_stamp":"2024-04-26T12:36:43.274807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:17.223965+0000","scrub_duration":0.007220705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:55.109547+0000","last_change":"2024-04-26T12:36:55.109649+0000","last_active":"2024-04-26T12:36:55.109547+0000","last_peered":"2024-04-26T12:36:55.109547+0000","last_clean":"2024-04-26T12:36:55.109547+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:36:55.109547+0000","last_undegraded":"2024-04-26T12:36:55.109547+0000","last_fullsized":"2024-04-26T12:36:55.109547+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:55.109520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:55.109520+0000","last_clean_scrub_stamp":"2024-04-26T12:36:55.109520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:09.449647+0000","scrub_duration":0.0018695129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"98'9","reported_seq":95,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:13.902533+0000","last_change":"2024-04-26T12:36:13.902674+0000","last_active":"2024-04-26T12:36:13.902533+0000","last_peered":"2024-04-26T12:36:13.902533+0000","last_clean":"2024-04-26T12:36:13.902533+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:36:13.902533+0000","last_undegraded":"2024-04-26T12:36:13.902533+0000","last_fullsized":"2024-04-26T12:36:13.902533+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_deep_scrub":"98'9","last_deep_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_clean_scrub_stamp":"2024-04-26T12:36:13.902508+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:02.310643+0000","scrub_duration":0.0037104799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:36.306921+0000","last_change":"2024-04-26T12:36:36.306921+0000","last_active":"2024-04-26T12:36:36.306921+0000","last_peered":"2024-04-26T12:36:36.306921+0000","last_clean":"2024-04-26T12:36:36.306921+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:36:36.306921+0000","last_undegraded":"2024-04-26T12:36:36.306921+0000","last_fullsized":"2024-04-26T12:36:36.306921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:36.306777+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:36.306777+0000","last_clean_scrub_stamp":"2024-04-26T12:36:36.306777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:56.292025+0000","scrub_duration":0.0093015630000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.273898+0000","last_change":"2024-04-26T12:36:22.274010+0000","last_active":"2024-04-26T12:36:22.273898+0000","last_peered":"2024-04-26T12:36:22.273898+0000","last_clean":"2024-04-26T12:36:22.273898+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:36:22.273898+0000","last_undegraded":"2024-04-26T12:36:22.273898+0000","last_fullsized":"2024-04-26T12:36:22.273898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.273870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:52.682099+0000","scrub_duration":0.0016147990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2132,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.254488+0000","last_change":"2024-04-26T12:36:09.254596+0000","last_active":"2024-04-26T12:36:09.254488+0000","last_peered":"2024-04-26T12:36:09.254488+0000","last_clean":"2024-04-26T12:36:09.254488+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:36:09.254488+0000","last_undegraded":"2024-04-26T12:36:09.254488+0000","last_fullsized":"2024-04-26T12:36:09.254488+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2049","last_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_deep_scrub":"80'2049","last_deep_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.254461+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:25.158195+0000","scrub_duration":0.0084966799999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"98'3","reported_seq":124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:06.029049+0000","last_change":"2024-04-26T12:36:06.029182+0000","last_active":"2024-04-26T12:36:06.029049+0000","last_peered":"2024-04-26T12:36:06.029049+0000","last_clean":"2024-04-26T12:36:06.029049+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:36:06.029049+0000","last_undegraded":"2024-04-26T12:36:06.029049+0000","last_fullsized":"2024-04-26T12:36:06.029049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_clean_scrub_stamp":"2024-04-26T12:36:06.029025+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:17.682144+0000","scrub_duration":0.0034148149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.961730+0000","last_change":"2024-04-26T12:36:29.961845+0000","last_active":"2024-04-26T12:36:29.961730+0000","last_peered":"2024-04-26T12:36:29.961730+0000","last_clean":"2024-04-26T12:36:29.961730+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:36:29.961730+0000","last_undegraded":"2024-04-26T12:36:29.961730+0000","last_fullsized":"2024-04-26T12:36:29.961730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2040","last_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_deep_scrub":"80'2040","last_deep_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.961702+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:33.150927+0000","scrub_duration":0.0070304959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223153+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:29.223153+0000","last_peered":"2024-04-26T12:35:29.223153+0000","last_clean":"2024-04-26T12:35:29.223153+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:29.223153+0000","last_undegraded":"2024-04-26T12:35:29.223153+0000","last_fullsized":"2024-04-26T12:35:29.223153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":127,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:41.966293+0000","last_change":"2024-04-26T12:35:41.966428+0000","last_active":"2024-04-26T12:35:41.966293+0000","last_peered":"2024-04-26T12:35:41.966293+0000","last_clean":"2024-04-26T12:35:41.966293+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:41.966293+0000","last_undegraded":"2024-04-26T12:35:41.966293+0000","last_fullsized":"2024-04-26T12:35:41.966293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7","last_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_deep_scrub":"80'7","last_deep_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_clean_scrub_stamp":"2024-04-26T12:35:41.966266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:47.286627+0000","scrub_duration":0.011530692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":87,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:50.849528+0000","last_change":"2024-04-26T12:35:50.849631+0000","last_active":"2024-04-26T12:35:50.849528+0000","last_peered":"2024-04-26T12:35:50.849528+0000","last_clean":"2024-04-26T12:35:50.849528+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:50.849528+0000","last_undegraded":"2024-04-26T12:35:50.849528+0000","last_fullsized":"2024-04-26T12:35:50.849528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_clean_scrub_stamp":"2024-04-26T12:35:50.849501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:53.832051+0000","scrub_duration":0.002006037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4192,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.266881+0000","last_change":"2024-04-26T12:36:07.266994+0000","last_active":"2024-04-26T12:36:07.266881+0000","last_peered":"2024-04-26T12:36:07.266881+0000","last_clean":"2024-04-26T12:36:07.266881+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:36:07.266881+0000","last_undegraded":"2024-04-26T12:36:07.266881+0000","last_fullsized":"2024-04-26T12:36:07.266881+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4070","last_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_deep_scrub":"80'4070","last_deep_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.266853+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:12.587214+0000","scrub_duration":0.013959829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"98'6","reported_seq":92,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:08.980159+0000","last_change":"2024-04-26T12:36:08.980266+0000","last_active":"2024-04-26T12:36:08.980159+0000","last_peered":"2024-04-26T12:36:08.980159+0000","last_clean":"2024-04-26T12:36:08.980159+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:36:08.980159+0000","last_undegraded":"2024-04-26T12:36:08.980159+0000","last_fullsized":"2024-04-26T12:36:08.980159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_clean_scrub_stamp":"2024-04-26T12:36:08.980132+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:12.661795+0000","scrub_duration":0.0093908959999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2166,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.222234+0000","last_change":"2024-04-26T12:35:26.168561+0000","last_active":"2024-04-26T12:35:29.222234+0000","last_peered":"2024-04-26T12:35:29.222234+0000","last_clean":"2024-04-26T12:35:29.222234+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:35:29.222234+0000","last_undegraded":"2024-04-26T12:35:29.222234+0000","last_fullsized":"2024-04-26T12:35:29.222234+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":130,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:12.000253+0000","last_change":"2024-04-26T12:36:12.000253+0000","last_active":"2024-04-26T12:36:12.000253+0000","last_peered":"2024-04-26T12:36:12.000253+0000","last_clean":"2024-04-26T12:36:12.000253+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:36:12.000253+0000","last_undegraded":"2024-04-26T12:36:12.000253+0000","last_fullsized":"2024-04-26T12:36:12.000253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_clean_scrub_stamp":"2024-04-26T12:36:12.000111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:02.393567+0000","scrub_duration":0.017651467000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.855421+0000","last_change":"2024-04-26T12:35:56.855547+0000","last_active":"2024-04-26T12:35:56.855421+0000","last_peered":"2024-04-26T12:35:56.855421+0000","last_clean":"2024-04-26T12:35:56.855421+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:56.855421+0000","last_undegraded":"2024-04-26T12:35:56.855421+0000","last_fullsized":"2024-04-26T12:35:56.855421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.855396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:59.203820+0000","scrub_duration":0.0078982099999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2039,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:26.308848+0000","last_change":"2024-04-26T12:36:26.308957+0000","last_active":"2024-04-26T12:36:26.308848+0000","last_peered":"2024-04-26T12:36:26.308848+0000","last_clean":"2024-04-26T12:36:26.308848+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:36:26.308848+0000","last_undegraded":"2024-04-26T12:36:26.308848+0000","last_fullsized":"2024-04-26T12:36:26.308848+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1986","last_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_deep_scrub":"80'1986","last_deep_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_clean_scrub_stamp":"2024-04-26T12:36:26.308823+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:41.739629+0000","scrub_duration":0.010363702000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2133,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.226589+0000","last_change":"2024-04-26T12:35:05.898005+0000","last_active":"2024-04-26T12:35:29.226589+0000","last_peered":"2024-04-26T12:35:29.226589+0000","last_clean":"2024-04-26T12:35:29.226589+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:35:29.226589+0000","last_undegraded":"2024-04-26T12:35:29.226589+0000","last_fullsized":"2024-04-26T12:35:29.226589+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2149,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:37.258174+0000","last_change":"2024-04-26T12:36:37.258311+0000","last_active":"2024-04-26T12:36:37.258174+0000","last_peered":"2024-04-26T12:36:37.258174+0000","last_clean":"2024-04-26T12:36:37.258174+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:36:37.258174+0000","last_undegraded":"2024-04-26T12:36:37.258174+0000","last_fullsized":"2024-04-26T12:36:37.258174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2044","last_scrub_stamp":"2024-04-26T12:36:37.258151+0000","last_deep_scrub":"80'2044","last_deep_scrub_stamp":"2024-04-26T12:36:37.258151+0000","last_clean_scrub_stamp":"2024-04-26T12:36:37.258151+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:27.651607+0000","scrub_duration":0.0086302089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738449,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142980,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228860,"statfs":{"total":96636764160,"available":95466352640,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:36:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.437,"15min":0.441},"min":{"1min":0.41699999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.625,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.373},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.44800000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.39000000000000001}]}]},{"osd":0,"up_from":85,"seq":365072220185,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52660,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319180,"statfs":{"total":96636764160,"available":96582840320,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:36:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.503}]},{"osd":2,"last update":"Fri Apr 26 12:36:02 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.52200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738450,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860676,"statfs":{"total":96636764160,"available":95089332224,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:36:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.377}]},{"osd":2,"last update":"Fri Apr 26 12:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42799999999999999,"15min":0.443},"min":{"1min":0.37,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.35899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.623,"5min":1.137,"15min":1.137},"last":0.64300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:36:59.794 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.794 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.794 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.795 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.795 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.795 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.795 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.795 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.795 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.796 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.796 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.796 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.796 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.796 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.796 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.796 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.797 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.797 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.797 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.797 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.797 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.797 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.797 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.798 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.798 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.798 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.798 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:30:25.764494+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.798 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.798 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.799 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.799 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:36:59.799 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:37:19.800 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:37:20.180 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:37:20.182 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:37:20.193 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-04-26T12:37:19.078304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119344,"ondisk_log_size":119344,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706804,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408716,"statfs":{"total":289910292480,"available":287138525184,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003380"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2096,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:05.467533+0000","last_change":"2024-04-26T12:37:05.467714+0000","last_active":"2024-04-26T12:37:05.467533+0000","last_peered":"2024-04-26T12:37:05.467533+0000","last_clean":"2024-04-26T12:37:05.467533+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:37:05.467533+0000","last_undegraded":"2024-04-26T12:37:05.467533+0000","last_fullsized":"2024-04-26T12:37:05.467533+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:37:05.467471+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:37:05.467471+0000","last_clean_scrub_stamp":"2024-04-26T12:37:05.467471+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.132163+0000","scrub_duration":0.0045153559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:52.167251+0000","last_change":"2024-04-26T12:35:52.167251+0000","last_active":"2024-04-26T12:35:52.167251+0000","last_peered":"2024-04-26T12:35:52.167251+0000","last_clean":"2024-04-26T12:35:52.167251+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:52.167251+0000","last_undegraded":"2024-04-26T12:35:52.167251+0000","last_fullsized":"2024-04-26T12:35:52.167251+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_clean_scrub_stamp":"2024-04-26T12:35:52.167078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.351227+0000","scrub_duration":0.0068001590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4144,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:45.987903+0000","last_change":"2024-04-26T12:35:45.987903+0000","last_active":"2024-04-26T12:35:45.987903+0000","last_peered":"2024-04-26T12:35:45.987903+0000","last_clean":"2024-04-26T12:35:45.987903+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:45.987903+0000","last_undegraded":"2024-04-26T12:35:45.987903+0000","last_fullsized":"2024-04-26T12:35:45.987903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4036","last_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_deep_scrub":"80'4036","last_deep_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_clean_scrub_stamp":"2024-04-26T12:35:45.987680+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:57.838823+0000","scrub_duration":0.014722818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":129,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:51.983250+0000","last_change":"2024-04-26T12:35:51.983250+0000","last_active":"2024-04-26T12:35:51.983250+0000","last_peered":"2024-04-26T12:35:51.983250+0000","last_clean":"2024-04-26T12:35:51.983250+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:51.983250+0000","last_undegraded":"2024-04-26T12:35:51.983250+0000","last_fullsized":"2024-04-26T12:35:51.983250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_clean_scrub_stamp":"2024-04-26T12:35:51.983105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:34.627140+0000","scrub_duration":0.0030895979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2167,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:24.326520+0000","last_change":"2024-04-26T12:36:24.326642+0000","last_active":"2024-04-26T12:36:24.326520+0000","last_peered":"2024-04-26T12:36:24.326520+0000","last_clean":"2024-04-26T12:36:24.326520+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:36:24.326520+0000","last_undegraded":"2024-04-26T12:36:24.326520+0000","last_fullsized":"2024-04-26T12:36:24.326520+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2045","last_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_deep_scrub":"80'2045","last_deep_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_clean_scrub_stamp":"2024-04-26T12:36:24.326492+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:11.354437+0000","scrub_duration":0.011899834999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103322+0000","last_change":"2024-04-26T12:35:28.213656+0000","last_active":"2024-04-26T12:35:35.103322+0000","last_peered":"2024-04-26T12:35:35.103322+0000","last_clean":"2024-04-26T12:35:35.103322+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:35:35.103322+0000","last_undegraded":"2024-04-26T12:35:35.103322+0000","last_fullsized":"2024-04-26T12:35:35.103322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":60,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:35.103311+0000","last_change":"2024-04-26T12:35:28.214278+0000","last_active":"2024-04-26T12:35:35.103311+0000","last_peered":"2024-04-26T12:35:35.103311+0000","last_clean":"2024-04-26T12:35:35.103311+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:35:35.103311+0000","last_undegraded":"2024-04-26T12:35:35.103311+0000","last_fullsized":"2024-04-26T12:35:35.103311+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8217,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.006065+0000","last_change":"2024-04-26T12:35:38.006208+0000","last_active":"2024-04-26T12:35:38.006065+0000","last_peered":"2024-04-26T12:35:38.006065+0000","last_clean":"2024-04-26T12:35:38.006065+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:38.006065+0000","last_undegraded":"2024-04-26T12:35:38.006065+0000","last_fullsized":"2024-04-26T12:35:38.006065+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8077","last_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_deep_scrub":"80'8077","last_deep_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.006040+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:57.036646+0000","scrub_duration":0.014128129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6191,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:10.074475+0000","last_change":"2024-04-26T12:37:10.074606+0000","last_active":"2024-04-26T12:37:10.074475+0000","last_peered":"2024-04-26T12:37:10.074475+0000","last_clean":"2024-04-26T12:37:10.074475+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:37:10.074475+0000","last_undegraded":"2024-04-26T12:37:10.074475+0000","last_fullsized":"2024-04-26T12:37:10.074475+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6081","last_scrub_stamp":"2024-04-26T12:37:10.074452+0000","last_deep_scrub":"80'6081","last_deep_scrub_stamp":"2024-04-26T12:37:10.074452+0000","last_clean_scrub_stamp":"2024-04-26T12:37:10.074452+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:26.460625+0000","scrub_duration":0.010833512,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6252,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.280808+0000","last_change":"2024-04-26T12:35:49.280948+0000","last_active":"2024-04-26T12:35:49.280808+0000","last_peered":"2024-04-26T12:35:49.280808+0000","last_clean":"2024-04-26T12:35:49.280808+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:49.280808+0000","last_undegraded":"2024-04-26T12:35:49.280808+0000","last_fullsized":"2024-04-26T12:35:49.280808+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6120","last_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_deep_scrub":"80'6120","last_deep_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.280781+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:12.424132+0000","scrub_duration":0.01226383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4080,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102734+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:30.102734+0000","last_peered":"2024-04-26T12:35:30.102734+0000","last_clean":"2024-04-26T12:35:30.102734+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:30.102734+0000","last_undegraded":"2024-04-26T12:35:30.102734+0000","last_fullsized":"2024-04-26T12:35:30.102734+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.138480+0000","last_change":"2024-04-26T12:35:56.138597+0000","last_active":"2024-04-26T12:35:56.138480+0000","last_peered":"2024-04-26T12:35:56.138480+0000","last_clean":"2024-04-26T12:35:56.138480+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:56.138480+0000","last_undegraded":"2024-04-26T12:35:56.138480+0000","last_fullsized":"2024-04-26T12:35:56.138480+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2051","last_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_deep_scrub":"80'2051","last_deep_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.138454+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:03.549045+0000","scrub_duration":0.011597293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2150,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.311288+0000","last_change":"2024-04-26T12:36:29.311400+0000","last_active":"2024-04-26T12:36:29.311288+0000","last_peered":"2024-04-26T12:36:29.311288+0000","last_clean":"2024-04-26T12:36:29.311288+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:36:29.311288+0000","last_undegraded":"2024-04-26T12:36:29.311288+0000","last_fullsized":"2024-04-26T12:36:29.311288+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2026","last_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_deep_scrub":"80'2026","last_deep_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.311261+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:55.733965+0000","scrub_duration":0.0058874599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2159,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:57.048226+0000","last_change":"2024-04-26T12:35:57.048340+0000","last_active":"2024-04-26T12:35:57.048226+0000","last_peered":"2024-04-26T12:35:57.048226+0000","last_clean":"2024-04-26T12:35:57.048226+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:57.048226+0000","last_undegraded":"2024-04-26T12:35:57.048226+0000","last_fullsized":"2024-04-26T12:35:57.048226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2052","last_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_deep_scrub":"80'2052","last_deep_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_clean_scrub_stamp":"2024-04-26T12:35:57.048199+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:27.456428+0000","scrub_duration":0.016047618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2178,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:01.108264+0000","last_change":"2024-04-26T12:36:01.108416+0000","last_active":"2024-04-26T12:36:01.108264+0000","last_peered":"2024-04-26T12:36:01.108264+0000","last_clean":"2024-04-26T12:36:01.108264+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:36:01.108264+0000","last_undegraded":"2024-04-26T12:36:01.108264+0000","last_fullsized":"2024-04-26T12:36:01.108264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2071","last_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_deep_scrub":"80'2071","last_deep_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_clean_scrub_stamp":"2024-04-26T12:36:01.108240+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:16.539046+0000","scrub_duration":0.014518568000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102574+0000","last_change":"2024-04-26T12:35:28.214763+0000","last_active":"2024-04-26T12:35:30.102574+0000","last_peered":"2024-04-26T12:35:30.102574+0000","last_clean":"2024-04-26T12:35:30.102574+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:35:30.102574+0000","last_undegraded":"2024-04-26T12:35:30.102574+0000","last_fullsized":"2024-04-26T12:35:30.102574+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2130,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:13.050318+0000","last_change":"2024-04-26T12:37:13.050459+0000","last_active":"2024-04-26T12:37:13.050318+0000","last_peered":"2024-04-26T12:37:13.050318+0000","last_clean":"2024-04-26T12:37:13.050318+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:37:13.050318+0000","last_undegraded":"2024-04-26T12:37:13.050318+0000","last_fullsized":"2024-04-26T12:37:13.050318+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2015","last_scrub_stamp":"2024-04-26T12:37:13.050294+0000","last_deep_scrub":"80'2015","last_deep_scrub_stamp":"2024-04-26T12:37:13.050294+0000","last_clean_scrub_stamp":"2024-04-26T12:37:13.050294+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:52.328160+0000","scrub_duration":0.0048918870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2141,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223130+0000","last_change":"2024-04-26T12:35:26.171317+0000","last_active":"2024-04-26T12:35:29.223130+0000","last_peered":"2024-04-26T12:35:29.223130+0000","last_clean":"2024-04-26T12:35:29.223130+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:35:29.223130+0000","last_undegraded":"2024-04-26T12:35:29.223130+0000","last_fullsized":"2024-04-26T12:35:29.223130+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:11.051825+0000","last_change":"2024-04-26T12:37:11.051825+0000","last_active":"2024-04-26T12:37:11.051825+0000","last_peered":"2024-04-26T12:37:11.051825+0000","last_clean":"2024-04-26T12:37:11.051825+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:37:11.051825+0000","last_undegraded":"2024-04-26T12:37:11.051825+0000","last_fullsized":"2024-04-26T12:37:11.051825+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3996","last_scrub_stamp":"2024-04-26T12:37:11.051664+0000","last_deep_scrub":"80'3996","last_deep_scrub_stamp":"2024-04-26T12:37:11.051664+0000","last_clean_scrub_stamp":"2024-04-26T12:37:11.051664+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:33.819537+0000","scrub_duration":0.0080050139999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4234,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:16.031374+0000","last_change":"2024-04-26T12:36:16.031481+0000","last_active":"2024-04-26T12:36:16.031374+0000","last_peered":"2024-04-26T12:36:16.031374+0000","last_clean":"2024-04-26T12:36:16.031374+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:36:16.031374+0000","last_undegraded":"2024-04-26T12:36:16.031374+0000","last_fullsized":"2024-04-26T12:36:16.031374+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4103","last_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_deep_scrub":"80'4103","last_deep_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_clean_scrub_stamp":"2024-04-26T12:36:16.031346+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:35.734914+0000","scrub_duration":0.0054779479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":131,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:12.202815+0000","last_change":"2024-04-26T12:37:12.202975+0000","last_active":"2024-04-26T12:37:12.202815+0000","last_peered":"2024-04-26T12:37:12.202815+0000","last_clean":"2024-04-26T12:37:12.202815+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:37:12.202815+0000","last_undegraded":"2024-04-26T12:37:12.202815+0000","last_fullsized":"2024-04-26T12:37:12.202815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'11","last_scrub_stamp":"2024-04-26T12:37:12.202785+0000","last_deep_scrub":"80'11","last_deep_scrub_stamp":"2024-04-26T12:37:12.202785+0000","last_clean_scrub_stamp":"2024-04-26T12:37:12.202785+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:39.672705+0000","scrub_duration":0.0071294280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2128,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:40.305677+0000","last_change":"2024-04-26T12:36:40.305800+0000","last_active":"2024-04-26T12:36:40.305677+0000","last_peered":"2024-04-26T12:36:40.305677+0000","last_clean":"2024-04-26T12:36:40.305677+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:36:40.305677+0000","last_undegraded":"2024-04-26T12:36:40.305677+0000","last_fullsized":"2024-04-26T12:36:40.305677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2023","last_scrub_stamp":"2024-04-26T12:36:40.305650+0000","last_deep_scrub":"80'2023","last_deep_scrub_stamp":"2024-04-26T12:36:40.305650+0000","last_clean_scrub_stamp":"2024-04-26T12:36:40.305650+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:59.028356+0000","scrub_duration":0.019539554000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:06.069235+0000","last_change":"2024-04-26T12:37:06.069235+0000","last_active":"2024-04-26T12:37:06.069235+0000","last_peered":"2024-04-26T12:37:06.069235+0000","last_clean":"2024-04-26T12:37:06.069235+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:37:06.069235+0000","last_undegraded":"2024-04-26T12:37:06.069235+0000","last_fullsized":"2024-04-26T12:37:06.069235+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1995","last_scrub_stamp":"2024-04-26T12:37:06.069104+0000","last_deep_scrub":"80'1995","last_deep_scrub_stamp":"2024-04-26T12:37:06.069104+0000","last_clean_scrub_stamp":"2024-04-26T12:37:06.069104+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:53.097688+0000","scrub_duration":0.0079981329999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4152,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:03.189097+0000","last_change":"2024-04-26T12:36:03.189097+0000","last_active":"2024-04-26T12:36:03.189097+0000","last_peered":"2024-04-26T12:36:03.189097+0000","last_clean":"2024-04-26T12:36:03.189097+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:36:03.189097+0000","last_undegraded":"2024-04-26T12:36:03.189097+0000","last_fullsized":"2024-04-26T12:36:03.189097+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4067","last_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_deep_scrub":"80'4067","last_deep_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_clean_scrub_stamp":"2024-04-26T12:36:03.188951+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:22.219557+0000","scrub_duration":0.013814754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2153,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.127431+0000","last_change":"2024-04-26T12:35:59.127545+0000","last_active":"2024-04-26T12:35:59.127431+0000","last_peered":"2024-04-26T12:35:59.127431+0000","last_clean":"2024-04-26T12:35:59.127431+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:59.127431+0000","last_undegraded":"2024-04-26T12:35:59.127431+0000","last_fullsized":"2024-04-26T12:35:59.127431+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2053","last_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_deep_scrub":"80'2053","last_deep_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.127404+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:55.177992+0000","scrub_duration":0.018465079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.893816+0000","last_change":"2024-04-26T12:36:17.893816+0000","last_active":"2024-04-26T12:36:17.893816+0000","last_peered":"2024-04-26T12:36:17.893816+0000","last_clean":"2024-04-26T12:36:17.893816+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:36:17.893816+0000","last_undegraded":"2024-04-26T12:36:17.893816+0000","last_fullsized":"2024-04-26T12:36:17.893816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.893660+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:02.255600+0000","scrub_duration":0.0081512219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2114,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.999776+0000","last_change":"2024-04-26T12:35:49.999776+0000","last_active":"2024-04-26T12:35:49.999776+0000","last_peered":"2024-04-26T12:35:49.999776+0000","last_clean":"2024-04-26T12:35:49.999776+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:49.999776+0000","last_undegraded":"2024-04-26T12:35:49.999776+0000","last_fullsized":"2024-04-26T12:35:49.999776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2006","last_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_deep_scrub":"80'2006","last_deep_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.999571+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:58.313518+0000","scrub_duration":0.012700795000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:47.311342+0000","last_change":"2024-04-26T12:36:47.311461+0000","last_active":"2024-04-26T12:36:47.311342+0000","last_peered":"2024-04-26T12:36:47.311342+0000","last_clean":"2024-04-26T12:36:47.311342+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:36:47.311342+0000","last_undegraded":"2024-04-26T12:36:47.311342+0000","last_fullsized":"2024-04-26T12:36:47.311342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:36:47.311317+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:36:47.311317+0000","last_clean_scrub_stamp":"2024-04-26T12:36:47.311317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:34.018306+0000","scrub_duration":0.002254729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.161522+0000","last_change":"2024-04-26T12:35:38.161638+0000","last_active":"2024-04-26T12:35:38.161522+0000","last_peered":"2024-04-26T12:35:38.161522+0000","last_clean":"2024-04-26T12:35:38.161522+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:38.161522+0000","last_undegraded":"2024-04-26T12:35:38.161522+0000","last_fullsized":"2024-04-26T12:35:38.161522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.161494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:19.249824+0000","scrub_duration":0.014847795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:35.181585+0000","last_change":"2024-04-26T12:36:35.181718+0000","last_active":"2024-04-26T12:36:35.181585+0000","last_peered":"2024-04-26T12:36:35.181585+0000","last_clean":"2024-04-26T12:36:35.181585+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:36:35.181585+0000","last_undegraded":"2024-04-26T12:36:35.181585+0000","last_fullsized":"2024-04-26T12:36:35.181585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_clean_scrub_stamp":"2024-04-26T12:36:35.181561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:15.742099+0000","scrub_duration":0.0020050630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.946252+0000","last_change":"2024-04-26T12:36:07.946252+0000","last_active":"2024-04-26T12:36:07.946252+0000","last_peered":"2024-04-26T12:36:07.946252+0000","last_clean":"2024-04-26T12:36:07.946252+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:36:07.946252+0000","last_undegraded":"2024-04-26T12:36:07.946252+0000","last_fullsized":"2024-04-26T12:36:07.946252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.946106+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:15.251311+0000","scrub_duration":0.0085133599999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:30.077762+0000","last_change":"2024-04-26T12:36:30.077900+0000","last_active":"2024-04-26T12:36:30.077762+0000","last_peered":"2024-04-26T12:36:30.077762+0000","last_clean":"2024-04-26T12:36:30.077762+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:36:30.077762+0000","last_undegraded":"2024-04-26T12:36:30.077762+0000","last_fullsized":"2024-04-26T12:36:30.077762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_clean_scrub_stamp":"2024-04-26T12:36:30.077735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:09.005584+0000","scrub_duration":0.0019678730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":58,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223197+0000","last_change":"2024-04-26T12:35:26.168703+0000","last_active":"2024-04-26T12:35:29.223197+0000","last_peered":"2024-04-26T12:35:29.223197+0000","last_clean":"2024-04-26T12:35:29.223197+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:35:29.223197+0000","last_undegraded":"2024-04-26T12:35:29.223197+0000","last_fullsized":"2024-04-26T12:35:29.223197+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:58.133514+0000","last_change":"2024-04-26T12:36:58.133655+0000","last_active":"2024-04-26T12:36:58.133514+0000","last_peered":"2024-04-26T12:36:58.133514+0000","last_clean":"2024-04-26T12:36:58.133514+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:36:58.133514+0000","last_undegraded":"2024-04-26T12:36:58.133514+0000","last_fullsized":"2024-04-26T12:36:58.133514+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'1","last_scrub_stamp":"2024-04-26T12:36:58.133490+0000","last_deep_scrub":"79'1","last_deep_scrub_stamp":"2024-04-26T12:36:58.133490+0000","last_clean_scrub_stamp":"2024-04-26T12:36:58.133490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:43.786311+0000","scrub_duration":0.00167731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:46.789110+0000","last_change":"2024-04-26T12:35:46.789233+0000","last_active":"2024-04-26T12:35:46.789110+0000","last_peered":"2024-04-26T12:35:46.789110+0000","last_clean":"2024-04-26T12:35:46.789110+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:46.789110+0000","last_undegraded":"2024-04-26T12:35:46.789110+0000","last_fullsized":"2024-04-26T12:35:46.789110+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_clean_scrub_stamp":"2024-04-26T12:35:46.789065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:51.542684+0000","scrub_duration":0.010829827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":56,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102784+0000","last_change":"2024-04-26T12:35:28.213770+0000","last_active":"2024-04-26T12:35:30.102784+0000","last_peered":"2024-04-26T12:35:30.102784+0000","last_clean":"2024-04-26T12:35:30.102784+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:35:30.102784+0000","last_undegraded":"2024-04-26T12:35:30.102784+0000","last_fullsized":"2024-04-26T12:35:30.102784+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6194,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:07.037540+0000","last_change":"2024-04-26T12:37:07.037664+0000","last_active":"2024-04-26T12:37:07.037540+0000","last_peered":"2024-04-26T12:37:07.037540+0000","last_clean":"2024-04-26T12:37:07.037540+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:37:07.037540+0000","last_undegraded":"2024-04-26T12:37:07.037540+0000","last_fullsized":"2024-04-26T12:37:07.037540+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6064","last_scrub_stamp":"2024-04-26T12:37:07.037516+0000","last_deep_scrub":"80'6064","last_deep_scrub_stamp":"2024-04-26T12:37:07.037516+0000","last_clean_scrub_stamp":"2024-04-26T12:37:07.037516+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:16.565817+0000","scrub_duration":0.011608321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"98'8","reported_seq":75,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:14.620457+0000","last_change":"2024-04-26T12:37:14.620563+0000","last_active":"2024-04-26T12:37:14.620457+0000","last_peered":"2024-04-26T12:37:14.620457+0000","last_clean":"2024-04-26T12:37:14.620457+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:37:14.620457+0000","last_undegraded":"2024-04-26T12:37:14.620457+0000","last_fullsized":"2024-04-26T12:37:14.620457+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'8","last_scrub_stamp":"2024-04-26T12:37:14.620431+0000","last_deep_scrub":"98'8","last_deep_scrub_stamp":"2024-04-26T12:37:14.620431+0000","last_clean_scrub_stamp":"2024-04-26T12:37:14.620431+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:18.798832+0000","scrub_duration":0.0042118800000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4174,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:42.691761+0000","last_change":"2024-04-26T12:35:42.691943+0000","last_active":"2024-04-26T12:35:42.691761+0000","last_peered":"2024-04-26T12:35:42.691761+0000","last_clean":"2024-04-26T12:35:42.691761+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:42.691761+0000","last_undegraded":"2024-04-26T12:35:42.691761+0000","last_fullsized":"2024-04-26T12:35:42.691761+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4058","last_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_deep_scrub":"80'4058","last_deep_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_clean_scrub_stamp":"2024-04-26T12:35:42.691721+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:59.851784+0000","scrub_duration":0.010224120999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"98'100","reported_seq":208,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.932551+0000","last_change":"2024-04-26T12:36:41.932662+0000","last_active":"2024-04-26T12:36:41.932551+0000","last_peered":"2024-04-26T12:36:41.932551+0000","last_clean":"2024-04-26T12:36:41.932551+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:36:41.932551+0000","last_undegraded":"2024-04-26T12:36:41.932551+0000","last_fullsized":"2024-04-26T12:36:41.932551+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'100","last_scrub_stamp":"2024-04-26T12:36:41.932523+0000","last_deep_scrub":"98'100","last_deep_scrub_stamp":"2024-04-26T12:36:41.932523+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.932523+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:04.155704+0000","scrub_duration":0.0057948440000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4201,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.099299+0000","last_change":"2024-04-26T12:35:59.099460+0000","last_active":"2024-04-26T12:35:59.099299+0000","last_peered":"2024-04-26T12:35:59.099299+0000","last_clean":"2024-04-26T12:35:59.099299+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:59.099299+0000","last_undegraded":"2024-04-26T12:35:59.099299+0000","last_fullsized":"2024-04-26T12:35:59.099299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4094","last_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_deep_scrub":"80'4094","last_deep_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.099256+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:46.127201+0000","scrub_duration":0.013902207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"98'4","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:10.954307+0000","last_change":"2024-04-26T12:36:10.954415+0000","last_active":"2024-04-26T12:36:10.954307+0000","last_peered":"2024-04-26T12:36:10.954307+0000","last_clean":"2024-04-26T12:36:10.954307+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:36:10.954307+0000","last_undegraded":"2024-04-26T12:36:10.954307+0000","last_fullsized":"2024-04-26T12:36:10.954307+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_clean_scrub_stamp":"2024-04-26T12:36:10.954281+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:30.939529+0000","scrub_duration":0.0038576499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2093,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.082461+0000","last_change":"2024-04-26T12:36:00.082579+0000","last_active":"2024-04-26T12:36:00.082461+0000","last_peered":"2024-04-26T12:36:00.082461+0000","last_clean":"2024-04-26T12:36:00.082461+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:36:00.082461+0000","last_undegraded":"2024-04-26T12:36:00.082461+0000","last_fullsized":"2024-04-26T12:36:00.082461+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1968","last_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_deep_scrub":"80'1968","last_deep_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.082433+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.908109+0000","scrub_duration":0.011161457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:51.233837+0000","last_change":"2024-04-26T12:36:51.234006+0000","last_active":"2024-04-26T12:36:51.233837+0000","last_peered":"2024-04-26T12:36:51.233837+0000","last_clean":"2024-04-26T12:36:51.233837+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:36:51.233837+0000","last_undegraded":"2024-04-26T12:36:51.233837+0000","last_fullsized":"2024-04-26T12:36:51.233837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:51.233800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:51.233800+0000","last_clean_scrub_stamp":"2024-04-26T12:36:51.233800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:27.209478+0000","scrub_duration":0.0021296700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2079,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223191+0000","last_change":"2024-04-26T12:35:26.166066+0000","last_active":"2024-04-26T12:35:29.223191+0000","last_peered":"2024-04-26T12:35:29.223191+0000","last_clean":"2024-04-26T12:35:29.223191+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:35:29.223191+0000","last_undegraded":"2024-04-26T12:35:29.223191+0000","last_fullsized":"2024-04-26T12:35:29.223191+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.344225+0000","last_change":"2024-04-26T12:36:17.344357+0000","last_active":"2024-04-26T12:36:17.344225+0000","last_peered":"2024-04-26T12:36:17.344225+0000","last_clean":"2024-04-26T12:36:17.344225+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:36:17.344225+0000","last_undegraded":"2024-04-26T12:36:17.344225+0000","last_fullsized":"2024-04-26T12:36:17.344225+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.344200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:59.988235+0000","scrub_duration":0.0016444610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:23.003025+0000","last_change":"2024-04-26T12:36:23.003182+0000","last_active":"2024-04-26T12:36:23.003025+0000","last_peered":"2024-04-26T12:36:23.003025+0000","last_clean":"2024-04-26T12:36:23.003025+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:36:23.003025+0000","last_undegraded":"2024-04-26T12:36:23.003025+0000","last_fullsized":"2024-04-26T12:36:23.003025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_clean_scrub_stamp":"2024-04-26T12:36:23.002980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:24.050905+0000","scrub_duration":0.008324517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"98'13","reported_seq":121,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:03.245497+0000","last_change":"2024-04-26T12:37:03.245630+0000","last_active":"2024-04-26T12:37:03.245497+0000","last_peered":"2024-04-26T12:37:03.245497+0000","last_clean":"2024-04-26T12:37:03.245497+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:37:03.245497+0000","last_undegraded":"2024-04-26T12:37:03.245497+0000","last_fullsized":"2024-04-26T12:37:03.245497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'13","last_scrub_stamp":"2024-04-26T12:37:03.245471+0000","last_deep_scrub":"98'13","last_deep_scrub_stamp":"2024-04-26T12:37:03.245471+0000","last_clean_scrub_stamp":"2024-04-26T12:37:03.245471+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:34.822704+0000","scrub_duration":0.0049500450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.227218+0000","last_change":"2024-04-26T12:35:06.903189+0000","last_active":"2024-04-26T12:35:29.227218+0000","last_peered":"2024-04-26T12:35:29.227218+0000","last_clean":"2024-04-26T12:35:29.227218+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:35:29.227218+0000","last_undegraded":"2024-04-26T12:35:29.227218+0000","last_fullsized":"2024-04-26T12:35:29.227218+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"98'2","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:34.866882+0000","last_change":"2024-04-26T12:36:34.867018+0000","last_active":"2024-04-26T12:36:34.866882+0000","last_peered":"2024-04-26T12:36:34.866882+0000","last_clean":"2024-04-26T12:36:34.866882+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:36:34.866882+0000","last_undegraded":"2024-04-26T12:36:34.866882+0000","last_fullsized":"2024-04-26T12:36:34.866882+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_clean_scrub_stamp":"2024-04-26T12:36:34.866855+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:44.780097+0000","scrub_duration":0.0056431429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:00.345336+0000","last_change":"2024-04-26T12:37:00.345450+0000","last_active":"2024-04-26T12:37:00.345336+0000","last_peered":"2024-04-26T12:37:00.345336+0000","last_clean":"2024-04-26T12:37:00.345336+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:37:00.345336+0000","last_undegraded":"2024-04-26T12:37:00.345336+0000","last_fullsized":"2024-04-26T12:37:00.345336+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2055","last_scrub_stamp":"2024-04-26T12:37:00.345311+0000","last_deep_scrub":"80'2055","last_deep_scrub_stamp":"2024-04-26T12:37:00.345311+0000","last_clean_scrub_stamp":"2024-04-26T12:37:00.345311+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:10.258554+0000","scrub_duration":0.015153711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"98'3","reported_seq":109,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:35.331048+0000","last_change":"2024-04-26T12:36:35.331158+0000","last_active":"2024-04-26T12:36:35.331048+0000","last_peered":"2024-04-26T12:36:35.331048+0000","last_clean":"2024-04-26T12:36:35.331048+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:36:35.331048+0000","last_undegraded":"2024-04-26T12:36:35.331048+0000","last_fullsized":"2024-04-26T12:36:35.331048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:35.331023+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:35.331023+0000","last_clean_scrub_stamp":"2024-04-26T12:36:35.331023+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:30.228403+0000","scrub_duration":0.0034488190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":98,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:40.209064+0000","last_change":"2024-04-26T12:35:40.209064+0000","last_active":"2024-04-26T12:35:40.209064+0000","last_peered":"2024-04-26T12:35:40.209064+0000","last_clean":"2024-04-26T12:35:40.209064+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:40.209064+0000","last_undegraded":"2024-04-26T12:35:40.209064+0000","last_fullsized":"2024-04-26T12:35:40.209064+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_clean_scrub_stamp":"2024-04-26T12:35:40.208887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:37.520324+0000","scrub_duration":0.016687707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":31,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102753+0000","last_change":"2024-04-26T12:35:28.214279+0000","last_active":"2024-04-26T12:35:30.102753+0000","last_peered":"2024-04-26T12:35:30.102753+0000","last_clean":"2024-04-26T12:35:30.102753+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:35:30.102753+0000","last_undegraded":"2024-04-26T12:35:30.102753+0000","last_fullsized":"2024-04-26T12:35:30.102753+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:39.969333+0000","last_change":"2024-04-26T12:36:39.969333+0000","last_active":"2024-04-26T12:36:39.969333+0000","last_peered":"2024-04-26T12:36:39.969333+0000","last_clean":"2024-04-26T12:36:39.969333+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:36:39.969333+0000","last_undegraded":"2024-04-26T12:36:39.969333+0000","last_fullsized":"2024-04-26T12:36:39.969333+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1991","last_scrub_stamp":"2024-04-26T12:36:39.969173+0000","last_deep_scrub":"80'1991","last_deep_scrub_stamp":"2024-04-26T12:36:39.969173+0000","last_clean_scrub_stamp":"2024-04-26T12:36:39.969173+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.633864+0000","scrub_duration":0.011084973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":121,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.982136+0000","last_change":"2024-04-26T12:36:14.982242+0000","last_active":"2024-04-26T12:36:14.982136+0000","last_peered":"2024-04-26T12:36:14.982136+0000","last_clean":"2024-04-26T12:36:14.982136+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:36:14.982136+0000","last_undegraded":"2024-04-26T12:36:14.982136+0000","last_fullsized":"2024-04-26T12:36:14.982136+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.982103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.704809+0000","scrub_duration":0.0018977480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:20.998503+0000","last_change":"2024-04-26T12:36:20.998503+0000","last_active":"2024-04-26T12:36:20.998503+0000","last_peered":"2024-04-26T12:36:20.998503+0000","last_clean":"2024-04-26T12:36:20.998503+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:36:20.998503+0000","last_undegraded":"2024-04-26T12:36:20.998503+0000","last_fullsized":"2024-04-26T12:36:20.998503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_clean_scrub_stamp":"2024-04-26T12:36:20.998357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.004150+0000","scrub_duration":0.0052206129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:37.185388+0000","last_change":"2024-04-26T12:36:37.185388+0000","last_active":"2024-04-26T12:36:37.185388+0000","last_peered":"2024-04-26T12:36:37.185388+0000","last_clean":"2024-04-26T12:36:37.185388+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:36:37.185388+0000","last_undegraded":"2024-04-26T12:36:37.185388+0000","last_fullsized":"2024-04-26T12:36:37.185388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:37.185231+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:37.185231+0000","last_clean_scrub_stamp":"2024-04-26T12:36:37.185231+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:12.684695+0000","scrub_duration":0.0035423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.017218+0000","last_change":"2024-04-26T12:35:56.017326+0000","last_active":"2024-04-26T12:35:56.017218+0000","last_peered":"2024-04-26T12:35:56.017218+0000","last_clean":"2024-04-26T12:35:56.017218+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:56.017218+0000","last_undegraded":"2024-04-26T12:35:56.017218+0000","last_fullsized":"2024-04-26T12:35:56.017218+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1980","last_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_deep_scrub":"80'1980","last_deep_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.017191+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:19.910231+0000","scrub_duration":0.0081651450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:02.197971+0000","last_change":"2024-04-26T12:37:02.197971+0000","last_active":"2024-04-26T12:37:02.197971+0000","last_peered":"2024-04-26T12:37:02.197971+0000","last_clean":"2024-04-26T12:37:02.197971+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:37:02.197971+0000","last_undegraded":"2024-04-26T12:37:02.197971+0000","last_fullsized":"2024-04-26T12:37:02.197971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:37:02.197804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:37:02.197804+0000","last_clean_scrub_stamp":"2024-04-26T12:37:02.197804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:29.596636+0000","scrub_duration":0.0016879169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2146,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:04.058960+0000","last_change":"2024-04-26T12:36:04.059101+0000","last_active":"2024-04-26T12:36:04.058960+0000","last_peered":"2024-04-26T12:36:04.058960+0000","last_clean":"2024-04-26T12:36:04.058960+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:36:04.058960+0000","last_undegraded":"2024-04-26T12:36:04.058960+0000","last_fullsized":"2024-04-26T12:36:04.058960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2039","last_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_deep_scrub":"80'2039","last_deep_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_clean_scrub_stamp":"2024-04-26T12:36:04.058924+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:30.481629+0000","scrub_duration":0.012146647999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.322623+0000","last_change":"2024-04-26T12:36:41.322735+0000","last_active":"2024-04-26T12:36:41.322623+0000","last_peered":"2024-04-26T12:36:41.322623+0000","last_clean":"2024-04-26T12:36:41.322623+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:36:41.322623+0000","last_undegraded":"2024-04-26T12:36:41.322623+0000","last_fullsized":"2024-04-26T12:36:41.322623+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:41.322599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:41.322599+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.322599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:01.026167+0000","scrub_duration":0.0017738890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2172,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.984844+0000","last_change":"2024-04-26T12:36:09.984957+0000","last_active":"2024-04-26T12:36:09.984844+0000","last_peered":"2024-04-26T12:36:09.984844+0000","last_clean":"2024-04-26T12:36:09.984844+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:36:09.984844+0000","last_undegraded":"2024-04-26T12:36:09.984844+0000","last_fullsized":"2024-04-26T12:36:09.984844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2065","last_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_deep_scrub":"80'2065","last_deep_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.984820+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:04.882200+0000","scrub_duration":0.013017881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.285733+0000","last_change":"2024-04-26T12:36:14.285733+0000","last_active":"2024-04-26T12:36:14.285733+0000","last_peered":"2024-04-26T12:36:14.285733+0000","last_clean":"2024-04-26T12:36:14.285733+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:36:14.285733+0000","last_undegraded":"2024-04-26T12:36:14.285733+0000","last_fullsized":"2024-04-26T12:36:14.285733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.285570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:22.599518+0000","scrub_duration":0.0020305150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:12.085358+0000","last_change":"2024-04-26T12:37:12.085358+0000","last_active":"2024-04-26T12:37:12.085358+0000","last_peered":"2024-04-26T12:37:12.085358+0000","last_clean":"2024-04-26T12:37:12.085358+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:37:12.085358+0000","last_undegraded":"2024-04-26T12:37:12.085358+0000","last_fullsized":"2024-04-26T12:37:12.085358+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6083","last_scrub_stamp":"2024-04-26T12:37:12.085213+0000","last_deep_scrub":"80'6083","last_deep_scrub_stamp":"2024-04-26T12:37:12.085213+0000","last_clean_scrub_stamp":"2024-04-26T12:37:12.085213+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:20.355830+0000","scrub_duration":0.010905646999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:54.828732+0000","last_change":"2024-04-26T12:35:54.828732+0000","last_active":"2024-04-26T12:35:54.828732+0000","last_peered":"2024-04-26T12:35:54.828732+0000","last_clean":"2024-04-26T12:35:54.828732+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:54.828732+0000","last_undegraded":"2024-04-26T12:35:54.828732+0000","last_fullsized":"2024-04-26T12:35:54.828732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_clean_scrub_stamp":"2024-04-26T12:35:54.828605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:29.226278+0000","scrub_duration":0.001515267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.033778+0000","last_change":"2024-04-26T12:36:22.033778+0000","last_active":"2024-04-26T12:36:22.033778+0000","last_peered":"2024-04-26T12:36:22.033778+0000","last_clean":"2024-04-26T12:36:22.033778+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:36:22.033778+0000","last_undegraded":"2024-04-26T12:36:22.033778+0000","last_fullsized":"2024-04-26T12:36:22.033778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.033620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:08.740609+0000","scrub_duration":0.0020642659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:21.254921+0000","last_change":"2024-04-26T12:36:21.255056+0000","last_active":"2024-04-26T12:36:21.254921+0000","last_peered":"2024-04-26T12:36:21.254921+0000","last_clean":"2024-04-26T12:36:21.254921+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:36:21.254921+0000","last_undegraded":"2024-04-26T12:36:21.254921+0000","last_fullsized":"2024-04-26T12:36:21.254921+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_clean_scrub_stamp":"2024-04-26T12:36:21.254895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:45.147934+0000","scrub_duration":0.0093846899999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:54.092774+0000","last_change":"2024-04-26T12:36:54.092893+0000","last_active":"2024-04-26T12:36:54.092774+0000","last_peered":"2024-04-26T12:36:54.092774+0000","last_clean":"2024-04-26T12:36:54.092774+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:36:54.092774+0000","last_undegraded":"2024-04-26T12:36:54.092774+0000","last_fullsized":"2024-04-26T12:36:54.092774+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:54.092735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:54.092735+0000","last_clean_scrub_stamp":"2024-04-26T12:36:54.092735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:40.809083+0000","scrub_duration":0.001976303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:06.197816+0000","last_change":"2024-04-26T12:37:06.197958+0000","last_active":"2024-04-26T12:37:06.197816+0000","last_peered":"2024-04-26T12:37:06.197816+0000","last_clean":"2024-04-26T12:37:06.197816+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:37:06.197816+0000","last_undegraded":"2024-04-26T12:37:06.197816+0000","last_fullsized":"2024-04-26T12:37:06.197816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:37:06.197792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:37:06.197792+0000","last_clean_scrub_stamp":"2024-04-26T12:37:06.197792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:02.633118+0000","scrub_duration":0.0019428410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:49.289630+0000","last_change":"2024-04-26T12:36:49.289630+0000","last_active":"2024-04-26T12:36:49.289630+0000","last_peered":"2024-04-26T12:36:49.289630+0000","last_clean":"2024-04-26T12:36:49.289630+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:36:49.289630+0000","last_undegraded":"2024-04-26T12:36:49.289630+0000","last_fullsized":"2024-04-26T12:36:49.289630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:49.289463+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:49.289463+0000","last_clean_scrub_stamp":"2024-04-26T12:36:49.289463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:56.753704+0000","scrub_duration":0.0072399329999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.903484+0000","last_change":"2024-04-26T12:36:14.903484+0000","last_active":"2024-04-26T12:36:14.903484+0000","last_peered":"2024-04-26T12:36:14.903484+0000","last_clean":"2024-04-26T12:36:14.903484+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:36:14.903484+0000","last_undegraded":"2024-04-26T12:36:14.903484+0000","last_fullsized":"2024-04-26T12:36:14.903484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.903354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:16.770079+0000","scrub_duration":0.0017945649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:31.324893+0000","last_change":"2024-04-26T12:36:31.324893+0000","last_active":"2024-04-26T12:36:31.324893+0000","last_peered":"2024-04-26T12:36:31.324893+0000","last_clean":"2024-04-26T12:36:31.324893+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:36:31.324893+0000","last_undegraded":"2024-04-26T12:36:31.324893+0000","last_fullsized":"2024-04-26T12:36:31.324893+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_clean_scrub_stamp":"2024-04-26T12:36:31.324737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:42.977856+0000","scrub_duration":0.0020696540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:25.039601+0000","last_change":"2024-04-26T12:36:25.039601+0000","last_active":"2024-04-26T12:36:25.039601+0000","last_peered":"2024-04-26T12:36:25.039601+0000","last_clean":"2024-04-26T12:36:25.039601+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:36:25.039601+0000","last_undegraded":"2024-04-26T12:36:25.039601+0000","last_fullsized":"2024-04-26T12:36:25.039601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_clean_scrub_stamp":"2024-04-26T12:36:25.039404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:58.902069+0000","scrub_duration":0.0099267869999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:58.126359+0000","last_change":"2024-04-26T12:36:58.126508+0000","last_active":"2024-04-26T12:36:58.126359+0000","last_peered":"2024-04-26T12:36:58.126359+0000","last_clean":"2024-04-26T12:36:58.126359+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:36:58.126359+0000","last_undegraded":"2024-04-26T12:36:58.126359+0000","last_fullsized":"2024-04-26T12:36:58.126359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:58.126323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:58.126323+0000","last_clean_scrub_stamp":"2024-04-26T12:36:58.126323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:08.517108+0000","scrub_duration":0.002073723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"98'159","reported_seq":310,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:48.982871+0000","last_change":"2024-04-26T12:36:48.982998+0000","last_active":"2024-04-26T12:36:48.982871+0000","last_peered":"2024-04-26T12:36:48.982871+0000","last_clean":"2024-04-26T12:36:48.982871+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:36:48.982871+0000","last_undegraded":"2024-04-26T12:36:48.982871+0000","last_fullsized":"2024-04-26T12:36:48.982871+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'159","last_scrub_stamp":"2024-04-26T12:36:48.982845+0000","last_deep_scrub":"98'159","last_deep_scrub_stamp":"2024-04-26T12:36:48.982845+0000","last_clean_scrub_stamp":"2024-04-26T12:36:48.982845+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:53.161246+0000","scrub_duration":0.0049176230000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.886361+0000","last_change":"2024-04-26T12:36:00.886361+0000","last_active":"2024-04-26T12:36:00.886361+0000","last_peered":"2024-04-26T12:36:00.886361+0000","last_clean":"2024-04-26T12:36:00.886361+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:36:00.886361+0000","last_undegraded":"2024-04-26T12:36:00.886361+0000","last_fullsized":"2024-04-26T12:36:00.886361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.886200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.777562+0000","scrub_duration":0.0021566559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":85,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:37.734450+0000","last_change":"2024-04-26T12:35:28.214469+0000","last_active":"2024-04-26T12:35:37.734450+0000","last_peered":"2024-04-26T12:35:37.734450+0000","last_clean":"2024-04-26T12:35:37.734450+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:35:37.734450+0000","last_undegraded":"2024-04-26T12:35:37.734450+0000","last_fullsized":"2024-04-26T12:35:37.734450+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:59.165931+0000","last_change":"2024-04-26T12:36:59.166091+0000","last_active":"2024-04-26T12:36:59.165931+0000","last_peered":"2024-04-26T12:36:59.165931+0000","last_clean":"2024-04-26T12:36:59.165931+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:36:59.165931+0000","last_undegraded":"2024-04-26T12:36:59.165931+0000","last_fullsized":"2024-04-26T12:36:59.165931+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:59.165894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:59.165894+0000","last_clean_scrub_stamp":"2024-04-26T12:36:59.165894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:16.495623+0000","scrub_duration":0.001857247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"98'4","reported_seq":91,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.833616+0000","last_change":"2024-04-26T12:35:55.833616+0000","last_active":"2024-04-26T12:35:55.833616+0000","last_peered":"2024-04-26T12:35:55.833616+0000","last_clean":"2024-04-26T12:35:55.833616+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:55.833616+0000","last_undegraded":"2024-04-26T12:35:55.833616+0000","last_fullsized":"2024-04-26T12:35:55.833616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.833451+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:41.021792+0000","scrub_duration":0.003578328,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8102,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:07.544773+0000","last_change":"2024-04-26T12:37:07.544924+0000","last_active":"2024-04-26T12:37:07.544773+0000","last_peered":"2024-04-26T12:37:07.544773+0000","last_clean":"2024-04-26T12:37:07.544773+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:37:07.544773+0000","last_undegraded":"2024-04-26T12:37:07.544773+0000","last_fullsized":"2024-04-26T12:37:07.544773+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7980","last_scrub_stamp":"2024-04-26T12:37:07.544747+0000","last_deep_scrub":"80'7980","last_deep_scrub_stamp":"2024-04-26T12:37:07.544747+0000","last_clean_scrub_stamp":"2024-04-26T12:37:07.544747+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:29.767928+0000","scrub_duration":0.019747101999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:43.256815+0000","last_change":"2024-04-26T12:35:43.256815+0000","last_active":"2024-04-26T12:35:43.256815+0000","last_peered":"2024-04-26T12:35:43.256815+0000","last_clean":"2024-04-26T12:35:43.256815+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:43.256815+0000","last_undegraded":"2024-04-26T12:35:43.256815+0000","last_fullsized":"2024-04-26T12:35:43.256815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_clean_scrub_stamp":"2024-04-26T12:35:43.256655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:10.856381+0000","scrub_duration":0.001974197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.839864+0000","last_change":"2024-04-26T12:35:59.839864+0000","last_active":"2024-04-26T12:35:59.839864+0000","last_peered":"2024-04-26T12:35:59.839864+0000","last_clean":"2024-04-26T12:35:59.839864+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:59.839864+0000","last_undegraded":"2024-04-26T12:35:59.839864+0000","last_fullsized":"2024-04-26T12:35:59.839864+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.839691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:13.298302+0000","scrub_duration":0.0019804599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.150119+0000","last_change":"2024-04-26T12:35:55.150310+0000","last_active":"2024-04-26T12:35:55.150119+0000","last_peered":"2024-04-26T12:35:55.150119+0000","last_clean":"2024-04-26T12:35:55.150119+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:55.150119+0000","last_undegraded":"2024-04-26T12:35:55.150119+0000","last_fullsized":"2024-04-26T12:35:55.150119+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.150079+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.249254+0000","scrub_duration":0.011542274999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.260010+0000","last_change":"2024-04-26T12:36:41.260010+0000","last_active":"2024-04-26T12:36:41.260010+0000","last_peered":"2024-04-26T12:36:41.260010+0000","last_clean":"2024-04-26T12:36:41.260010+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:36:41.260010+0000","last_undegraded":"2024-04-26T12:36:41.260010+0000","last_fullsized":"2024-04-26T12:36:41.260010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:41.259810+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:41.259810+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.259810+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:21.428799+0000","scrub_duration":0.003236708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.880182+0000","last_change":"2024-04-26T12:35:49.880182+0000","last_active":"2024-04-26T12:35:49.880182+0000","last_peered":"2024-04-26T12:35:49.880182+0000","last_clean":"2024-04-26T12:35:49.880182+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:49.880182+0000","last_undegraded":"2024-04-26T12:35:49.880182+0000","last_fullsized":"2024-04-26T12:35:49.880182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.880012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.320847+0000","scrub_duration":0.0019327299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:43.274955+0000","last_change":"2024-04-26T12:36:43.274955+0000","last_active":"2024-04-26T12:36:43.274955+0000","last_peered":"2024-04-26T12:36:43.274955+0000","last_clean":"2024-04-26T12:36:43.274955+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:36:43.274955+0000","last_undegraded":"2024-04-26T12:36:43.274955+0000","last_fullsized":"2024-04-26T12:36:43.274955+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:43.274807+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:43.274807+0000","last_clean_scrub_stamp":"2024-04-26T12:36:43.274807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:17.223965+0000","scrub_duration":0.007220705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:55.109649+0000","last_change":"2024-04-26T12:36:55.109649+0000","last_active":"2024-04-26T12:36:55.109649+0000","last_peered":"2024-04-26T12:36:55.109649+0000","last_clean":"2024-04-26T12:36:55.109649+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:36:55.109649+0000","last_undegraded":"2024-04-26T12:36:55.109649+0000","last_fullsized":"2024-04-26T12:36:55.109649+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:55.109520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:55.109520+0000","last_clean_scrub_stamp":"2024-04-26T12:36:55.109520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:09.449647+0000","scrub_duration":0.0018695129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"98'9","reported_seq":96,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:13.902674+0000","last_change":"2024-04-26T12:36:13.902674+0000","last_active":"2024-04-26T12:36:13.902674+0000","last_peered":"2024-04-26T12:36:13.902674+0000","last_clean":"2024-04-26T12:36:13.902674+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:36:13.902674+0000","last_undegraded":"2024-04-26T12:36:13.902674+0000","last_fullsized":"2024-04-26T12:36:13.902674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_deep_scrub":"98'9","last_deep_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_clean_scrub_stamp":"2024-04-26T12:36:13.902508+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:02.310643+0000","scrub_duration":0.0037104799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:36.306921+0000","last_change":"2024-04-26T12:36:36.306921+0000","last_active":"2024-04-26T12:36:36.306921+0000","last_peered":"2024-04-26T12:36:36.306921+0000","last_clean":"2024-04-26T12:36:36.306921+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:36:36.306921+0000","last_undegraded":"2024-04-26T12:36:36.306921+0000","last_fullsized":"2024-04-26T12:36:36.306921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:36.306777+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:36.306777+0000","last_clean_scrub_stamp":"2024-04-26T12:36:36.306777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:56.292025+0000","scrub_duration":0.0093015630000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.273898+0000","last_change":"2024-04-26T12:36:22.274010+0000","last_active":"2024-04-26T12:36:22.273898+0000","last_peered":"2024-04-26T12:36:22.273898+0000","last_clean":"2024-04-26T12:36:22.273898+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:36:22.273898+0000","last_undegraded":"2024-04-26T12:36:22.273898+0000","last_fullsized":"2024-04-26T12:36:22.273898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.273870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:52.682099+0000","scrub_duration":0.0016147990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2132,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.254488+0000","last_change":"2024-04-26T12:36:09.254596+0000","last_active":"2024-04-26T12:36:09.254488+0000","last_peered":"2024-04-26T12:36:09.254488+0000","last_clean":"2024-04-26T12:36:09.254488+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:36:09.254488+0000","last_undegraded":"2024-04-26T12:36:09.254488+0000","last_fullsized":"2024-04-26T12:36:09.254488+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2049","last_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_deep_scrub":"80'2049","last_deep_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.254461+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:25.158195+0000","scrub_duration":0.0084966799999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"98'3","reported_seq":124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:06.029049+0000","last_change":"2024-04-26T12:36:06.029182+0000","last_active":"2024-04-26T12:36:06.029049+0000","last_peered":"2024-04-26T12:36:06.029049+0000","last_clean":"2024-04-26T12:36:06.029049+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:36:06.029049+0000","last_undegraded":"2024-04-26T12:36:06.029049+0000","last_fullsized":"2024-04-26T12:36:06.029049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_clean_scrub_stamp":"2024-04-26T12:36:06.029025+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:17.682144+0000","scrub_duration":0.0034148149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.961730+0000","last_change":"2024-04-26T12:36:29.961845+0000","last_active":"2024-04-26T12:36:29.961730+0000","last_peered":"2024-04-26T12:36:29.961730+0000","last_clean":"2024-04-26T12:36:29.961730+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:36:29.961730+0000","last_undegraded":"2024-04-26T12:36:29.961730+0000","last_fullsized":"2024-04-26T12:36:29.961730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2040","last_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_deep_scrub":"80'2040","last_deep_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.961702+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:33.150927+0000","scrub_duration":0.0070304959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"79'3","reported_seq":61,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:29.223153+0000","last_change":"2024-04-26T12:35:26.168055+0000","last_active":"2024-04-26T12:35:29.223153+0000","last_peered":"2024-04-26T12:35:29.223153+0000","last_clean":"2024-04-26T12:35:29.223153+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:35:29.223153+0000","last_undegraded":"2024-04-26T12:35:29.223153+0000","last_fullsized":"2024-04-26T12:35:29.223153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:31.115468+0000","last_clean_scrub_stamp":"2024-04-26T12:30:31.115468+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":127,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:41.966293+0000","last_change":"2024-04-26T12:35:41.966428+0000","last_active":"2024-04-26T12:35:41.966293+0000","last_peered":"2024-04-26T12:35:41.966293+0000","last_clean":"2024-04-26T12:35:41.966293+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:41.966293+0000","last_undegraded":"2024-04-26T12:35:41.966293+0000","last_fullsized":"2024-04-26T12:35:41.966293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7","last_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_deep_scrub":"80'7","last_deep_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_clean_scrub_stamp":"2024-04-26T12:35:41.966266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:47.286627+0000","scrub_duration":0.011530692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":88,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:50.849631+0000","last_change":"2024-04-26T12:35:50.849631+0000","last_active":"2024-04-26T12:35:50.849631+0000","last_peered":"2024-04-26T12:35:50.849631+0000","last_clean":"2024-04-26T12:35:50.849631+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:50.849631+0000","last_undegraded":"2024-04-26T12:35:50.849631+0000","last_fullsized":"2024-04-26T12:35:50.849631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_clean_scrub_stamp":"2024-04-26T12:35:50.849501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:53.832051+0000","scrub_duration":0.002006037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4192,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.266881+0000","last_change":"2024-04-26T12:36:07.266994+0000","last_active":"2024-04-26T12:36:07.266881+0000","last_peered":"2024-04-26T12:36:07.266881+0000","last_clean":"2024-04-26T12:36:07.266881+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:36:07.266881+0000","last_undegraded":"2024-04-26T12:36:07.266881+0000","last_fullsized":"2024-04-26T12:36:07.266881+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4070","last_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_deep_scrub":"80'4070","last_deep_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.266853+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:12.587214+0000","scrub_duration":0.013959829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"98'6","reported_seq":93,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:08.980266+0000","last_change":"2024-04-26T12:36:08.980266+0000","last_active":"2024-04-26T12:36:08.980266+0000","last_peered":"2024-04-26T12:36:08.980266+0000","last_clean":"2024-04-26T12:36:08.980266+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:36:08.980266+0000","last_undegraded":"2024-04-26T12:36:08.980266+0000","last_fullsized":"2024-04-26T12:36:08.980266+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_clean_scrub_stamp":"2024-04-26T12:36:08.980132+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:12.661795+0000","scrub_duration":0.0093908959999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2177,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:55.290231+0000","last_change":"2024-04-26T12:36:55.290401+0000","last_active":"2024-04-26T12:36:55.290231+0000","last_peered":"2024-04-26T12:36:55.290231+0000","last_clean":"2024-04-26T12:36:55.290231+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:36:55.290231+0000","last_undegraded":"2024-04-26T12:36:55.290231+0000","last_fullsized":"2024-04-26T12:36:55.290231+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2067","last_scrub_stamp":"2024-04-26T12:36:55.290208+0000","last_deep_scrub":"80'2067","last_deep_scrub_stamp":"2024-04-26T12:36:55.290208+0000","last_clean_scrub_stamp":"2024-04-26T12:36:55.290208+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:58.479433+0000","scrub_duration":0.015349889,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":130,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:12.000253+0000","last_change":"2024-04-26T12:36:12.000253+0000","last_active":"2024-04-26T12:36:12.000253+0000","last_peered":"2024-04-26T12:36:12.000253+0000","last_clean":"2024-04-26T12:36:12.000253+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:36:12.000253+0000","last_undegraded":"2024-04-26T12:36:12.000253+0000","last_fullsized":"2024-04-26T12:36:12.000253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_clean_scrub_stamp":"2024-04-26T12:36:12.000111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:02.393567+0000","scrub_duration":0.017651467000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.855547+0000","last_change":"2024-04-26T12:35:56.855547+0000","last_active":"2024-04-26T12:35:56.855547+0000","last_peered":"2024-04-26T12:35:56.855547+0000","last_clean":"2024-04-26T12:35:56.855547+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:56.855547+0000","last_undegraded":"2024-04-26T12:35:56.855547+0000","last_fullsized":"2024-04-26T12:35:56.855547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.855396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:59.203820+0000","scrub_duration":0.0078982099999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2039,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:26.308848+0000","last_change":"2024-04-26T12:36:26.308957+0000","last_active":"2024-04-26T12:36:26.308848+0000","last_peered":"2024-04-26T12:36:26.308848+0000","last_clean":"2024-04-26T12:36:26.308848+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:36:26.308848+0000","last_undegraded":"2024-04-26T12:36:26.308848+0000","last_fullsized":"2024-04-26T12:36:26.308848+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1986","last_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_deep_scrub":"80'1986","last_deep_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_clean_scrub_stamp":"2024-04-26T12:36:26.308823+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:41.739629+0000","scrub_duration":0.010363702000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2145,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:03.047838+0000","last_change":"2024-04-26T12:37:03.047838+0000","last_active":"2024-04-26T12:37:03.047838+0000","last_peered":"2024-04-26T12:37:03.047838+0000","last_clean":"2024-04-26T12:37:03.047838+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:37:03.047838+0000","last_undegraded":"2024-04-26T12:37:03.047838+0000","last_fullsized":"2024-04-26T12:37:03.047838+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2031","last_scrub_stamp":"2024-04-26T12:37:03.047680+0000","last_deep_scrub":"80'2031","last_deep_scrub_stamp":"2024-04-26T12:37:03.047680+0000","last_clean_scrub_stamp":"2024-04-26T12:37:03.047680+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:18.660703+0000","scrub_duration":0.0080994900000000009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2150,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:37.258311+0000","last_change":"2024-04-26T12:36:37.258311+0000","last_active":"2024-04-26T12:36:37.258311+0000","last_peered":"2024-04-26T12:36:37.258311+0000","last_clean":"2024-04-26T12:36:37.258311+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:36:37.258311+0000","last_undegraded":"2024-04-26T12:36:37.258311+0000","last_fullsized":"2024-04-26T12:36:37.258311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2044","last_scrub_stamp":"2024-04-26T12:36:37.258151+0000","last_deep_scrub":"80'2044","last_deep_scrub_stamp":"2024-04-26T12:36:37.258151+0000","last_clean_scrub_stamp":"2024-04-26T12:36:37.258151+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:27.651607+0000","scrub_duration":0.0086302089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738453,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142980,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228860,"statfs":{"total":96636764160,"available":95466352640,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.377,"5min":0.316,"15min":0.316},"max":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.437,"15min":0.441},"min":{"1min":0.41699999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.625,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.44800000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.52700000000000002}]}]},{"osd":0,"up_from":85,"seq":365072220189,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52660,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319180,"statfs":{"total":96636764160,"available":96582840320,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.44500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738454,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860676,"statfs":{"total":96636764160,"available":95089332224,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35099999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.48499999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.62}]},{"osd":2,"last update":"Fri Apr 26 12:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.42799999999999999,"15min":0.443},"min":{"1min":0.37,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.45100000000000001},"min":{"1min":0.35899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.623,"5min":1.137,"15min":1.137},"last":0.497}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:37:20.229 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.229 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.229 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.230 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.230 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.230 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.230 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.230 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.231 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.231 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.231 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.232 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:30:31.115468+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:20.232 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:37:40.233 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:37:40.613 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:37:40.615 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:37:40.627 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-04-26T12:37:39.083521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119346,"ondisk_log_size":119346,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706804,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408716,"statfs":{"total":289910292480,"available":287138525184,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2096,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:05.467533+0000","last_change":"2024-04-26T12:37:05.467714+0000","last_active":"2024-04-26T12:37:05.467533+0000","last_peered":"2024-04-26T12:37:05.467533+0000","last_clean":"2024-04-26T12:37:05.467533+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:37:05.467533+0000","last_undegraded":"2024-04-26T12:37:05.467533+0000","last_fullsized":"2024-04-26T12:37:05.467533+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:37:05.467471+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:37:05.467471+0000","last_clean_scrub_stamp":"2024-04-26T12:37:05.467471+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.132163+0000","scrub_duration":0.0045153559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:52.167251+0000","last_change":"2024-04-26T12:35:52.167251+0000","last_active":"2024-04-26T12:35:52.167251+0000","last_peered":"2024-04-26T12:35:52.167251+0000","last_clean":"2024-04-26T12:35:52.167251+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:52.167251+0000","last_undegraded":"2024-04-26T12:35:52.167251+0000","last_fullsized":"2024-04-26T12:35:52.167251+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_clean_scrub_stamp":"2024-04-26T12:35:52.167078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.351227+0000","scrub_duration":0.0068001590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4144,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:45.987903+0000","last_change":"2024-04-26T12:35:45.987903+0000","last_active":"2024-04-26T12:35:45.987903+0000","last_peered":"2024-04-26T12:35:45.987903+0000","last_clean":"2024-04-26T12:35:45.987903+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:45.987903+0000","last_undegraded":"2024-04-26T12:35:45.987903+0000","last_fullsized":"2024-04-26T12:35:45.987903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4036","last_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_deep_scrub":"80'4036","last_deep_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_clean_scrub_stamp":"2024-04-26T12:35:45.987680+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:57.838823+0000","scrub_duration":0.014722818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":129,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:51.983250+0000","last_change":"2024-04-26T12:35:51.983250+0000","last_active":"2024-04-26T12:35:51.983250+0000","last_peered":"2024-04-26T12:35:51.983250+0000","last_clean":"2024-04-26T12:35:51.983250+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:51.983250+0000","last_undegraded":"2024-04-26T12:35:51.983250+0000","last_fullsized":"2024-04-26T12:35:51.983250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_clean_scrub_stamp":"2024-04-26T12:35:51.983105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:34.627140+0000","scrub_duration":0.0030895979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2167,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:24.326520+0000","last_change":"2024-04-26T12:36:24.326642+0000","last_active":"2024-04-26T12:36:24.326520+0000","last_peered":"2024-04-26T12:36:24.326520+0000","last_clean":"2024-04-26T12:36:24.326520+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:36:24.326520+0000","last_undegraded":"2024-04-26T12:36:24.326520+0000","last_fullsized":"2024-04-26T12:36:24.326520+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2045","last_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_deep_scrub":"80'2045","last_deep_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_clean_scrub_stamp":"2024-04-26T12:36:24.326492+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:11.354437+0000","scrub_duration":0.011899834999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":72,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:25.397541+0000","last_change":"2024-04-26T12:37:25.397652+0000","last_active":"2024-04-26T12:37:25.397541+0000","last_peered":"2024-04-26T12:37:25.397541+0000","last_clean":"2024-04-26T12:37:25.397541+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:37:25.397541+0000","last_undegraded":"2024-04-26T12:37:25.397541+0000","last_fullsized":"2024-04-26T12:37:25.397541+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:37:25.397514+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:37:25.397514+0000","last_clean_scrub_stamp":"2024-04-26T12:37:25.397514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:58.883711+0000","scrub_duration":0.010796907999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:28.403421+0000","last_change":"2024-04-26T12:37:28.403538+0000","last_active":"2024-04-26T12:37:28.403421+0000","last_peered":"2024-04-26T12:37:28.403421+0000","last_clean":"2024-04-26T12:37:28.403421+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:37:28.403421+0000","last_undegraded":"2024-04-26T12:37:28.403421+0000","last_fullsized":"2024-04-26T12:37:28.403421+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:37:28.403394+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:37:28.403394+0000","last_clean_scrub_stamp":"2024-04-26T12:37:28.403394+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:14.988365+0000","scrub_duration":0.007319954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8217,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.006065+0000","last_change":"2024-04-26T12:35:38.006208+0000","last_active":"2024-04-26T12:35:38.006065+0000","last_peered":"2024-04-26T12:35:38.006065+0000","last_clean":"2024-04-26T12:35:38.006065+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:38.006065+0000","last_undegraded":"2024-04-26T12:35:38.006065+0000","last_fullsized":"2024-04-26T12:35:38.006065+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8077","last_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_deep_scrub":"80'8077","last_deep_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.006040+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:57.036646+0000","scrub_duration":0.014128129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6192,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:10.074606+0000","last_change":"2024-04-26T12:37:10.074606+0000","last_active":"2024-04-26T12:37:10.074606+0000","last_peered":"2024-04-26T12:37:10.074606+0000","last_clean":"2024-04-26T12:37:10.074606+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:37:10.074606+0000","last_undegraded":"2024-04-26T12:37:10.074606+0000","last_fullsized":"2024-04-26T12:37:10.074606+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6081","last_scrub_stamp":"2024-04-26T12:37:10.074452+0000","last_deep_scrub":"80'6081","last_deep_scrub_stamp":"2024-04-26T12:37:10.074452+0000","last_clean_scrub_stamp":"2024-04-26T12:37:10.074452+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:26.460625+0000","scrub_duration":0.010833512,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6252,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.280808+0000","last_change":"2024-04-26T12:35:49.280948+0000","last_active":"2024-04-26T12:35:49.280808+0000","last_peered":"2024-04-26T12:35:49.280808+0000","last_clean":"2024-04-26T12:35:49.280808+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:49.280808+0000","last_undegraded":"2024-04-26T12:35:49.280808+0000","last_fullsized":"2024-04-26T12:35:49.280808+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6120","last_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_deep_scrub":"80'6120","last_deep_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.280781+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:12.424132+0000","scrub_duration":0.01226383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4080,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:30.102734+0000","last_change":"2024-04-26T12:35:28.216086+0000","last_active":"2024-04-26T12:35:30.102734+0000","last_peered":"2024-04-26T12:35:30.102734+0000","last_clean":"2024-04-26T12:35:30.102734+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:35:30.102734+0000","last_undegraded":"2024-04-26T12:35:30.102734+0000","last_fullsized":"2024-04-26T12:35:30.102734+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:30:32.119831+0000","last_clean_scrub_stamp":"2024-04-26T12:30:32.119831+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2105,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.138480+0000","last_change":"2024-04-26T12:35:56.138597+0000","last_active":"2024-04-26T12:35:56.138480+0000","last_peered":"2024-04-26T12:35:56.138480+0000","last_clean":"2024-04-26T12:35:56.138480+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:56.138480+0000","last_undegraded":"2024-04-26T12:35:56.138480+0000","last_fullsized":"2024-04-26T12:35:56.138480+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2051","last_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_deep_scrub":"80'2051","last_deep_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.138454+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:03.549045+0000","scrub_duration":0.011597293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2150,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.311288+0000","last_change":"2024-04-26T12:36:29.311400+0000","last_active":"2024-04-26T12:36:29.311288+0000","last_peered":"2024-04-26T12:36:29.311288+0000","last_clean":"2024-04-26T12:36:29.311288+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:36:29.311288+0000","last_undegraded":"2024-04-26T12:36:29.311288+0000","last_fullsized":"2024-04-26T12:36:29.311288+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2026","last_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_deep_scrub":"80'2026","last_deep_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.311261+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:55.733965+0000","scrub_duration":0.0058874599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2160,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:57.048340+0000","last_change":"2024-04-26T12:35:57.048340+0000","last_active":"2024-04-26T12:35:57.048340+0000","last_peered":"2024-04-26T12:35:57.048340+0000","last_clean":"2024-04-26T12:35:57.048340+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:57.048340+0000","last_undegraded":"2024-04-26T12:35:57.048340+0000","last_fullsized":"2024-04-26T12:35:57.048340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2052","last_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_deep_scrub":"80'2052","last_deep_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_clean_scrub_stamp":"2024-04-26T12:35:57.048199+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:27.456428+0000","scrub_duration":0.016047618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2179,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:01.108416+0000","last_change":"2024-04-26T12:36:01.108416+0000","last_active":"2024-04-26T12:36:01.108416+0000","last_peered":"2024-04-26T12:36:01.108416+0000","last_clean":"2024-04-26T12:36:01.108416+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:36:01.108416+0000","last_undegraded":"2024-04-26T12:36:01.108416+0000","last_fullsized":"2024-04-26T12:36:01.108416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2071","last_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_deep_scrub":"80'2071","last_deep_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_clean_scrub_stamp":"2024-04-26T12:36:01.108240+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:16.539046+0000","scrub_duration":0.014518568000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:20.286926+0000","last_change":"2024-04-26T12:37:20.287053+0000","last_active":"2024-04-26T12:37:20.286926+0000","last_peered":"2024-04-26T12:37:20.286926+0000","last_clean":"2024-04-26T12:37:20.286926+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:37:20.286926+0000","last_undegraded":"2024-04-26T12:37:20.286926+0000","last_fullsized":"2024-04-26T12:37:20.286926+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2013","last_scrub_stamp":"2024-04-26T12:37:20.286898+0000","last_deep_scrub":"80'2013","last_deep_scrub_stamp":"2024-04-26T12:37:20.286898+0000","last_clean_scrub_stamp":"2024-04-26T12:37:20.286898+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:06.249198+0000","scrub_duration":0.017240426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2131,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:13.050459+0000","last_change":"2024-04-26T12:37:13.050459+0000","last_active":"2024-04-26T12:37:13.050459+0000","last_peered":"2024-04-26T12:37:13.050459+0000","last_clean":"2024-04-26T12:37:13.050459+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:37:13.050459+0000","last_undegraded":"2024-04-26T12:37:13.050459+0000","last_fullsized":"2024-04-26T12:37:13.050459+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2015","last_scrub_stamp":"2024-04-26T12:37:13.050294+0000","last_deep_scrub":"80'2015","last_deep_scrub_stamp":"2024-04-26T12:37:13.050294+0000","last_clean_scrub_stamp":"2024-04-26T12:37:13.050294+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:52.328160+0000","scrub_duration":0.0048918870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2152,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:18.634570+0000","last_change":"2024-04-26T12:37:18.634705+0000","last_active":"2024-04-26T12:37:18.634570+0000","last_peered":"2024-04-26T12:37:18.634570+0000","last_clean":"2024-04-26T12:37:18.634570+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:37:18.634570+0000","last_undegraded":"2024-04-26T12:37:18.634570+0000","last_fullsized":"2024-04-26T12:37:18.634570+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2071","last_scrub_stamp":"2024-04-26T12:37:18.634526+0000","last_deep_scrub":"80'2071","last_deep_scrub_stamp":"2024-04-26T12:37:18.634526+0000","last_clean_scrub_stamp":"2024-04-26T12:37:18.634526+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:05.350874+0000","scrub_duration":0.0080801680000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:11.051825+0000","last_change":"2024-04-26T12:37:11.051825+0000","last_active":"2024-04-26T12:37:11.051825+0000","last_peered":"2024-04-26T12:37:11.051825+0000","last_clean":"2024-04-26T12:37:11.051825+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:37:11.051825+0000","last_undegraded":"2024-04-26T12:37:11.051825+0000","last_fullsized":"2024-04-26T12:37:11.051825+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3996","last_scrub_stamp":"2024-04-26T12:37:11.051664+0000","last_deep_scrub":"80'3996","last_deep_scrub_stamp":"2024-04-26T12:37:11.051664+0000","last_clean_scrub_stamp":"2024-04-26T12:37:11.051664+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:33.819537+0000","scrub_duration":0.0080050139999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4235,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:16.031481+0000","last_change":"2024-04-26T12:36:16.031481+0000","last_active":"2024-04-26T12:36:16.031481+0000","last_peered":"2024-04-26T12:36:16.031481+0000","last_clean":"2024-04-26T12:36:16.031481+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:36:16.031481+0000","last_undegraded":"2024-04-26T12:36:16.031481+0000","last_fullsized":"2024-04-26T12:36:16.031481+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4103","last_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_deep_scrub":"80'4103","last_deep_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_clean_scrub_stamp":"2024-04-26T12:36:16.031346+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:35.734914+0000","scrub_duration":0.0054779479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":132,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:12.202975+0000","last_change":"2024-04-26T12:37:12.202975+0000","last_active":"2024-04-26T12:37:12.202975+0000","last_peered":"2024-04-26T12:37:12.202975+0000","last_clean":"2024-04-26T12:37:12.202975+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:37:12.202975+0000","last_undegraded":"2024-04-26T12:37:12.202975+0000","last_fullsized":"2024-04-26T12:37:12.202975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'11","last_scrub_stamp":"2024-04-26T12:37:12.202785+0000","last_deep_scrub":"80'11","last_deep_scrub_stamp":"2024-04-26T12:37:12.202785+0000","last_clean_scrub_stamp":"2024-04-26T12:37:12.202785+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:39.672705+0000","scrub_duration":0.0071294280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2129,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:40.305800+0000","last_change":"2024-04-26T12:36:40.305800+0000","last_active":"2024-04-26T12:36:40.305800+0000","last_peered":"2024-04-26T12:36:40.305800+0000","last_clean":"2024-04-26T12:36:40.305800+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:36:40.305800+0000","last_undegraded":"2024-04-26T12:36:40.305800+0000","last_fullsized":"2024-04-26T12:36:40.305800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2023","last_scrub_stamp":"2024-04-26T12:36:40.305650+0000","last_deep_scrub":"80'2023","last_deep_scrub_stamp":"2024-04-26T12:36:40.305650+0000","last_clean_scrub_stamp":"2024-04-26T12:36:40.305650+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:59.028356+0000","scrub_duration":0.019539554000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:06.069235+0000","last_change":"2024-04-26T12:37:06.069235+0000","last_active":"2024-04-26T12:37:06.069235+0000","last_peered":"2024-04-26T12:37:06.069235+0000","last_clean":"2024-04-26T12:37:06.069235+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:37:06.069235+0000","last_undegraded":"2024-04-26T12:37:06.069235+0000","last_fullsized":"2024-04-26T12:37:06.069235+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1995","last_scrub_stamp":"2024-04-26T12:37:06.069104+0000","last_deep_scrub":"80'1995","last_deep_scrub_stamp":"2024-04-26T12:37:06.069104+0000","last_clean_scrub_stamp":"2024-04-26T12:37:06.069104+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:53.097688+0000","scrub_duration":0.0079981329999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4152,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:03.189097+0000","last_change":"2024-04-26T12:36:03.189097+0000","last_active":"2024-04-26T12:36:03.189097+0000","last_peered":"2024-04-26T12:36:03.189097+0000","last_clean":"2024-04-26T12:36:03.189097+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:36:03.189097+0000","last_undegraded":"2024-04-26T12:36:03.189097+0000","last_fullsized":"2024-04-26T12:36:03.189097+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4067","last_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_deep_scrub":"80'4067","last_deep_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_clean_scrub_stamp":"2024-04-26T12:36:03.188951+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:22.219557+0000","scrub_duration":0.013814754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2154,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.127545+0000","last_change":"2024-04-26T12:35:59.127545+0000","last_active":"2024-04-26T12:35:59.127545+0000","last_peered":"2024-04-26T12:35:59.127545+0000","last_clean":"2024-04-26T12:35:59.127545+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:59.127545+0000","last_undegraded":"2024-04-26T12:35:59.127545+0000","last_fullsized":"2024-04-26T12:35:59.127545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2053","last_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_deep_scrub":"80'2053","last_deep_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.127404+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:55.177992+0000","scrub_duration":0.018465079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.893816+0000","last_change":"2024-04-26T12:36:17.893816+0000","last_active":"2024-04-26T12:36:17.893816+0000","last_peered":"2024-04-26T12:36:17.893816+0000","last_clean":"2024-04-26T12:36:17.893816+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:36:17.893816+0000","last_undegraded":"2024-04-26T12:36:17.893816+0000","last_fullsized":"2024-04-26T12:36:17.893816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.893660+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:02.255600+0000","scrub_duration":0.0081512219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2114,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.999776+0000","last_change":"2024-04-26T12:35:49.999776+0000","last_active":"2024-04-26T12:35:49.999776+0000","last_peered":"2024-04-26T12:35:49.999776+0000","last_clean":"2024-04-26T12:35:49.999776+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:49.999776+0000","last_undegraded":"2024-04-26T12:35:49.999776+0000","last_fullsized":"2024-04-26T12:35:49.999776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2006","last_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_deep_scrub":"80'2006","last_deep_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.999571+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:58.313518+0000","scrub_duration":0.012700795000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:47.311342+0000","last_change":"2024-04-26T12:36:47.311461+0000","last_active":"2024-04-26T12:36:47.311342+0000","last_peered":"2024-04-26T12:36:47.311342+0000","last_clean":"2024-04-26T12:36:47.311342+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:36:47.311342+0000","last_undegraded":"2024-04-26T12:36:47.311342+0000","last_fullsized":"2024-04-26T12:36:47.311342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:36:47.311317+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:36:47.311317+0000","last_clean_scrub_stamp":"2024-04-26T12:36:47.311317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:34.018306+0000","scrub_duration":0.002254729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":69,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.161522+0000","last_change":"2024-04-26T12:35:38.161638+0000","last_active":"2024-04-26T12:35:38.161522+0000","last_peered":"2024-04-26T12:35:38.161522+0000","last_clean":"2024-04-26T12:35:38.161522+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:38.161522+0000","last_undegraded":"2024-04-26T12:35:38.161522+0000","last_fullsized":"2024-04-26T12:35:38.161522+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.161494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:19.249824+0000","scrub_duration":0.014847795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:35.181718+0000","last_change":"2024-04-26T12:36:35.181718+0000","last_active":"2024-04-26T12:36:35.181718+0000","last_peered":"2024-04-26T12:36:35.181718+0000","last_clean":"2024-04-26T12:36:35.181718+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:36:35.181718+0000","last_undegraded":"2024-04-26T12:36:35.181718+0000","last_fullsized":"2024-04-26T12:36:35.181718+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_clean_scrub_stamp":"2024-04-26T12:36:35.181561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:15.742099+0000","scrub_duration":0.0020050630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.946252+0000","last_change":"2024-04-26T12:36:07.946252+0000","last_active":"2024-04-26T12:36:07.946252+0000","last_peered":"2024-04-26T12:36:07.946252+0000","last_clean":"2024-04-26T12:36:07.946252+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:36:07.946252+0000","last_undegraded":"2024-04-26T12:36:07.946252+0000","last_fullsized":"2024-04-26T12:36:07.946252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.946106+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:15.251311+0000","scrub_duration":0.0085133599999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:30.077900+0000","last_change":"2024-04-26T12:36:30.077900+0000","last_active":"2024-04-26T12:36:30.077900+0000","last_peered":"2024-04-26T12:36:30.077900+0000","last_clean":"2024-04-26T12:36:30.077900+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:36:30.077900+0000","last_undegraded":"2024-04-26T12:36:30.077900+0000","last_fullsized":"2024-04-26T12:36:30.077900+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_clean_scrub_stamp":"2024-04-26T12:36:30.077735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:09.005584+0000","scrub_duration":0.0019678730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:22.715763+0000","last_change":"2024-04-26T12:37:22.715763+0000","last_active":"2024-04-26T12:37:22.715763+0000","last_peered":"2024-04-26T12:37:22.715763+0000","last_clean":"2024-04-26T12:37:22.715763+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:37:22.715763+0000","last_undegraded":"2024-04-26T12:37:22.715763+0000","last_fullsized":"2024-04-26T12:37:22.715763+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:37:22.715615+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:37:22.715615+0000","last_clean_scrub_stamp":"2024-04-26T12:37:22.715615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:33.106400+0000","scrub_duration":0.003655195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:58.133655+0000","last_change":"2024-04-26T12:36:58.133655+0000","last_active":"2024-04-26T12:36:58.133655+0000","last_peered":"2024-04-26T12:36:58.133655+0000","last_clean":"2024-04-26T12:36:58.133655+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:36:58.133655+0000","last_undegraded":"2024-04-26T12:36:58.133655+0000","last_fullsized":"2024-04-26T12:36:58.133655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'1","last_scrub_stamp":"2024-04-26T12:36:58.133490+0000","last_deep_scrub":"79'1","last_deep_scrub_stamp":"2024-04-26T12:36:58.133490+0000","last_clean_scrub_stamp":"2024-04-26T12:36:58.133490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:43.786311+0000","scrub_duration":0.00167731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:46.789233+0000","last_change":"2024-04-26T12:35:46.789233+0000","last_active":"2024-04-26T12:35:46.789233+0000","last_peered":"2024-04-26T12:35:46.789233+0000","last_clean":"2024-04-26T12:35:46.789233+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:46.789233+0000","last_undegraded":"2024-04-26T12:35:46.789233+0000","last_fullsized":"2024-04-26T12:35:46.789233+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_clean_scrub_stamp":"2024-04-26T12:35:46.789065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:51.542684+0000","scrub_duration":0.010829827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":67,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:31.405752+0000","last_change":"2024-04-26T12:37:31.405857+0000","last_active":"2024-04-26T12:37:31.405752+0000","last_peered":"2024-04-26T12:37:31.405752+0000","last_clean":"2024-04-26T12:37:31.405752+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:37:31.405752+0000","last_undegraded":"2024-04-26T12:37:31.405752+0000","last_fullsized":"2024-04-26T12:37:31.405752+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:37:31.405727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:37:31.405727+0000","last_clean_scrub_stamp":"2024-04-26T12:37:31.405727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:45.219854+0000","scrub_duration":0.0021049290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6195,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:07.037664+0000","last_change":"2024-04-26T12:37:07.037664+0000","last_active":"2024-04-26T12:37:07.037664+0000","last_peered":"2024-04-26T12:37:07.037664+0000","last_clean":"2024-04-26T12:37:07.037664+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:37:07.037664+0000","last_undegraded":"2024-04-26T12:37:07.037664+0000","last_fullsized":"2024-04-26T12:37:07.037664+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6064","last_scrub_stamp":"2024-04-26T12:37:07.037516+0000","last_deep_scrub":"80'6064","last_deep_scrub_stamp":"2024-04-26T12:37:07.037516+0000","last_clean_scrub_stamp":"2024-04-26T12:37:07.037516+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:16.565817+0000","scrub_duration":0.011608321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"98'8","reported_seq":75,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:14.620457+0000","last_change":"2024-04-26T12:37:14.620563+0000","last_active":"2024-04-26T12:37:14.620457+0000","last_peered":"2024-04-26T12:37:14.620457+0000","last_clean":"2024-04-26T12:37:14.620457+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:37:14.620457+0000","last_undegraded":"2024-04-26T12:37:14.620457+0000","last_fullsized":"2024-04-26T12:37:14.620457+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'8","last_scrub_stamp":"2024-04-26T12:37:14.620431+0000","last_deep_scrub":"98'8","last_deep_scrub_stamp":"2024-04-26T12:37:14.620431+0000","last_clean_scrub_stamp":"2024-04-26T12:37:14.620431+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:18.798832+0000","scrub_duration":0.0042118800000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4175,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:42.691943+0000","last_change":"2024-04-26T12:35:42.691943+0000","last_active":"2024-04-26T12:35:42.691943+0000","last_peered":"2024-04-26T12:35:42.691943+0000","last_clean":"2024-04-26T12:35:42.691943+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:42.691943+0000","last_undegraded":"2024-04-26T12:35:42.691943+0000","last_fullsized":"2024-04-26T12:35:42.691943+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4058","last_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_deep_scrub":"80'4058","last_deep_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_clean_scrub_stamp":"2024-04-26T12:35:42.691721+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:59.851784+0000","scrub_duration":0.010224120999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"98'100","reported_seq":209,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.932662+0000","last_change":"2024-04-26T12:36:41.932662+0000","last_active":"2024-04-26T12:36:41.932662+0000","last_peered":"2024-04-26T12:36:41.932662+0000","last_clean":"2024-04-26T12:36:41.932662+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:36:41.932662+0000","last_undegraded":"2024-04-26T12:36:41.932662+0000","last_fullsized":"2024-04-26T12:36:41.932662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'100","last_scrub_stamp":"2024-04-26T12:36:41.932523+0000","last_deep_scrub":"98'100","last_deep_scrub_stamp":"2024-04-26T12:36:41.932523+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.932523+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:04.155704+0000","scrub_duration":0.0057948440000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4202,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.099460+0000","last_change":"2024-04-26T12:35:59.099460+0000","last_active":"2024-04-26T12:35:59.099460+0000","last_peered":"2024-04-26T12:35:59.099460+0000","last_clean":"2024-04-26T12:35:59.099460+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:59.099460+0000","last_undegraded":"2024-04-26T12:35:59.099460+0000","last_fullsized":"2024-04-26T12:35:59.099460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4094","last_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_deep_scrub":"80'4094","last_deep_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.099256+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:46.127201+0000","scrub_duration":0.013902207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"98'4","reported_seq":126,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:10.954415+0000","last_change":"2024-04-26T12:36:10.954415+0000","last_active":"2024-04-26T12:36:10.954415+0000","last_peered":"2024-04-26T12:36:10.954415+0000","last_clean":"2024-04-26T12:36:10.954415+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:36:10.954415+0000","last_undegraded":"2024-04-26T12:36:10.954415+0000","last_fullsized":"2024-04-26T12:36:10.954415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_clean_scrub_stamp":"2024-04-26T12:36:10.954281+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:30.939529+0000","scrub_duration":0.0038576499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2093,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.082461+0000","last_change":"2024-04-26T12:36:00.082579+0000","last_active":"2024-04-26T12:36:00.082461+0000","last_peered":"2024-04-26T12:36:00.082461+0000","last_clean":"2024-04-26T12:36:00.082461+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:36:00.082461+0000","last_undegraded":"2024-04-26T12:36:00.082461+0000","last_fullsized":"2024-04-26T12:36:00.082461+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1968","last_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_deep_scrub":"80'1968","last_deep_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.082433+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.908109+0000","scrub_duration":0.011161457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:51.234006+0000","last_change":"2024-04-26T12:36:51.234006+0000","last_active":"2024-04-26T12:36:51.234006+0000","last_peered":"2024-04-26T12:36:51.234006+0000","last_clean":"2024-04-26T12:36:51.234006+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:36:51.234006+0000","last_undegraded":"2024-04-26T12:36:51.234006+0000","last_fullsized":"2024-04-26T12:36:51.234006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:51.233800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:51.233800+0000","last_clean_scrub_stamp":"2024-04-26T12:36:51.233800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:27.209478+0000","scrub_duration":0.0021296700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2090,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:23.748446+0000","last_change":"2024-04-26T12:37:23.748558+0000","last_active":"2024-04-26T12:37:23.748446+0000","last_peered":"2024-04-26T12:37:23.748446+0000","last_clean":"2024-04-26T12:37:23.748446+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:37:23.748446+0000","last_undegraded":"2024-04-26T12:37:23.748446+0000","last_fullsized":"2024-04-26T12:37:23.748446+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2009","last_scrub_stamp":"2024-04-26T12:37:23.748419+0000","last_deep_scrub":"80'2009","last_deep_scrub_stamp":"2024-04-26T12:37:23.748419+0000","last_clean_scrub_stamp":"2024-04-26T12:37:23.748419+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:41.078148+0000","scrub_duration":0.013466535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.344225+0000","last_change":"2024-04-26T12:36:17.344357+0000","last_active":"2024-04-26T12:36:17.344225+0000","last_peered":"2024-04-26T12:36:17.344225+0000","last_clean":"2024-04-26T12:36:17.344225+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:36:17.344225+0000","last_undegraded":"2024-04-26T12:36:17.344225+0000","last_fullsized":"2024-04-26T12:36:17.344225+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.344200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:59.988235+0000","scrub_duration":0.0016444610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:23.003182+0000","last_change":"2024-04-26T12:36:23.003182+0000","last_active":"2024-04-26T12:36:23.003182+0000","last_peered":"2024-04-26T12:36:23.003182+0000","last_clean":"2024-04-26T12:36:23.003182+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:36:23.003182+0000","last_undegraded":"2024-04-26T12:36:23.003182+0000","last_fullsized":"2024-04-26T12:36:23.003182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_clean_scrub_stamp":"2024-04-26T12:36:23.002980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:24.050905+0000","scrub_duration":0.008324517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"98'13","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:03.245630+0000","last_change":"2024-04-26T12:37:03.245630+0000","last_active":"2024-04-26T12:37:03.245630+0000","last_peered":"2024-04-26T12:37:03.245630+0000","last_clean":"2024-04-26T12:37:03.245630+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:37:03.245630+0000","last_undegraded":"2024-04-26T12:37:03.245630+0000","last_fullsized":"2024-04-26T12:37:03.245630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'13","last_scrub_stamp":"2024-04-26T12:37:03.245471+0000","last_deep_scrub":"98'13","last_deep_scrub_stamp":"2024-04-26T12:37:03.245471+0000","last_clean_scrub_stamp":"2024-04-26T12:37:03.245471+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:34.822704+0000","scrub_duration":0.0049500450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:18.033263+0000","last_change":"2024-04-26T12:37:18.033263+0000","last_active":"2024-04-26T12:37:18.033263+0000","last_peered":"2024-04-26T12:37:18.033263+0000","last_clean":"2024-04-26T12:37:18.033263+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:37:18.033263+0000","last_undegraded":"2024-04-26T12:37:18.033263+0000","last_fullsized":"2024-04-26T12:37:18.033263+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2067","last_scrub_stamp":"2024-04-26T12:37:18.033088+0000","last_deep_scrub":"80'2067","last_deep_scrub_stamp":"2024-04-26T12:37:18.033088+0000","last_clean_scrub_stamp":"2024-04-26T12:37:18.033088+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:08.753080+0000","scrub_duration":0.0072143529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"98'2","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:34.867018+0000","last_change":"2024-04-26T12:36:34.867018+0000","last_active":"2024-04-26T12:36:34.867018+0000","last_peered":"2024-04-26T12:36:34.867018+0000","last_clean":"2024-04-26T12:36:34.867018+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:36:34.867018+0000","last_undegraded":"2024-04-26T12:36:34.867018+0000","last_fullsized":"2024-04-26T12:36:34.867018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_clean_scrub_stamp":"2024-04-26T12:36:34.866855+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:44.780097+0000","scrub_duration":0.0056431429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2108,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:00.345450+0000","last_change":"2024-04-26T12:37:00.345450+0000","last_active":"2024-04-26T12:37:00.345450+0000","last_peered":"2024-04-26T12:37:00.345450+0000","last_clean":"2024-04-26T12:37:00.345450+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:37:00.345450+0000","last_undegraded":"2024-04-26T12:37:00.345450+0000","last_fullsized":"2024-04-26T12:37:00.345450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2055","last_scrub_stamp":"2024-04-26T12:37:00.345311+0000","last_deep_scrub":"80'2055","last_deep_scrub_stamp":"2024-04-26T12:37:00.345311+0000","last_clean_scrub_stamp":"2024-04-26T12:37:00.345311+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:10.258554+0000","scrub_duration":0.015153711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"98'3","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:35.331158+0000","last_change":"2024-04-26T12:36:35.331158+0000","last_active":"2024-04-26T12:36:35.331158+0000","last_peered":"2024-04-26T12:36:35.331158+0000","last_clean":"2024-04-26T12:36:35.331158+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:36:35.331158+0000","last_undegraded":"2024-04-26T12:36:35.331158+0000","last_fullsized":"2024-04-26T12:36:35.331158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:35.331023+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:35.331023+0000","last_clean_scrub_stamp":"2024-04-26T12:36:35.331023+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:30.228403+0000","scrub_duration":0.0034488190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":98,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:40.209064+0000","last_change":"2024-04-26T12:35:40.209064+0000","last_active":"2024-04-26T12:35:40.209064+0000","last_peered":"2024-04-26T12:35:40.209064+0000","last_clean":"2024-04-26T12:35:40.209064+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:40.209064+0000","last_undegraded":"2024-04-26T12:35:40.209064+0000","last_fullsized":"2024-04-26T12:35:40.209064+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_clean_scrub_stamp":"2024-04-26T12:35:40.208887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:37.520324+0000","scrub_duration":0.016687707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"98'2","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:19.260452+0000","last_change":"2024-04-26T12:37:19.260557+0000","last_active":"2024-04-26T12:37:19.260452+0000","last_peered":"2024-04-26T12:37:19.260452+0000","last_clean":"2024-04-26T12:37:19.260452+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:37:19.260452+0000","last_undegraded":"2024-04-26T12:37:19.260452+0000","last_fullsized":"2024-04-26T12:37:19.260452+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-26T12:37:19.260427+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-26T12:37:19.260427+0000","last_clean_scrub_stamp":"2024-04-26T12:37:19.260427+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:49.781561+0000","scrub_duration":0.0033091790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:39.969333+0000","last_change":"2024-04-26T12:36:39.969333+0000","last_active":"2024-04-26T12:36:39.969333+0000","last_peered":"2024-04-26T12:36:39.969333+0000","last_clean":"2024-04-26T12:36:39.969333+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:36:39.969333+0000","last_undegraded":"2024-04-26T12:36:39.969333+0000","last_fullsized":"2024-04-26T12:36:39.969333+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1991","last_scrub_stamp":"2024-04-26T12:36:39.969173+0000","last_deep_scrub":"80'1991","last_deep_scrub_stamp":"2024-04-26T12:36:39.969173+0000","last_clean_scrub_stamp":"2024-04-26T12:36:39.969173+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.633864+0000","scrub_duration":0.011084973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.982242+0000","last_change":"2024-04-26T12:36:14.982242+0000","last_active":"2024-04-26T12:36:14.982242+0000","last_peered":"2024-04-26T12:36:14.982242+0000","last_clean":"2024-04-26T12:36:14.982242+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:36:14.982242+0000","last_undegraded":"2024-04-26T12:36:14.982242+0000","last_fullsized":"2024-04-26T12:36:14.982242+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.982103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.704809+0000","scrub_duration":0.0018977480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:20.998503+0000","last_change":"2024-04-26T12:36:20.998503+0000","last_active":"2024-04-26T12:36:20.998503+0000","last_peered":"2024-04-26T12:36:20.998503+0000","last_clean":"2024-04-26T12:36:20.998503+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:36:20.998503+0000","last_undegraded":"2024-04-26T12:36:20.998503+0000","last_fullsized":"2024-04-26T12:36:20.998503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_clean_scrub_stamp":"2024-04-26T12:36:20.998357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.004150+0000","scrub_duration":0.0052206129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:37.185388+0000","last_change":"2024-04-26T12:36:37.185388+0000","last_active":"2024-04-26T12:36:37.185388+0000","last_peered":"2024-04-26T12:36:37.185388+0000","last_clean":"2024-04-26T12:36:37.185388+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:36:37.185388+0000","last_undegraded":"2024-04-26T12:36:37.185388+0000","last_fullsized":"2024-04-26T12:36:37.185388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:37.185231+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:37.185231+0000","last_clean_scrub_stamp":"2024-04-26T12:36:37.185231+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:12.684695+0000","scrub_duration":0.0035423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.017326+0000","last_change":"2024-04-26T12:35:56.017326+0000","last_active":"2024-04-26T12:35:56.017326+0000","last_peered":"2024-04-26T12:35:56.017326+0000","last_clean":"2024-04-26T12:35:56.017326+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:56.017326+0000","last_undegraded":"2024-04-26T12:35:56.017326+0000","last_fullsized":"2024-04-26T12:35:56.017326+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1980","last_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_deep_scrub":"80'1980","last_deep_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.017191+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:19.910231+0000","scrub_duration":0.0081651450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:02.197971+0000","last_change":"2024-04-26T12:37:02.197971+0000","last_active":"2024-04-26T12:37:02.197971+0000","last_peered":"2024-04-26T12:37:02.197971+0000","last_clean":"2024-04-26T12:37:02.197971+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:37:02.197971+0000","last_undegraded":"2024-04-26T12:37:02.197971+0000","last_fullsized":"2024-04-26T12:37:02.197971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:37:02.197804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:37:02.197804+0000","last_clean_scrub_stamp":"2024-04-26T12:37:02.197804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:29.596636+0000","scrub_duration":0.0016879169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2147,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:04.059101+0000","last_change":"2024-04-26T12:36:04.059101+0000","last_active":"2024-04-26T12:36:04.059101+0000","last_peered":"2024-04-26T12:36:04.059101+0000","last_clean":"2024-04-26T12:36:04.059101+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:36:04.059101+0000","last_undegraded":"2024-04-26T12:36:04.059101+0000","last_fullsized":"2024-04-26T12:36:04.059101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2039","last_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_deep_scrub":"80'2039","last_deep_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_clean_scrub_stamp":"2024-04-26T12:36:04.058924+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:30.481629+0000","scrub_duration":0.012146647999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.322735+0000","last_change":"2024-04-26T12:36:41.322735+0000","last_active":"2024-04-26T12:36:41.322735+0000","last_peered":"2024-04-26T12:36:41.322735+0000","last_clean":"2024-04-26T12:36:41.322735+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:36:41.322735+0000","last_undegraded":"2024-04-26T12:36:41.322735+0000","last_fullsized":"2024-04-26T12:36:41.322735+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:41.322599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:41.322599+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.322599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:01.026167+0000","scrub_duration":0.0017738890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.984957+0000","last_change":"2024-04-26T12:36:09.984957+0000","last_active":"2024-04-26T12:36:09.984957+0000","last_peered":"2024-04-26T12:36:09.984957+0000","last_clean":"2024-04-26T12:36:09.984957+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:36:09.984957+0000","last_undegraded":"2024-04-26T12:36:09.984957+0000","last_fullsized":"2024-04-26T12:36:09.984957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2065","last_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_deep_scrub":"80'2065","last_deep_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.984820+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:04.882200+0000","scrub_duration":0.013017881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.285733+0000","last_change":"2024-04-26T12:36:14.285733+0000","last_active":"2024-04-26T12:36:14.285733+0000","last_peered":"2024-04-26T12:36:14.285733+0000","last_clean":"2024-04-26T12:36:14.285733+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:36:14.285733+0000","last_undegraded":"2024-04-26T12:36:14.285733+0000","last_fullsized":"2024-04-26T12:36:14.285733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.285570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:22.599518+0000","scrub_duration":0.0020305150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:12.085358+0000","last_change":"2024-04-26T12:37:12.085358+0000","last_active":"2024-04-26T12:37:12.085358+0000","last_peered":"2024-04-26T12:37:12.085358+0000","last_clean":"2024-04-26T12:37:12.085358+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:37:12.085358+0000","last_undegraded":"2024-04-26T12:37:12.085358+0000","last_fullsized":"2024-04-26T12:37:12.085358+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6083","last_scrub_stamp":"2024-04-26T12:37:12.085213+0000","last_deep_scrub":"80'6083","last_deep_scrub_stamp":"2024-04-26T12:37:12.085213+0000","last_clean_scrub_stamp":"2024-04-26T12:37:12.085213+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:20.355830+0000","scrub_duration":0.010905646999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:54.828732+0000","last_change":"2024-04-26T12:35:54.828732+0000","last_active":"2024-04-26T12:35:54.828732+0000","last_peered":"2024-04-26T12:35:54.828732+0000","last_clean":"2024-04-26T12:35:54.828732+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:54.828732+0000","last_undegraded":"2024-04-26T12:35:54.828732+0000","last_fullsized":"2024-04-26T12:35:54.828732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_clean_scrub_stamp":"2024-04-26T12:35:54.828605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:29.226278+0000","scrub_duration":0.001515267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.033778+0000","last_change":"2024-04-26T12:36:22.033778+0000","last_active":"2024-04-26T12:36:22.033778+0000","last_peered":"2024-04-26T12:36:22.033778+0000","last_clean":"2024-04-26T12:36:22.033778+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:36:22.033778+0000","last_undegraded":"2024-04-26T12:36:22.033778+0000","last_fullsized":"2024-04-26T12:36:22.033778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.033620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:08.740609+0000","scrub_duration":0.0020642659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:21.255056+0000","last_change":"2024-04-26T12:36:21.255056+0000","last_active":"2024-04-26T12:36:21.255056+0000","last_peered":"2024-04-26T12:36:21.255056+0000","last_clean":"2024-04-26T12:36:21.255056+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:36:21.255056+0000","last_undegraded":"2024-04-26T12:36:21.255056+0000","last_fullsized":"2024-04-26T12:36:21.255056+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_clean_scrub_stamp":"2024-04-26T12:36:21.254895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:45.147934+0000","scrub_duration":0.0093846899999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:54.092774+0000","last_change":"2024-04-26T12:36:54.092893+0000","last_active":"2024-04-26T12:36:54.092774+0000","last_peered":"2024-04-26T12:36:54.092774+0000","last_clean":"2024-04-26T12:36:54.092774+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:36:54.092774+0000","last_undegraded":"2024-04-26T12:36:54.092774+0000","last_fullsized":"2024-04-26T12:36:54.092774+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:54.092735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:54.092735+0000","last_clean_scrub_stamp":"2024-04-26T12:36:54.092735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:40.809083+0000","scrub_duration":0.001976303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:06.197816+0000","last_change":"2024-04-26T12:37:06.197958+0000","last_active":"2024-04-26T12:37:06.197816+0000","last_peered":"2024-04-26T12:37:06.197816+0000","last_clean":"2024-04-26T12:37:06.197816+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:37:06.197816+0000","last_undegraded":"2024-04-26T12:37:06.197816+0000","last_fullsized":"2024-04-26T12:37:06.197816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:37:06.197792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:37:06.197792+0000","last_clean_scrub_stamp":"2024-04-26T12:37:06.197792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:02.633118+0000","scrub_duration":0.0019428410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:49.289630+0000","last_change":"2024-04-26T12:36:49.289630+0000","last_active":"2024-04-26T12:36:49.289630+0000","last_peered":"2024-04-26T12:36:49.289630+0000","last_clean":"2024-04-26T12:36:49.289630+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:36:49.289630+0000","last_undegraded":"2024-04-26T12:36:49.289630+0000","last_fullsized":"2024-04-26T12:36:49.289630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:49.289463+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:49.289463+0000","last_clean_scrub_stamp":"2024-04-26T12:36:49.289463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:56.753704+0000","scrub_duration":0.0072399329999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.903484+0000","last_change":"2024-04-26T12:36:14.903484+0000","last_active":"2024-04-26T12:36:14.903484+0000","last_peered":"2024-04-26T12:36:14.903484+0000","last_clean":"2024-04-26T12:36:14.903484+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:36:14.903484+0000","last_undegraded":"2024-04-26T12:36:14.903484+0000","last_fullsized":"2024-04-26T12:36:14.903484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.903354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:16.770079+0000","scrub_duration":0.0017945649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:31.324893+0000","last_change":"2024-04-26T12:36:31.324893+0000","last_active":"2024-04-26T12:36:31.324893+0000","last_peered":"2024-04-26T12:36:31.324893+0000","last_clean":"2024-04-26T12:36:31.324893+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:36:31.324893+0000","last_undegraded":"2024-04-26T12:36:31.324893+0000","last_fullsized":"2024-04-26T12:36:31.324893+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_clean_scrub_stamp":"2024-04-26T12:36:31.324737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:42.977856+0000","scrub_duration":0.0020696540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:25.039601+0000","last_change":"2024-04-26T12:36:25.039601+0000","last_active":"2024-04-26T12:36:25.039601+0000","last_peered":"2024-04-26T12:36:25.039601+0000","last_clean":"2024-04-26T12:36:25.039601+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:36:25.039601+0000","last_undegraded":"2024-04-26T12:36:25.039601+0000","last_fullsized":"2024-04-26T12:36:25.039601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_clean_scrub_stamp":"2024-04-26T12:36:25.039404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:58.902069+0000","scrub_duration":0.0099267869999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:58.126359+0000","last_change":"2024-04-26T12:36:58.126508+0000","last_active":"2024-04-26T12:36:58.126359+0000","last_peered":"2024-04-26T12:36:58.126359+0000","last_clean":"2024-04-26T12:36:58.126359+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:36:58.126359+0000","last_undegraded":"2024-04-26T12:36:58.126359+0000","last_fullsized":"2024-04-26T12:36:58.126359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:58.126323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:58.126323+0000","last_clean_scrub_stamp":"2024-04-26T12:36:58.126323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:08.517108+0000","scrub_duration":0.002073723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"98'159","reported_seq":310,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:48.982871+0000","last_change":"2024-04-26T12:36:48.982998+0000","last_active":"2024-04-26T12:36:48.982871+0000","last_peered":"2024-04-26T12:36:48.982871+0000","last_clean":"2024-04-26T12:36:48.982871+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:36:48.982871+0000","last_undegraded":"2024-04-26T12:36:48.982871+0000","last_fullsized":"2024-04-26T12:36:48.982871+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'159","last_scrub_stamp":"2024-04-26T12:36:48.982845+0000","last_deep_scrub":"98'159","last_deep_scrub_stamp":"2024-04-26T12:36:48.982845+0000","last_clean_scrub_stamp":"2024-04-26T12:36:48.982845+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:53.161246+0000","scrub_duration":0.0049176230000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.886361+0000","last_change":"2024-04-26T12:36:00.886361+0000","last_active":"2024-04-26T12:36:00.886361+0000","last_peered":"2024-04-26T12:36:00.886361+0000","last_clean":"2024-04-26T12:36:00.886361+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:36:00.886361+0000","last_undegraded":"2024-04-26T12:36:00.886361+0000","last_fullsized":"2024-04-26T12:36:00.886361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.886200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.777562+0000","scrub_duration":0.0021566559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":96,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:15.226719+0000","last_change":"2024-04-26T12:37:15.226842+0000","last_active":"2024-04-26T12:37:15.226719+0000","last_peered":"2024-04-26T12:37:15.226719+0000","last_clean":"2024-04-26T12:37:15.226719+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:37:15.226719+0000","last_undegraded":"2024-04-26T12:37:15.226719+0000","last_fullsized":"2024-04-26T12:37:15.226719+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:37:15.226676+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:37:15.226676+0000","last_clean_scrub_stamp":"2024-04-26T12:37:15.226676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:53.631775+0000","scrub_duration":0.0093574120000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:59.165931+0000","last_change":"2024-04-26T12:36:59.166091+0000","last_active":"2024-04-26T12:36:59.165931+0000","last_peered":"2024-04-26T12:36:59.165931+0000","last_clean":"2024-04-26T12:36:59.165931+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:36:59.165931+0000","last_undegraded":"2024-04-26T12:36:59.165931+0000","last_fullsized":"2024-04-26T12:36:59.165931+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:59.165894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:59.165894+0000","last_clean_scrub_stamp":"2024-04-26T12:36:59.165894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:16.495623+0000","scrub_duration":0.001857247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"98'4","reported_seq":91,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.833616+0000","last_change":"2024-04-26T12:35:55.833616+0000","last_active":"2024-04-26T12:35:55.833616+0000","last_peered":"2024-04-26T12:35:55.833616+0000","last_clean":"2024-04-26T12:35:55.833616+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:55.833616+0000","last_undegraded":"2024-04-26T12:35:55.833616+0000","last_fullsized":"2024-04-26T12:35:55.833616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.833451+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:41.021792+0000","scrub_duration":0.003578328,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8102,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:07.544773+0000","last_change":"2024-04-26T12:37:07.544924+0000","last_active":"2024-04-26T12:37:07.544773+0000","last_peered":"2024-04-26T12:37:07.544773+0000","last_clean":"2024-04-26T12:37:07.544773+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:37:07.544773+0000","last_undegraded":"2024-04-26T12:37:07.544773+0000","last_fullsized":"2024-04-26T12:37:07.544773+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7980","last_scrub_stamp":"2024-04-26T12:37:07.544747+0000","last_deep_scrub":"80'7980","last_deep_scrub_stamp":"2024-04-26T12:37:07.544747+0000","last_clean_scrub_stamp":"2024-04-26T12:37:07.544747+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:29.767928+0000","scrub_duration":0.019747101999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:43.256815+0000","last_change":"2024-04-26T12:35:43.256815+0000","last_active":"2024-04-26T12:35:43.256815+0000","last_peered":"2024-04-26T12:35:43.256815+0000","last_clean":"2024-04-26T12:35:43.256815+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:43.256815+0000","last_undegraded":"2024-04-26T12:35:43.256815+0000","last_fullsized":"2024-04-26T12:35:43.256815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_clean_scrub_stamp":"2024-04-26T12:35:43.256655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:10.856381+0000","scrub_duration":0.001974197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.839864+0000","last_change":"2024-04-26T12:35:59.839864+0000","last_active":"2024-04-26T12:35:59.839864+0000","last_peered":"2024-04-26T12:35:59.839864+0000","last_clean":"2024-04-26T12:35:59.839864+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:59.839864+0000","last_undegraded":"2024-04-26T12:35:59.839864+0000","last_fullsized":"2024-04-26T12:35:59.839864+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.839691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:13.298302+0000","scrub_duration":0.0019804599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2108,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.150310+0000","last_change":"2024-04-26T12:35:55.150310+0000","last_active":"2024-04-26T12:35:55.150310+0000","last_peered":"2024-04-26T12:35:55.150310+0000","last_clean":"2024-04-26T12:35:55.150310+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:55.150310+0000","last_undegraded":"2024-04-26T12:35:55.150310+0000","last_fullsized":"2024-04-26T12:35:55.150310+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.150079+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.249254+0000","scrub_duration":0.011542274999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.260010+0000","last_change":"2024-04-26T12:36:41.260010+0000","last_active":"2024-04-26T12:36:41.260010+0000","last_peered":"2024-04-26T12:36:41.260010+0000","last_clean":"2024-04-26T12:36:41.260010+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:36:41.260010+0000","last_undegraded":"2024-04-26T12:36:41.260010+0000","last_fullsized":"2024-04-26T12:36:41.260010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:41.259810+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:41.259810+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.259810+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:21.428799+0000","scrub_duration":0.003236708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.880182+0000","last_change":"2024-04-26T12:35:49.880182+0000","last_active":"2024-04-26T12:35:49.880182+0000","last_peered":"2024-04-26T12:35:49.880182+0000","last_clean":"2024-04-26T12:35:49.880182+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:49.880182+0000","last_undegraded":"2024-04-26T12:35:49.880182+0000","last_fullsized":"2024-04-26T12:35:49.880182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.880012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.320847+0000","scrub_duration":0.0019327299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:43.274955+0000","last_change":"2024-04-26T12:36:43.274955+0000","last_active":"2024-04-26T12:36:43.274955+0000","last_peered":"2024-04-26T12:36:43.274955+0000","last_clean":"2024-04-26T12:36:43.274955+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:36:43.274955+0000","last_undegraded":"2024-04-26T12:36:43.274955+0000","last_fullsized":"2024-04-26T12:36:43.274955+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:43.274807+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:43.274807+0000","last_clean_scrub_stamp":"2024-04-26T12:36:43.274807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:17.223965+0000","scrub_duration":0.007220705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:55.109649+0000","last_change":"2024-04-26T12:36:55.109649+0000","last_active":"2024-04-26T12:36:55.109649+0000","last_peered":"2024-04-26T12:36:55.109649+0000","last_clean":"2024-04-26T12:36:55.109649+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:36:55.109649+0000","last_undegraded":"2024-04-26T12:36:55.109649+0000","last_fullsized":"2024-04-26T12:36:55.109649+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:55.109520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:55.109520+0000","last_clean_scrub_stamp":"2024-04-26T12:36:55.109520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:09.449647+0000","scrub_duration":0.0018695129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"98'9","reported_seq":96,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:13.902674+0000","last_change":"2024-04-26T12:36:13.902674+0000","last_active":"2024-04-26T12:36:13.902674+0000","last_peered":"2024-04-26T12:36:13.902674+0000","last_clean":"2024-04-26T12:36:13.902674+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:36:13.902674+0000","last_undegraded":"2024-04-26T12:36:13.902674+0000","last_fullsized":"2024-04-26T12:36:13.902674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_deep_scrub":"98'9","last_deep_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_clean_scrub_stamp":"2024-04-26T12:36:13.902508+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:02.310643+0000","scrub_duration":0.0037104799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:36.306921+0000","last_change":"2024-04-26T12:36:36.306921+0000","last_active":"2024-04-26T12:36:36.306921+0000","last_peered":"2024-04-26T12:36:36.306921+0000","last_clean":"2024-04-26T12:36:36.306921+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:36:36.306921+0000","last_undegraded":"2024-04-26T12:36:36.306921+0000","last_fullsized":"2024-04-26T12:36:36.306921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:36.306777+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:36.306777+0000","last_clean_scrub_stamp":"2024-04-26T12:36:36.306777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:56.292025+0000","scrub_duration":0.0093015630000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.273898+0000","last_change":"2024-04-26T12:36:22.274010+0000","last_active":"2024-04-26T12:36:22.273898+0000","last_peered":"2024-04-26T12:36:22.273898+0000","last_clean":"2024-04-26T12:36:22.273898+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:36:22.273898+0000","last_undegraded":"2024-04-26T12:36:22.273898+0000","last_fullsized":"2024-04-26T12:36:22.273898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.273870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:52.682099+0000","scrub_duration":0.0016147990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2132,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.254488+0000","last_change":"2024-04-26T12:36:09.254596+0000","last_active":"2024-04-26T12:36:09.254488+0000","last_peered":"2024-04-26T12:36:09.254488+0000","last_clean":"2024-04-26T12:36:09.254488+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:36:09.254488+0000","last_undegraded":"2024-04-26T12:36:09.254488+0000","last_fullsized":"2024-04-26T12:36:09.254488+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2049","last_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_deep_scrub":"80'2049","last_deep_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.254461+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:25.158195+0000","scrub_duration":0.0084966799999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"98'3","reported_seq":124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:06.029049+0000","last_change":"2024-04-26T12:36:06.029182+0000","last_active":"2024-04-26T12:36:06.029049+0000","last_peered":"2024-04-26T12:36:06.029049+0000","last_clean":"2024-04-26T12:36:06.029049+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:36:06.029049+0000","last_undegraded":"2024-04-26T12:36:06.029049+0000","last_fullsized":"2024-04-26T12:36:06.029049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_clean_scrub_stamp":"2024-04-26T12:36:06.029025+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:17.682144+0000","scrub_duration":0.0034148149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.961730+0000","last_change":"2024-04-26T12:36:29.961845+0000","last_active":"2024-04-26T12:36:29.961730+0000","last_peered":"2024-04-26T12:36:29.961730+0000","last_clean":"2024-04-26T12:36:29.961730+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:36:29.961730+0000","last_undegraded":"2024-04-26T12:36:29.961730+0000","last_fullsized":"2024-04-26T12:36:29.961730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2040","last_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_deep_scrub":"80'2040","last_deep_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.961702+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:33.150927+0000","scrub_duration":0.0070304959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"98'4","reported_seq":73,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:19.657406+0000","last_change":"2024-04-26T12:37:19.657511+0000","last_active":"2024-04-26T12:37:19.657406+0000","last_peered":"2024-04-26T12:37:19.657406+0000","last_clean":"2024-04-26T12:37:19.657406+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:37:19.657406+0000","last_undegraded":"2024-04-26T12:37:19.657406+0000","last_fullsized":"2024-04-26T12:37:19.657406+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:37:19.657379+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:37:19.657379+0000","last_clean_scrub_stamp":"2024-04-26T12:37:19.657379+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:33.997506+0000","scrub_duration":0.0033757969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":127,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:41.966293+0000","last_change":"2024-04-26T12:35:41.966428+0000","last_active":"2024-04-26T12:35:41.966293+0000","last_peered":"2024-04-26T12:35:41.966293+0000","last_clean":"2024-04-26T12:35:41.966293+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:41.966293+0000","last_undegraded":"2024-04-26T12:35:41.966293+0000","last_fullsized":"2024-04-26T12:35:41.966293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7","last_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_deep_scrub":"80'7","last_deep_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_clean_scrub_stamp":"2024-04-26T12:35:41.966266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:47.286627+0000","scrub_duration":0.011530692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":88,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:50.849631+0000","last_change":"2024-04-26T12:35:50.849631+0000","last_active":"2024-04-26T12:35:50.849631+0000","last_peered":"2024-04-26T12:35:50.849631+0000","last_clean":"2024-04-26T12:35:50.849631+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:50.849631+0000","last_undegraded":"2024-04-26T12:35:50.849631+0000","last_fullsized":"2024-04-26T12:35:50.849631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_clean_scrub_stamp":"2024-04-26T12:35:50.849501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:53.832051+0000","scrub_duration":0.002006037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4192,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.266881+0000","last_change":"2024-04-26T12:36:07.266994+0000","last_active":"2024-04-26T12:36:07.266881+0000","last_peered":"2024-04-26T12:36:07.266881+0000","last_clean":"2024-04-26T12:36:07.266881+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:36:07.266881+0000","last_undegraded":"2024-04-26T12:36:07.266881+0000","last_fullsized":"2024-04-26T12:36:07.266881+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4070","last_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_deep_scrub":"80'4070","last_deep_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.266853+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:12.587214+0000","scrub_duration":0.013959829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"98'6","reported_seq":93,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:08.980266+0000","last_change":"2024-04-26T12:36:08.980266+0000","last_active":"2024-04-26T12:36:08.980266+0000","last_peered":"2024-04-26T12:36:08.980266+0000","last_clean":"2024-04-26T12:36:08.980266+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:36:08.980266+0000","last_undegraded":"2024-04-26T12:36:08.980266+0000","last_fullsized":"2024-04-26T12:36:08.980266+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_clean_scrub_stamp":"2024-04-26T12:36:08.980132+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:12.661795+0000","scrub_duration":0.0093908959999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2177,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:55.290231+0000","last_change":"2024-04-26T12:36:55.290401+0000","last_active":"2024-04-26T12:36:55.290231+0000","last_peered":"2024-04-26T12:36:55.290231+0000","last_clean":"2024-04-26T12:36:55.290231+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:36:55.290231+0000","last_undegraded":"2024-04-26T12:36:55.290231+0000","last_fullsized":"2024-04-26T12:36:55.290231+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2067","last_scrub_stamp":"2024-04-26T12:36:55.290208+0000","last_deep_scrub":"80'2067","last_deep_scrub_stamp":"2024-04-26T12:36:55.290208+0000","last_clean_scrub_stamp":"2024-04-26T12:36:55.290208+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:58.479433+0000","scrub_duration":0.015349889,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":130,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:12.000253+0000","last_change":"2024-04-26T12:36:12.000253+0000","last_active":"2024-04-26T12:36:12.000253+0000","last_peered":"2024-04-26T12:36:12.000253+0000","last_clean":"2024-04-26T12:36:12.000253+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:36:12.000253+0000","last_undegraded":"2024-04-26T12:36:12.000253+0000","last_fullsized":"2024-04-26T12:36:12.000253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_clean_scrub_stamp":"2024-04-26T12:36:12.000111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:02.393567+0000","scrub_duration":0.017651467000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.855547+0000","last_change":"2024-04-26T12:35:56.855547+0000","last_active":"2024-04-26T12:35:56.855547+0000","last_peered":"2024-04-26T12:35:56.855547+0000","last_clean":"2024-04-26T12:35:56.855547+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:56.855547+0000","last_undegraded":"2024-04-26T12:35:56.855547+0000","last_fullsized":"2024-04-26T12:35:56.855547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.855396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:59.203820+0000","scrub_duration":0.0078982099999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2040,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:26.308957+0000","last_change":"2024-04-26T12:36:26.308957+0000","last_active":"2024-04-26T12:36:26.308957+0000","last_peered":"2024-04-26T12:36:26.308957+0000","last_clean":"2024-04-26T12:36:26.308957+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:36:26.308957+0000","last_undegraded":"2024-04-26T12:36:26.308957+0000","last_fullsized":"2024-04-26T12:36:26.308957+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1986","last_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_deep_scrub":"80'1986","last_deep_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_clean_scrub_stamp":"2024-04-26T12:36:26.308823+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:41.739629+0000","scrub_duration":0.010363702000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2145,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:03.047838+0000","last_change":"2024-04-26T12:37:03.047838+0000","last_active":"2024-04-26T12:37:03.047838+0000","last_peered":"2024-04-26T12:37:03.047838+0000","last_clean":"2024-04-26T12:37:03.047838+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:37:03.047838+0000","last_undegraded":"2024-04-26T12:37:03.047838+0000","last_fullsized":"2024-04-26T12:37:03.047838+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2031","last_scrub_stamp":"2024-04-26T12:37:03.047680+0000","last_deep_scrub":"80'2031","last_deep_scrub_stamp":"2024-04-26T12:37:03.047680+0000","last_clean_scrub_stamp":"2024-04-26T12:37:03.047680+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:18.660703+0000","scrub_duration":0.0080994900000000009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2150,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:37.258311+0000","last_change":"2024-04-26T12:36:37.258311+0000","last_active":"2024-04-26T12:36:37.258311+0000","last_peered":"2024-04-26T12:36:37.258311+0000","last_clean":"2024-04-26T12:36:37.258311+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:36:37.258311+0000","last_undegraded":"2024-04-26T12:36:37.258311+0000","last_fullsized":"2024-04-26T12:36:37.258311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2044","last_scrub_stamp":"2024-04-26T12:36:37.258151+0000","last_deep_scrub":"80'2044","last_deep_scrub_stamp":"2024-04-26T12:36:37.258151+0000","last_clean_scrub_stamp":"2024-04-26T12:36:37.258151+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:27.651607+0000","scrub_duration":0.0086302089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738457,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142980,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228860,"statfs":{"total":96636764160,"available":95466352640,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.377,"5min":0.316,"15min":0.316},"max":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.439}]},{"osd":1,"last update":"Fri Apr 26 12:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.437,"15min":0.441},"min":{"1min":0.41699999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.625,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.44800000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.39000000000000001}]}]},{"osd":0,"up_from":85,"seq":365072220193,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52660,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319180,"statfs":{"total":96636764160,"available":96582840320,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.498},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Apr 26 12:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.52700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738458,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860676,"statfs":{"total":96636764160,"available":95089332224,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35099999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.48499999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.30099999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48099999999999998,"15min":0.45400000000000001},"min":{"1min":0.31900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.66400000000000003,"5min":1.137,"15min":1.137},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:37:40.632 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:30:32.119831+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=35, tm_sec=35, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:37:40.633 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:38:00.634 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:38:01.016 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:38:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2024-04-26T12:38:01.030 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-04-26T12:37:59.088683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":875808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":138,"num_read_kb":120,"num_write":384394,"num_write_kb":1961458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":4194910,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119346,"ondisk_log_size":119346,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":2706804,"kb_used_data":3100,"kb_used_omap":10,"kb_used_meta":2703669,"kb_avail":280408716,"statfs":{"total":289910292480,"available":287138525184,"internally_reserved":0,"allocated":3174400,"data_stored":2964874,"data_compressed":18070,"data_compressed_allocated":90112,"data_compressed_original":1204224,"omap_allocated":10267,"internal_metadata":2768558053},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003119"},"pg_stats":[{"pgid":"4.3f","version":"80'2011","reported_seq":2096,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:05.467533+0000","last_change":"2024-04-26T12:37:05.467714+0000","last_active":"2024-04-26T12:37:05.467533+0000","last_peered":"2024-04-26T12:37:05.467533+0000","last_clean":"2024-04-26T12:37:05.467533+0000","last_became_active":"2024-04-26T12:35:26.165574+0000","last_became_peered":"2024-04-26T12:35:26.165574+0000","last_unstale":"2024-04-26T12:37:05.467533+0000","last_undegraded":"2024-04-26T12:37:05.467533+0000","last_fullsized":"2024-04-26T12:37:05.467533+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:37:05.467471+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:37:05.467471+0000","last_clean_scrub_stamp":"2024-04-26T12:37:05.467471+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.132163+0000","scrub_duration":0.0045153559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5883,"num_write_kb":29012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"80'4","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:52.167251+0000","last_change":"2024-04-26T12:35:52.167251+0000","last_active":"2024-04-26T12:35:52.167251+0000","last_peered":"2024-04-26T12:35:52.167251+0000","last_clean":"2024-04-26T12:35:52.167251+0000","last_became_active":"2024-04-26T12:35:26.165074+0000","last_became_peered":"2024-04-26T12:35:26.165074+0000","last_unstale":"2024-04-26T12:35:52.167251+0000","last_undegraded":"2024-04-26T12:35:52.167251+0000","last_fullsized":"2024-04-26T12:35:52.167251+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-04-26T12:35:52.167078+0000","last_clean_scrub_stamp":"2024-04-26T12:35:52.167078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:48.351227+0000","scrub_duration":0.0068001590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"80'4036","reported_seq":4144,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:45.987903+0000","last_change":"2024-04-26T12:35:45.987903+0000","last_active":"2024-04-26T12:35:45.987903+0000","last_peered":"2024-04-26T12:35:45.987903+0000","last_clean":"2024-04-26T12:35:45.987903+0000","last_became_active":"2024-04-26T12:30:32.618913+0000","last_became_peered":"2024-04-26T12:30:32.618913+0000","last_unstale":"2024-04-26T12:35:45.987903+0000","last_undegraded":"2024-04-26T12:35:45.987903+0000","last_fullsized":"2024-04-26T12:35:45.987903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4036","last_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_deep_scrub":"80'4036","last_deep_scrub_stamp":"2024-04-26T12:35:45.987680+0000","last_clean_scrub_stamp":"2024-04-26T12:35:45.987680+0000","objects_scrubbed":0,"log_size":4036,"log_dups_size":0,"ondisk_log_size":4036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:57.838823+0000","scrub_duration":0.014722818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11965,"num_write_kb":59216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"80'8","reported_seq":129,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:51.983250+0000","last_change":"2024-04-26T12:35:51.983250+0000","last_active":"2024-04-26T12:35:51.983250+0000","last_peered":"2024-04-26T12:35:51.983250+0000","last_clean":"2024-04-26T12:35:51.983250+0000","last_became_active":"2024-04-26T12:35:03.189005+0000","last_became_peered":"2024-04-26T12:35:03.189005+0000","last_unstale":"2024-04-26T12:35:51.983250+0000","last_undegraded":"2024-04-26T12:35:51.983250+0000","last_fullsized":"2024-04-26T12:35:51.983250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:35:51.983105+0000","last_clean_scrub_stamp":"2024-04-26T12:35:51.983105+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:34.627140+0000","scrub_duration":0.0030895979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"80'2045","reported_seq":2167,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:24.326520+0000","last_change":"2024-04-26T12:36:24.326642+0000","last_active":"2024-04-26T12:36:24.326520+0000","last_peered":"2024-04-26T12:36:24.326520+0000","last_clean":"2024-04-26T12:36:24.326520+0000","last_became_active":"2024-04-26T12:35:26.166145+0000","last_became_peered":"2024-04-26T12:35:26.166145+0000","last_unstale":"2024-04-26T12:36:24.326520+0000","last_undegraded":"2024-04-26T12:36:24.326520+0000","last_fullsized":"2024-04-26T12:36:24.326520+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2045","last_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_deep_scrub":"80'2045","last_deep_scrub_stamp":"2024-04-26T12:36:24.326492+0000","last_clean_scrub_stamp":"2024-04-26T12:36:24.326492+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:11.354437+0000","scrub_duration":0.011899834999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6151,"num_write_kb":30248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"80'6","reported_seq":72,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:25.397541+0000","last_change":"2024-04-26T12:37:25.397652+0000","last_active":"2024-04-26T12:37:25.397541+0000","last_peered":"2024-04-26T12:37:25.397541+0000","last_clean":"2024-04-26T12:37:25.397541+0000","last_became_active":"2024-04-26T12:35:28.212990+0000","last_became_peered":"2024-04-26T12:35:28.212990+0000","last_unstale":"2024-04-26T12:37:25.397541+0000","last_undegraded":"2024-04-26T12:37:25.397541+0000","last_fullsized":"2024-04-26T12:37:25.397541+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:37:25.397514+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:37:25.397514+0000","last_clean_scrub_stamp":"2024-04-26T12:37:25.397514+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:58.883711+0000","scrub_duration":0.010796907999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"80'5","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:28.403421+0000","last_change":"2024-04-26T12:37:28.403538+0000","last_active":"2024-04-26T12:37:28.403421+0000","last_peered":"2024-04-26T12:37:28.403421+0000","last_clean":"2024-04-26T12:37:28.403421+0000","last_became_active":"2024-04-26T12:35:28.213870+0000","last_became_peered":"2024-04-26T12:35:28.213870+0000","last_unstale":"2024-04-26T12:37:28.403421+0000","last_undegraded":"2024-04-26T12:37:28.403421+0000","last_fullsized":"2024-04-26T12:37:28.403421+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:37:28.403394+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:37:28.403394+0000","last_clean_scrub_stamp":"2024-04-26T12:37:28.403394+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:14.988365+0000","scrub_duration":0.007319954,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"80'8077","reported_seq":8217,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.006065+0000","last_change":"2024-04-26T12:35:38.006208+0000","last_active":"2024-04-26T12:35:38.006065+0000","last_peered":"2024-04-26T12:35:38.006065+0000","last_clean":"2024-04-26T12:35:38.006065+0000","last_became_active":"2024-04-26T12:35:06.901890+0000","last_became_peered":"2024-04-26T12:35:06.901890+0000","last_unstale":"2024-04-26T12:35:38.006065+0000","last_undegraded":"2024-04-26T12:35:38.006065+0000","last_fullsized":"2024-04-26T12:35:38.006065+0000","mapping_epoch":89,"log_start":"68'3800","ondisk_log_start":"68'3800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8077","last_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_deep_scrub":"80'8077","last_deep_scrub_stamp":"2024-04-26T12:35:38.006040+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.006040+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":3800,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:57.036646+0000","scrub_duration":0.014128129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24016,"num_write_kb":118900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"80'6081","reported_seq":6192,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:10.074606+0000","last_change":"2024-04-26T12:37:10.074606+0000","last_active":"2024-04-26T12:37:10.074606+0000","last_peered":"2024-04-26T12:37:10.074606+0000","last_clean":"2024-04-26T12:37:10.074606+0000","last_became_active":"2024-04-26T12:35:06.900526+0000","last_became_peered":"2024-04-26T12:35:06.900526+0000","last_unstale":"2024-04-26T12:37:10.074606+0000","last_undegraded":"2024-04-26T12:37:10.074606+0000","last_fullsized":"2024-04-26T12:37:10.074606+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6081","last_scrub_stamp":"2024-04-26T12:37:10.074452+0000","last_deep_scrub":"80'6081","last_deep_scrub_stamp":"2024-04-26T12:37:10.074452+0000","last_clean_scrub_stamp":"2024-04-26T12:37:10.074452+0000","objects_scrubbed":0,"log_size":6081,"log_dups_size":0,"ondisk_log_size":6081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:26.460625+0000","scrub_duration":0.010833512,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18120,"num_write_kb":89076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"80'6120","reported_seq":6253,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.280948+0000","last_change":"2024-04-26T12:35:49.280948+0000","last_active":"2024-04-26T12:35:49.280948+0000","last_peered":"2024-04-26T12:35:49.280948+0000","last_clean":"2024-04-26T12:35:49.280948+0000","last_became_active":"2024-04-26T12:35:26.165444+0000","last_became_peered":"2024-04-26T12:35:26.165444+0000","last_unstale":"2024-04-26T12:35:49.280948+0000","last_undegraded":"2024-04-26T12:35:49.280948+0000","last_fullsized":"2024-04-26T12:35:49.280948+0000","mapping_epoch":94,"log_start":"63'1700","ondisk_log_start":"63'1700","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6120","last_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_deep_scrub":"80'6120","last_deep_scrub_stamp":"2024-04-26T12:35:49.280781+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.280781+0000","objects_scrubbed":0,"log_size":4420,"log_dups_size":1700,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:12.424132+0000","scrub_duration":0.01226383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18103,"num_write_kb":149459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"80'3985","reported_seq":4092,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:37.371899+0000","last_change":"2024-04-26T12:37:37.371899+0000","last_active":"2024-04-26T12:37:37.371899+0000","last_peered":"2024-04-26T12:37:37.371899+0000","last_clean":"2024-04-26T12:37:37.371899+0000","last_became_active":"2024-04-26T12:35:28.214344+0000","last_became_peered":"2024-04-26T12:35:28.214344+0000","last_unstale":"2024-04-26T12:37:37.371899+0000","last_undegraded":"2024-04-26T12:37:37.371899+0000","last_fullsized":"2024-04-26T12:37:37.371899+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3985","last_scrub_stamp":"2024-04-26T12:37:37.371745+0000","last_deep_scrub":"80'3985","last_deep_scrub_stamp":"2024-04-26T12:37:37.371745+0000","last_clean_scrub_stamp":"2024-04-26T12:37:37.371745+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:50.189959+0000","scrub_duration":0.013085207999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11848,"num_write_kb":58648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"80'2051","reported_seq":2106,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.138597+0000","last_change":"2024-04-26T12:35:56.138597+0000","last_active":"2024-04-26T12:35:56.138597+0000","last_peered":"2024-04-26T12:35:56.138597+0000","last_clean":"2024-04-26T12:35:56.138597+0000","last_became_active":"2024-04-26T12:35:26.167002+0000","last_became_peered":"2024-04-26T12:35:26.167002+0000","last_unstale":"2024-04-26T12:35:56.138597+0000","last_undegraded":"2024-04-26T12:35:56.138597+0000","last_fullsized":"2024-04-26T12:35:56.138597+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2051","last_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_deep_scrub":"80'2051","last_deep_scrub_stamp":"2024-04-26T12:35:56.138454+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.138454+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:03.549045+0000","scrub_duration":0.011597293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6135,"num_write_kb":30324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"80'2026","reported_seq":2151,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.311400+0000","last_change":"2024-04-26T12:36:29.311400+0000","last_active":"2024-04-26T12:36:29.311400+0000","last_peered":"2024-04-26T12:36:29.311400+0000","last_clean":"2024-04-26T12:36:29.311400+0000","last_became_active":"2024-04-26T12:35:26.164574+0000","last_became_peered":"2024-04-26T12:35:26.164574+0000","last_unstale":"2024-04-26T12:36:29.311400+0000","last_undegraded":"2024-04-26T12:36:29.311400+0000","last_fullsized":"2024-04-26T12:36:29.311400+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2026","last_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_deep_scrub":"80'2026","last_deep_scrub_stamp":"2024-04-26T12:36:29.311261+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.311261+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:55.733965+0000","scrub_duration":0.0058874599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"80'2052","reported_seq":2160,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:57.048340+0000","last_change":"2024-04-26T12:35:57.048340+0000","last_active":"2024-04-26T12:35:57.048340+0000","last_peered":"2024-04-26T12:35:57.048340+0000","last_clean":"2024-04-26T12:35:57.048340+0000","last_became_active":"2024-04-26T12:30:32.616867+0000","last_became_peered":"2024-04-26T12:30:32.616867+0000","last_unstale":"2024-04-26T12:35:57.048340+0000","last_undegraded":"2024-04-26T12:35:57.048340+0000","last_fullsized":"2024-04-26T12:35:57.048340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2052","last_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_deep_scrub":"80'2052","last_deep_scrub_stamp":"2024-04-26T12:35:57.048199+0000","last_clean_scrub_stamp":"2024-04-26T12:35:57.048199+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:27.456428+0000","scrub_duration":0.016047618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6095,"num_write_kb":29988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"80'2071","reported_seq":2179,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:01.108416+0000","last_change":"2024-04-26T12:36:01.108416+0000","last_active":"2024-04-26T12:36:01.108416+0000","last_peered":"2024-04-26T12:36:01.108416+0000","last_clean":"2024-04-26T12:36:01.108416+0000","last_became_active":"2024-04-26T12:30:32.617900+0000","last_became_peered":"2024-04-26T12:30:32.617900+0000","last_unstale":"2024-04-26T12:36:01.108416+0000","last_undegraded":"2024-04-26T12:36:01.108416+0000","last_fullsized":"2024-04-26T12:36:01.108416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2071","last_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_deep_scrub":"80'2071","last_deep_scrub_stamp":"2024-04-26T12:36:01.108240+0000","last_clean_scrub_stamp":"2024-04-26T12:36:01.108240+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:16.539046+0000","scrub_duration":0.014518568000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6137,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2013","reported_seq":2123,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:20.287053+0000","last_change":"2024-04-26T12:37:20.287053+0000","last_active":"2024-04-26T12:37:20.287053+0000","last_peered":"2024-04-26T12:37:20.287053+0000","last_clean":"2024-04-26T12:37:20.287053+0000","last_became_active":"2024-04-26T12:35:28.213199+0000","last_became_peered":"2024-04-26T12:35:28.213199+0000","last_unstale":"2024-04-26T12:37:20.287053+0000","last_undegraded":"2024-04-26T12:37:20.287053+0000","last_fullsized":"2024-04-26T12:37:20.287053+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2013","last_scrub_stamp":"2024-04-26T12:37:20.286898+0000","last_deep_scrub":"80'2013","last_deep_scrub_stamp":"2024-04-26T12:37:20.286898+0000","last_clean_scrub_stamp":"2024-04-26T12:37:20.286898+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:06.249198+0000","scrub_duration":0.017240426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"80'2015","reported_seq":2131,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:13.050459+0000","last_change":"2024-04-26T12:37:13.050459+0000","last_active":"2024-04-26T12:37:13.050459+0000","last_peered":"2024-04-26T12:37:13.050459+0000","last_clean":"2024-04-26T12:37:13.050459+0000","last_became_active":"2024-04-26T12:35:06.900579+0000","last_became_peered":"2024-04-26T12:35:06.900579+0000","last_unstale":"2024-04-26T12:37:13.050459+0000","last_undegraded":"2024-04-26T12:37:13.050459+0000","last_fullsized":"2024-04-26T12:37:13.050459+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2015","last_scrub_stamp":"2024-04-26T12:37:13.050294+0000","last_deep_scrub":"80'2015","last_deep_scrub_stamp":"2024-04-26T12:37:13.050294+0000","last_clean_scrub_stamp":"2024-04-26T12:37:13.050294+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:52.328160+0000","scrub_duration":0.0048918870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5907,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"80'2071","reported_seq":2153,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:18.634705+0000","last_change":"2024-04-26T12:37:18.634705+0000","last_active":"2024-04-26T12:37:18.634705+0000","last_peered":"2024-04-26T12:37:18.634705+0000","last_clean":"2024-04-26T12:37:18.634705+0000","last_became_active":"2024-04-26T12:35:26.169363+0000","last_became_peered":"2024-04-26T12:35:26.169363+0000","last_unstale":"2024-04-26T12:37:18.634705+0000","last_undegraded":"2024-04-26T12:37:18.634705+0000","last_fullsized":"2024-04-26T12:37:18.634705+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2071","last_scrub_stamp":"2024-04-26T12:37:18.634526+0000","last_deep_scrub":"80'2071","last_deep_scrub_stamp":"2024-04-26T12:37:18.634526+0000","last_clean_scrub_stamp":"2024-04-26T12:37:18.634526+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:05.350874+0000","scrub_duration":0.0080801680000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6020,"num_write_kb":29724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"80'3996","reported_seq":4111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:11.051825+0000","last_change":"2024-04-26T12:37:11.051825+0000","last_active":"2024-04-26T12:37:11.051825+0000","last_peered":"2024-04-26T12:37:11.051825+0000","last_clean":"2024-04-26T12:37:11.051825+0000","last_became_active":"2024-04-26T12:35:06.898021+0000","last_became_peered":"2024-04-26T12:35:06.898021+0000","last_unstale":"2024-04-26T12:37:11.051825+0000","last_undegraded":"2024-04-26T12:37:11.051825+0000","last_fullsized":"2024-04-26T12:37:11.051825+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3996","last_scrub_stamp":"2024-04-26T12:37:11.051664+0000","last_deep_scrub":"80'3996","last_deep_scrub_stamp":"2024-04-26T12:37:11.051664+0000","last_clean_scrub_stamp":"2024-04-26T12:37:11.051664+0000","objects_scrubbed":0,"log_size":3996,"log_dups_size":0,"ondisk_log_size":3996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:33.819537+0000","scrub_duration":0.0080050139999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11849,"num_write_kb":58516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"80'4103","reported_seq":4235,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:16.031481+0000","last_change":"2024-04-26T12:36:16.031481+0000","last_active":"2024-04-26T12:36:16.031481+0000","last_peered":"2024-04-26T12:36:16.031481+0000","last_clean":"2024-04-26T12:36:16.031481+0000","last_became_active":"2024-04-26T12:35:05.899303+0000","last_became_peered":"2024-04-26T12:35:05.899303+0000","last_unstale":"2024-04-26T12:36:16.031481+0000","last_undegraded":"2024-04-26T12:36:16.031481+0000","last_fullsized":"2024-04-26T12:36:16.031481+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4103","last_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_deep_scrub":"80'4103","last_deep_scrub_stamp":"2024-04-26T12:36:16.031346+0000","last_clean_scrub_stamp":"2024-04-26T12:36:16.031346+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:35.734914+0000","scrub_duration":0.0054779479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12187,"num_write_kb":60080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"80'11","reported_seq":132,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:12.202975+0000","last_change":"2024-04-26T12:37:12.202975+0000","last_active":"2024-04-26T12:37:12.202975+0000","last_peered":"2024-04-26T12:37:12.202975+0000","last_clean":"2024-04-26T12:37:12.202975+0000","last_became_active":"2024-04-26T12:35:03.184475+0000","last_became_peered":"2024-04-26T12:35:03.184475+0000","last_unstale":"2024-04-26T12:37:12.202975+0000","last_undegraded":"2024-04-26T12:37:12.202975+0000","last_fullsized":"2024-04-26T12:37:12.202975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'11","last_scrub_stamp":"2024-04-26T12:37:12.202785+0000","last_deep_scrub":"80'11","last_deep_scrub_stamp":"2024-04-26T12:37:12.202785+0000","last_clean_scrub_stamp":"2024-04-26T12:37:12.202785+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:39.672705+0000","scrub_duration":0.0071294280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"80'2023","reported_seq":2129,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:40.305800+0000","last_change":"2024-04-26T12:36:40.305800+0000","last_active":"2024-04-26T12:36:40.305800+0000","last_peered":"2024-04-26T12:36:40.305800+0000","last_clean":"2024-04-26T12:36:40.305800+0000","last_became_active":"2024-04-26T12:30:32.613726+0000","last_became_peered":"2024-04-26T12:30:32.613726+0000","last_unstale":"2024-04-26T12:36:40.305800+0000","last_undegraded":"2024-04-26T12:36:40.305800+0000","last_fullsized":"2024-04-26T12:36:40.305800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2023","last_scrub_stamp":"2024-04-26T12:36:40.305650+0000","last_deep_scrub":"80'2023","last_deep_scrub_stamp":"2024-04-26T12:36:40.305650+0000","last_clean_scrub_stamp":"2024-04-26T12:36:40.305650+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:59.028356+0000","scrub_duration":0.019539554000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":29828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"80'1995","reported_seq":2112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:06.069235+0000","last_change":"2024-04-26T12:37:06.069235+0000","last_active":"2024-04-26T12:37:06.069235+0000","last_peered":"2024-04-26T12:37:06.069235+0000","last_clean":"2024-04-26T12:37:06.069235+0000","last_became_active":"2024-04-26T12:35:05.896616+0000","last_became_peered":"2024-04-26T12:35:05.896616+0000","last_unstale":"2024-04-26T12:37:06.069235+0000","last_undegraded":"2024-04-26T12:37:06.069235+0000","last_fullsized":"2024-04-26T12:37:06.069235+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1995","last_scrub_stamp":"2024-04-26T12:37:06.069104+0000","last_deep_scrub":"80'1995","last_deep_scrub_stamp":"2024-04-26T12:37:06.069104+0000","last_clean_scrub_stamp":"2024-04-26T12:37:06.069104+0000","objects_scrubbed":0,"log_size":1995,"log_dups_size":0,"ondisk_log_size":1995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:53.097688+0000","scrub_duration":0.0079981329999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":29592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"80'4067","reported_seq":4152,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:03.189097+0000","last_change":"2024-04-26T12:36:03.189097+0000","last_active":"2024-04-26T12:36:03.189097+0000","last_peered":"2024-04-26T12:36:03.189097+0000","last_clean":"2024-04-26T12:36:03.189097+0000","last_became_active":"2024-04-26T12:35:26.163060+0000","last_became_peered":"2024-04-26T12:35:26.163060+0000","last_unstale":"2024-04-26T12:36:03.189097+0000","last_undegraded":"2024-04-26T12:36:03.189097+0000","last_fullsized":"2024-04-26T12:36:03.189097+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4067","last_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_deep_scrub":"80'4067","last_deep_scrub_stamp":"2024-04-26T12:36:03.188951+0000","last_clean_scrub_stamp":"2024-04-26T12:36:03.188951+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:22.219557+0000","scrub_duration":0.013814754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11939,"num_write_kb":58920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"80'2053","reported_seq":2154,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.127545+0000","last_change":"2024-04-26T12:35:59.127545+0000","last_active":"2024-04-26T12:35:59.127545+0000","last_peered":"2024-04-26T12:35:59.127545+0000","last_clean":"2024-04-26T12:35:59.127545+0000","last_became_active":"2024-04-26T12:35:26.169210+0000","last_became_peered":"2024-04-26T12:35:26.169210+0000","last_unstale":"2024-04-26T12:35:59.127545+0000","last_undegraded":"2024-04-26T12:35:59.127545+0000","last_fullsized":"2024-04-26T12:35:59.127545+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2053","last_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_deep_scrub":"80'2053","last_deep_scrub_stamp":"2024-04-26T12:35:59.127404+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.127404+0000","objects_scrubbed":0,"log_size":2053,"log_dups_size":0,"ondisk_log_size":2053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:55.177992+0000","scrub_duration":0.018465079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6023,"num_write_kb":29684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"80'15","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.893816+0000","last_change":"2024-04-26T12:36:17.893816+0000","last_active":"2024-04-26T12:36:17.893816+0000","last_peered":"2024-04-26T12:36:17.893816+0000","last_clean":"2024-04-26T12:36:17.893816+0000","last_became_active":"2024-04-26T12:35:03.188450+0000","last_became_peered":"2024-04-26T12:35:03.188450+0000","last_unstale":"2024-04-26T12:36:17.893816+0000","last_undegraded":"2024-04-26T12:36:17.893816+0000","last_fullsized":"2024-04-26T12:36:17.893816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:36:17.893660+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.893660+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:02.255600+0000","scrub_duration":0.0081512219999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"80'2006","reported_seq":2114,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.999776+0000","last_change":"2024-04-26T12:35:49.999776+0000","last_active":"2024-04-26T12:35:49.999776+0000","last_peered":"2024-04-26T12:35:49.999776+0000","last_clean":"2024-04-26T12:35:49.999776+0000","last_became_active":"2024-04-26T12:30:32.618758+0000","last_became_peered":"2024-04-26T12:30:32.618758+0000","last_unstale":"2024-04-26T12:35:49.999776+0000","last_undegraded":"2024-04-26T12:35:49.999776+0000","last_fullsized":"2024-04-26T12:35:49.999776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2006","last_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_deep_scrub":"80'2006","last_deep_scrub_stamp":"2024-04-26T12:35:49.999571+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.999571+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:58.313518+0000","scrub_duration":0.012700795000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":29764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:47.311342+0000","last_change":"2024-04-26T12:36:47.311461+0000","last_active":"2024-04-26T12:36:47.311342+0000","last_peered":"2024-04-26T12:36:47.311342+0000","last_clean":"2024-04-26T12:36:47.311342+0000","last_became_active":"2024-04-26T12:35:26.165034+0000","last_became_peered":"2024-04-26T12:35:26.165034+0000","last_unstale":"2024-04-26T12:36:47.311342+0000","last_undegraded":"2024-04-26T12:36:47.311342+0000","last_fullsized":"2024-04-26T12:36:47.311342+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:36:47.311317+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:36:47.311317+0000","last_clean_scrub_stamp":"2024-04-26T12:36:47.311317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:34.018306+0000","scrub_duration":0.002254729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"80'15","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:38.161638+0000","last_change":"2024-04-26T12:35:38.161638+0000","last_active":"2024-04-26T12:35:38.161638+0000","last_peered":"2024-04-26T12:35:38.161638+0000","last_clean":"2024-04-26T12:35:38.161638+0000","last_became_active":"2024-04-26T12:35:26.166484+0000","last_became_peered":"2024-04-26T12:35:26.166484+0000","last_unstale":"2024-04-26T12:35:38.161638+0000","last_undegraded":"2024-04-26T12:35:38.161638+0000","last_fullsized":"2024-04-26T12:35:38.161638+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'15","last_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_deep_scrub":"80'15","last_deep_scrub_stamp":"2024-04-26T12:35:38.161494+0000","last_clean_scrub_stamp":"2024-04-26T12:35:38.161494+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:19.249824+0000","scrub_duration":0.014847795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:35.181718+0000","last_change":"2024-04-26T12:36:35.181718+0000","last_active":"2024-04-26T12:36:35.181718+0000","last_peered":"2024-04-26T12:36:35.181718+0000","last_clean":"2024-04-26T12:36:35.181718+0000","last_became_active":"2024-04-26T12:35:03.179078+0000","last_became_peered":"2024-04-26T12:35:03.179078+0000","last_unstale":"2024-04-26T12:36:35.181718+0000","last_undegraded":"2024-04-26T12:36:35.181718+0000","last_fullsized":"2024-04-26T12:36:35.181718+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:35.181561+0000","last_clean_scrub_stamp":"2024-04-26T12:36:35.181561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:15.742099+0000","scrub_duration":0.0020050630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"80'5","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.946252+0000","last_change":"2024-04-26T12:36:07.946252+0000","last_active":"2024-04-26T12:36:07.946252+0000","last_peered":"2024-04-26T12:36:07.946252+0000","last_clean":"2024-04-26T12:36:07.946252+0000","last_became_active":"2024-04-26T12:35:03.188799+0000","last_became_peered":"2024-04-26T12:35:03.188799+0000","last_unstale":"2024-04-26T12:36:07.946252+0000","last_undegraded":"2024-04-26T12:36:07.946252+0000","last_fullsized":"2024-04-26T12:36:07.946252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:07.946106+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.946106+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:15.251311+0000","scrub_duration":0.0085133599999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:30.077900+0000","last_change":"2024-04-26T12:36:30.077900+0000","last_active":"2024-04-26T12:36:30.077900+0000","last_peered":"2024-04-26T12:36:30.077900+0000","last_clean":"2024-04-26T12:36:30.077900+0000","last_became_active":"2024-04-26T12:35:03.169973+0000","last_became_peered":"2024-04-26T12:35:03.169973+0000","last_unstale":"2024-04-26T12:36:30.077900+0000","last_undegraded":"2024-04-26T12:36:30.077900+0000","last_fullsized":"2024-04-26T12:36:30.077900+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:30.077735+0000","last_clean_scrub_stamp":"2024-04-26T12:36:30.077735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:09.005584+0000","scrub_duration":0.0019678730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"80'6","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:22.715763+0000","last_change":"2024-04-26T12:37:22.715763+0000","last_active":"2024-04-26T12:37:22.715763+0000","last_peered":"2024-04-26T12:37:22.715763+0000","last_clean":"2024-04-26T12:37:22.715763+0000","last_became_active":"2024-04-26T12:35:26.164215+0000","last_became_peered":"2024-04-26T12:35:26.164215+0000","last_unstale":"2024-04-26T12:37:22.715763+0000","last_undegraded":"2024-04-26T12:37:22.715763+0000","last_fullsized":"2024-04-26T12:37:22.715763+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:37:22.715615+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:37:22.715615+0000","last_clean_scrub_stamp":"2024-04-26T12:37:22.715615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:33.106400+0000","scrub_duration":0.003655195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"79'1","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:58.133655+0000","last_change":"2024-04-26T12:36:58.133655+0000","last_active":"2024-04-26T12:36:58.133655+0000","last_peered":"2024-04-26T12:36:58.133655+0000","last_clean":"2024-04-26T12:36:58.133655+0000","last_became_active":"2024-04-26T12:35:03.194789+0000","last_became_peered":"2024-04-26T12:35:03.194789+0000","last_unstale":"2024-04-26T12:36:58.133655+0000","last_undegraded":"2024-04-26T12:36:58.133655+0000","last_fullsized":"2024-04-26T12:36:58.133655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'1","last_scrub_stamp":"2024-04-26T12:36:58.133490+0000","last_deep_scrub":"79'1","last_deep_scrub_stamp":"2024-04-26T12:36:58.133490+0000","last_clean_scrub_stamp":"2024-04-26T12:36:58.133490+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:43.786311+0000","scrub_duration":0.00167731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"80'6","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:46.789233+0000","last_change":"2024-04-26T12:35:46.789233+0000","last_active":"2024-04-26T12:35:46.789233+0000","last_peered":"2024-04-26T12:35:46.789233+0000","last_clean":"2024-04-26T12:35:46.789233+0000","last_became_active":"2024-04-26T12:35:03.165465+0000","last_became_peered":"2024-04-26T12:35:03.165465+0000","last_unstale":"2024-04-26T12:35:46.789233+0000","last_undegraded":"2024-04-26T12:35:46.789233+0000","last_fullsized":"2024-04-26T12:35:46.789233+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6","last_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_deep_scrub":"80'6","last_deep_scrub_stamp":"2024-04-26T12:35:46.789065+0000","last_clean_scrub_stamp":"2024-04-26T12:35:46.789065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:51.542684+0000","scrub_duration":0.010829827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":68,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:31.405857+0000","last_change":"2024-04-26T12:37:31.405857+0000","last_active":"2024-04-26T12:37:31.405857+0000","last_peered":"2024-04-26T12:37:31.405857+0000","last_clean":"2024-04-26T12:37:31.405857+0000","last_became_active":"2024-04-26T12:35:28.213082+0000","last_became_peered":"2024-04-26T12:35:28.213082+0000","last_unstale":"2024-04-26T12:37:31.405857+0000","last_undegraded":"2024-04-26T12:37:31.405857+0000","last_fullsized":"2024-04-26T12:37:31.405857+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:37:31.405727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:37:31.405727+0000","last_clean_scrub_stamp":"2024-04-26T12:37:31.405727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:45.219854+0000","scrub_duration":0.0021049290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"80'6064","reported_seq":6195,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:07.037664+0000","last_change":"2024-04-26T12:37:07.037664+0000","last_active":"2024-04-26T12:37:07.037664+0000","last_peered":"2024-04-26T12:37:07.037664+0000","last_clean":"2024-04-26T12:37:07.037664+0000","last_became_active":"2024-04-26T12:35:06.900936+0000","last_became_peered":"2024-04-26T12:35:06.900936+0000","last_unstale":"2024-04-26T12:37:07.037664+0000","last_undegraded":"2024-04-26T12:37:07.037664+0000","last_fullsized":"2024-04-26T12:37:07.037664+0000","mapping_epoch":89,"log_start":"65'1800","ondisk_log_start":"65'1800","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6064","last_scrub_stamp":"2024-04-26T12:37:07.037516+0000","last_deep_scrub":"80'6064","last_deep_scrub_stamp":"2024-04-26T12:37:07.037516+0000","last_clean_scrub_stamp":"2024-04-26T12:37:07.037516+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1800,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:16.565817+0000","scrub_duration":0.011608321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17961,"num_write_kb":88884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"98'8","reported_seq":76,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:14.620563+0000","last_change":"2024-04-26T12:37:14.620563+0000","last_active":"2024-04-26T12:37:14.620563+0000","last_peered":"2024-04-26T12:37:14.620563+0000","last_clean":"2024-04-26T12:37:14.620563+0000","last_became_active":"2024-04-26T12:35:26.167704+0000","last_became_peered":"2024-04-26T12:35:26.167704+0000","last_unstale":"2024-04-26T12:37:14.620563+0000","last_undegraded":"2024-04-26T12:37:14.620563+0000","last_fullsized":"2024-04-26T12:37:14.620563+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'8","last_scrub_stamp":"2024-04-26T12:37:14.620431+0000","last_deep_scrub":"98'8","last_deep_scrub_stamp":"2024-04-26T12:37:14.620431+0000","last_clean_scrub_stamp":"2024-04-26T12:37:14.620431+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:18.798832+0000","scrub_duration":0.0042118800000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"80'4058","reported_seq":4175,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:42.691943+0000","last_change":"2024-04-26T12:35:42.691943+0000","last_active":"2024-04-26T12:35:42.691943+0000","last_peered":"2024-04-26T12:35:42.691943+0000","last_clean":"2024-04-26T12:35:42.691943+0000","last_became_active":"2024-04-26T12:35:05.897379+0000","last_became_peered":"2024-04-26T12:35:05.897379+0000","last_unstale":"2024-04-26T12:35:42.691943+0000","last_undegraded":"2024-04-26T12:35:42.691943+0000","last_fullsized":"2024-04-26T12:35:42.691943+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4058","last_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_deep_scrub":"80'4058","last_deep_scrub_stamp":"2024-04-26T12:35:42.691721+0000","last_clean_scrub_stamp":"2024-04-26T12:35:42.691721+0000","objects_scrubbed":0,"log_size":4058,"log_dups_size":0,"ondisk_log_size":4058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:59.851784+0000","scrub_duration":0.010224120999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11934,"num_write_kb":58991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"98'100","reported_seq":209,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.932662+0000","last_change":"2024-04-26T12:36:41.932662+0000","last_active":"2024-04-26T12:36:41.932662+0000","last_peered":"2024-04-26T12:36:41.932662+0000","last_clean":"2024-04-26T12:36:41.932662+0000","last_became_active":"2024-04-26T12:30:32.158787+0000","last_became_peered":"2024-04-26T12:30:32.158787+0000","last_unstale":"2024-04-26T12:36:41.932662+0000","last_undegraded":"2024-04-26T12:36:41.932662+0000","last_fullsized":"2024-04-26T12:36:41.932662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'100","last_scrub_stamp":"2024-04-26T12:36:41.932523+0000","last_deep_scrub":"98'100","last_deep_scrub_stamp":"2024-04-26T12:36:41.932523+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.932523+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:04.155704+0000","scrub_duration":0.0057948440000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284036,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"80'4094","reported_seq":4202,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.099460+0000","last_change":"2024-04-26T12:35:59.099460+0000","last_active":"2024-04-26T12:35:59.099460+0000","last_peered":"2024-04-26T12:35:59.099460+0000","last_clean":"2024-04-26T12:35:59.099460+0000","last_became_active":"2024-04-26T12:30:32.619266+0000","last_became_peered":"2024-04-26T12:30:32.619266+0000","last_unstale":"2024-04-26T12:35:59.099460+0000","last_undegraded":"2024-04-26T12:35:59.099460+0000","last_fullsized":"2024-04-26T12:35:59.099460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4094","last_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_deep_scrub":"80'4094","last_deep_scrub_stamp":"2024-04-26T12:35:59.099256+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.099256+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:46.127201+0000","scrub_duration":0.013902207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11915,"num_write_kb":59148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"98'4","reported_seq":126,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:10.954415+0000","last_change":"2024-04-26T12:36:10.954415+0000","last_active":"2024-04-26T12:36:10.954415+0000","last_peered":"2024-04-26T12:36:10.954415+0000","last_clean":"2024-04-26T12:36:10.954415+0000","last_became_active":"2024-04-26T12:35:03.184216+0000","last_became_peered":"2024-04-26T12:35:03.184216+0000","last_unstale":"2024-04-26T12:36:10.954415+0000","last_undegraded":"2024-04-26T12:36:10.954415+0000","last_fullsized":"2024-04-26T12:36:10.954415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:10.954281+0000","last_clean_scrub_stamp":"2024-04-26T12:36:10.954281+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:30.939529+0000","scrub_duration":0.0038576499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"80'1968","reported_seq":2094,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.082579+0000","last_change":"2024-04-26T12:36:00.082579+0000","last_active":"2024-04-26T12:36:00.082579+0000","last_peered":"2024-04-26T12:36:00.082579+0000","last_clean":"2024-04-26T12:36:00.082579+0000","last_became_active":"2024-04-26T12:35:26.164836+0000","last_became_peered":"2024-04-26T12:35:26.164836+0000","last_unstale":"2024-04-26T12:36:00.082579+0000","last_undegraded":"2024-04-26T12:36:00.082579+0000","last_fullsized":"2024-04-26T12:36:00.082579+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1968","last_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_deep_scrub":"80'1968","last_deep_scrub_stamp":"2024-04-26T12:36:00.082433+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.082433+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.908109+0000","scrub_duration":0.011161457,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5906,"num_write_kb":29288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:51.234006+0000","last_change":"2024-04-26T12:36:51.234006+0000","last_active":"2024-04-26T12:36:51.234006+0000","last_peered":"2024-04-26T12:36:51.234006+0000","last_clean":"2024-04-26T12:36:51.234006+0000","last_became_active":"2024-04-26T12:35:03.164586+0000","last_became_peered":"2024-04-26T12:35:03.164586+0000","last_unstale":"2024-04-26T12:36:51.234006+0000","last_undegraded":"2024-04-26T12:36:51.234006+0000","last_fullsized":"2024-04-26T12:36:51.234006+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:51.233800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:51.233800+0000","last_clean_scrub_stamp":"2024-04-26T12:36:51.233800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:27.209478+0000","scrub_duration":0.0021296700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"80'2009","reported_seq":2091,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:23.748558+0000","last_change":"2024-04-26T12:37:23.748558+0000","last_active":"2024-04-26T12:37:23.748558+0000","last_peered":"2024-04-26T12:37:23.748558+0000","last_clean":"2024-04-26T12:37:23.748558+0000","last_became_active":"2024-04-26T12:35:26.164900+0000","last_became_peered":"2024-04-26T12:35:26.164900+0000","last_unstale":"2024-04-26T12:37:23.748558+0000","last_undegraded":"2024-04-26T12:37:23.748558+0000","last_fullsized":"2024-04-26T12:37:23.748558+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2009","last_scrub_stamp":"2024-04-26T12:37:23.748419+0000","last_deep_scrub":"80'2009","last_deep_scrub_stamp":"2024-04-26T12:37:23.748419+0000","last_clean_scrub_stamp":"2024-04-26T12:37:23.748419+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:41.078148+0000","scrub_duration":0.013466535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":29512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:17.344357+0000","last_change":"2024-04-26T12:36:17.344357+0000","last_active":"2024-04-26T12:36:17.344357+0000","last_peered":"2024-04-26T12:36:17.344357+0000","last_clean":"2024-04-26T12:36:17.344357+0000","last_became_active":"2024-04-26T12:35:26.163404+0000","last_became_peered":"2024-04-26T12:35:26.163404+0000","last_unstale":"2024-04-26T12:36:17.344357+0000","last_undegraded":"2024-04-26T12:36:17.344357+0000","last_fullsized":"2024-04-26T12:36:17.344357+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:17.344200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:17.344200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:59.988235+0000","scrub_duration":0.0016444610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"80'10","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:23.003182+0000","last_change":"2024-04-26T12:36:23.003182+0000","last_active":"2024-04-26T12:36:23.003182+0000","last_peered":"2024-04-26T12:36:23.003182+0000","last_clean":"2024-04-26T12:36:23.003182+0000","last_became_active":"2024-04-26T12:35:03.189889+0000","last_became_peered":"2024-04-26T12:35:03.189889+0000","last_unstale":"2024-04-26T12:36:23.003182+0000","last_undegraded":"2024-04-26T12:36:23.003182+0000","last_fullsized":"2024-04-26T12:36:23.003182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'10","last_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_deep_scrub":"80'10","last_deep_scrub_stamp":"2024-04-26T12:36:23.002980+0000","last_clean_scrub_stamp":"2024-04-26T12:36:23.002980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:24.050905+0000","scrub_duration":0.008324517,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"98'13","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:03.245630+0000","last_change":"2024-04-26T12:37:03.245630+0000","last_active":"2024-04-26T12:37:03.245630+0000","last_peered":"2024-04-26T12:37:03.245630+0000","last_clean":"2024-04-26T12:37:03.245630+0000","last_became_active":"2024-04-26T12:30:32.157778+0000","last_became_peered":"2024-04-26T12:30:32.157778+0000","last_unstale":"2024-04-26T12:37:03.245630+0000","last_undegraded":"2024-04-26T12:37:03.245630+0000","last_fullsized":"2024-04-26T12:37:03.245630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'13","last_scrub_stamp":"2024-04-26T12:37:03.245471+0000","last_deep_scrub":"98'13","last_deep_scrub_stamp":"2024-04-26T12:37:03.245471+0000","last_clean_scrub_stamp":"2024-04-26T12:37:03.245471+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:34.822704+0000","scrub_duration":0.0049500450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"80'2067","reported_seq":2182,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:18.033263+0000","last_change":"2024-04-26T12:37:18.033263+0000","last_active":"2024-04-26T12:37:18.033263+0000","last_peered":"2024-04-26T12:37:18.033263+0000","last_clean":"2024-04-26T12:37:18.033263+0000","last_became_active":"2024-04-26T12:35:06.902594+0000","last_became_peered":"2024-04-26T12:35:06.902594+0000","last_unstale":"2024-04-26T12:37:18.033263+0000","last_undegraded":"2024-04-26T12:37:18.033263+0000","last_fullsized":"2024-04-26T12:37:18.033263+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2067","last_scrub_stamp":"2024-04-26T12:37:18.033088+0000","last_deep_scrub":"80'2067","last_deep_scrub_stamp":"2024-04-26T12:37:18.033088+0000","last_clean_scrub_stamp":"2024-04-26T12:37:18.033088+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:08.753080+0000","scrub_duration":0.0072143529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6092,"num_write_kb":30120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"98'2","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:34.867018+0000","last_change":"2024-04-26T12:36:34.867018+0000","last_active":"2024-04-26T12:36:34.867018+0000","last_peered":"2024-04-26T12:36:34.867018+0000","last_clean":"2024-04-26T12:36:34.867018+0000","last_became_active":"2024-04-26T12:30:32.158957+0000","last_became_peered":"2024-04-26T12:30:32.158957+0000","last_unstale":"2024-04-26T12:36:34.867018+0000","last_undegraded":"2024-04-26T12:36:34.867018+0000","last_fullsized":"2024-04-26T12:36:34.867018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-26T12:36:34.866855+0000","last_clean_scrub_stamp":"2024-04-26T12:36:34.866855+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:44.780097+0000","scrub_duration":0.0056431429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"80'2055","reported_seq":2108,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:00.345450+0000","last_change":"2024-04-26T12:37:00.345450+0000","last_active":"2024-04-26T12:37:00.345450+0000","last_peered":"2024-04-26T12:37:00.345450+0000","last_clean":"2024-04-26T12:37:00.345450+0000","last_became_active":"2024-04-26T12:35:26.169321+0000","last_became_peered":"2024-04-26T12:35:26.169321+0000","last_unstale":"2024-04-26T12:37:00.345450+0000","last_undegraded":"2024-04-26T12:37:00.345450+0000","last_fullsized":"2024-04-26T12:37:00.345450+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2055","last_scrub_stamp":"2024-04-26T12:37:00.345311+0000","last_deep_scrub":"80'2055","last_deep_scrub_stamp":"2024-04-26T12:37:00.345311+0000","last_clean_scrub_stamp":"2024-04-26T12:37:00.345311+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:10.258554+0000","scrub_duration":0.015153711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":29700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"98'3","reported_seq":110,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:35.331158+0000","last_change":"2024-04-26T12:36:35.331158+0000","last_active":"2024-04-26T12:36:35.331158+0000","last_peered":"2024-04-26T12:36:35.331158+0000","last_clean":"2024-04-26T12:36:35.331158+0000","last_became_active":"2024-04-26T12:30:32.154744+0000","last_became_peered":"2024-04-26T12:30:32.154744+0000","last_unstale":"2024-04-26T12:36:35.331158+0000","last_undegraded":"2024-04-26T12:36:35.331158+0000","last_fullsized":"2024-04-26T12:36:35.331158+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:35.331023+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:35.331023+0000","last_clean_scrub_stamp":"2024-04-26T12:36:35.331023+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:30.228403+0000","scrub_duration":0.0034488190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":98,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:40.209064+0000","last_change":"2024-04-26T12:35:40.209064+0000","last_active":"2024-04-26T12:35:40.209064+0000","last_peered":"2024-04-26T12:35:40.209064+0000","last_clean":"2024-04-26T12:35:40.209064+0000","last_became_active":"2024-04-26T12:35:26.164909+0000","last_became_peered":"2024-04-26T12:35:26.164909+0000","last_unstale":"2024-04-26T12:35:40.209064+0000","last_undegraded":"2024-04-26T12:35:40.209064+0000","last_fullsized":"2024-04-26T12:35:40.209064+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-04-26T12:35:40.208887+0000","last_clean_scrub_stamp":"2024-04-26T12:35:40.208887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:37.520324+0000","scrub_duration":0.016687707999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"98'2","reported_seq":44,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:19.260557+0000","last_change":"2024-04-26T12:37:19.260557+0000","last_active":"2024-04-26T12:37:19.260557+0000","last_peered":"2024-04-26T12:37:19.260557+0000","last_clean":"2024-04-26T12:37:19.260557+0000","last_became_active":"2024-04-26T12:35:28.213800+0000","last_became_peered":"2024-04-26T12:35:28.213800+0000","last_unstale":"2024-04-26T12:37:19.260557+0000","last_undegraded":"2024-04-26T12:37:19.260557+0000","last_fullsized":"2024-04-26T12:37:19.260557+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'2","last_scrub_stamp":"2024-04-26T12:37:19.260427+0000","last_deep_scrub":"98'2","last_deep_scrub_stamp":"2024-04-26T12:37:19.260427+0000","last_clean_scrub_stamp":"2024-04-26T12:37:19.260427+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:49.781561+0000","scrub_duration":0.0033091790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"80'1991","reported_seq":2124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:39.969333+0000","last_change":"2024-04-26T12:36:39.969333+0000","last_active":"2024-04-26T12:36:39.969333+0000","last_peered":"2024-04-26T12:36:39.969333+0000","last_clean":"2024-04-26T12:36:39.969333+0000","last_became_active":"2024-04-26T12:35:05.899287+0000","last_became_peered":"2024-04-26T12:35:05.899287+0000","last_unstale":"2024-04-26T12:36:39.969333+0000","last_undegraded":"2024-04-26T12:36:39.969333+0000","last_fullsized":"2024-04-26T12:36:39.969333+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1991","last_scrub_stamp":"2024-04-26T12:36:39.969173+0000","last_deep_scrub":"80'1991","last_deep_scrub_stamp":"2024-04-26T12:36:39.969173+0000","last_clean_scrub_stamp":"2024-04-26T12:36:39.969173+0000","objects_scrubbed":0,"log_size":1991,"log_dups_size":0,"ondisk_log_size":1991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.633864+0000","scrub_duration":0.011084973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5942,"num_write_kb":29448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.982242+0000","last_change":"2024-04-26T12:36:14.982242+0000","last_active":"2024-04-26T12:36:14.982242+0000","last_peered":"2024-04-26T12:36:14.982242+0000","last_clean":"2024-04-26T12:36:14.982242+0000","last_became_active":"2024-04-26T12:35:03.188359+0000","last_became_peered":"2024-04-26T12:35:03.188359+0000","last_unstale":"2024-04-26T12:36:14.982242+0000","last_undegraded":"2024-04-26T12:36:14.982242+0000","last_fullsized":"2024-04-26T12:36:14.982242+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.982103+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.982103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:33.704809+0000","scrub_duration":0.0018977480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"80'8","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:20.998503+0000","last_change":"2024-04-26T12:36:20.998503+0000","last_active":"2024-04-26T12:36:20.998503+0000","last_peered":"2024-04-26T12:36:20.998503+0000","last_clean":"2024-04-26T12:36:20.998503+0000","last_became_active":"2024-04-26T12:35:03.183365+0000","last_became_peered":"2024-04-26T12:35:03.183365+0000","last_unstale":"2024-04-26T12:36:20.998503+0000","last_undegraded":"2024-04-26T12:36:20.998503+0000","last_fullsized":"2024-04-26T12:36:20.998503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:20.998357+0000","last_clean_scrub_stamp":"2024-04-26T12:36:20.998357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.004150+0000","scrub_duration":0.0052206129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:37.185388+0000","last_change":"2024-04-26T12:36:37.185388+0000","last_active":"2024-04-26T12:36:37.185388+0000","last_peered":"2024-04-26T12:36:37.185388+0000","last_clean":"2024-04-26T12:36:37.185388+0000","last_became_active":"2024-04-26T12:35:03.159912+0000","last_became_peered":"2024-04-26T12:35:03.159912+0000","last_unstale":"2024-04-26T12:36:37.185388+0000","last_undegraded":"2024-04-26T12:36:37.185388+0000","last_fullsized":"2024-04-26T12:36:37.185388+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:37.185231+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:37.185231+0000","last_clean_scrub_stamp":"2024-04-26T12:36:37.185231+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:12.684695+0000","scrub_duration":0.0035423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"80'1980","reported_seq":2112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.017326+0000","last_change":"2024-04-26T12:35:56.017326+0000","last_active":"2024-04-26T12:35:56.017326+0000","last_peered":"2024-04-26T12:35:56.017326+0000","last_clean":"2024-04-26T12:35:56.017326+0000","last_became_active":"2024-04-26T12:35:05.901186+0000","last_became_peered":"2024-04-26T12:35:05.901186+0000","last_unstale":"2024-04-26T12:35:56.017326+0000","last_undegraded":"2024-04-26T12:35:56.017326+0000","last_fullsized":"2024-04-26T12:35:56.017326+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1980","last_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_deep_scrub":"80'1980","last_deep_scrub_stamp":"2024-04-26T12:35:56.017191+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.017191+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:19.910231+0000","scrub_duration":0.0081651450000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5925,"num_write_kb":29340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:02.197971+0000","last_change":"2024-04-26T12:37:02.197971+0000","last_active":"2024-04-26T12:37:02.197971+0000","last_peered":"2024-04-26T12:37:02.197971+0000","last_clean":"2024-04-26T12:37:02.197971+0000","last_became_active":"2024-04-26T12:35:03.180024+0000","last_became_peered":"2024-04-26T12:35:03.180024+0000","last_unstale":"2024-04-26T12:37:02.197971+0000","last_undegraded":"2024-04-26T12:37:02.197971+0000","last_fullsized":"2024-04-26T12:37:02.197971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:37:02.197804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:37:02.197804+0000","last_clean_scrub_stamp":"2024-04-26T12:37:02.197804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:29.596636+0000","scrub_duration":0.0016879169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"80'2039","reported_seq":2147,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:04.059101+0000","last_change":"2024-04-26T12:36:04.059101+0000","last_active":"2024-04-26T12:36:04.059101+0000","last_peered":"2024-04-26T12:36:04.059101+0000","last_clean":"2024-04-26T12:36:04.059101+0000","last_became_active":"2024-04-26T12:30:32.620377+0000","last_became_peered":"2024-04-26T12:30:32.620377+0000","last_unstale":"2024-04-26T12:36:04.059101+0000","last_undegraded":"2024-04-26T12:36:04.059101+0000","last_fullsized":"2024-04-26T12:36:04.059101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2039","last_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_deep_scrub":"80'2039","last_deep_scrub_stamp":"2024-04-26T12:36:04.058924+0000","last_clean_scrub_stamp":"2024-04-26T12:36:04.058924+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:30.481629+0000","scrub_duration":0.012146647999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5998,"num_write_kb":29536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.322735+0000","last_change":"2024-04-26T12:36:41.322735+0000","last_active":"2024-04-26T12:36:41.322735+0000","last_peered":"2024-04-26T12:36:41.322735+0000","last_clean":"2024-04-26T12:36:41.322735+0000","last_became_active":"2024-04-26T12:35:26.161325+0000","last_became_peered":"2024-04-26T12:35:26.161325+0000","last_unstale":"2024-04-26T12:36:41.322735+0000","last_undegraded":"2024-04-26T12:36:41.322735+0000","last_fullsized":"2024-04-26T12:36:41.322735+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:41.322599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:41.322599+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.322599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:01.026167+0000","scrub_duration":0.0017738890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"80'2065","reported_seq":2173,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.984957+0000","last_change":"2024-04-26T12:36:09.984957+0000","last_active":"2024-04-26T12:36:09.984957+0000","last_peered":"2024-04-26T12:36:09.984957+0000","last_clean":"2024-04-26T12:36:09.984957+0000","last_became_active":"2024-04-26T12:30:32.617788+0000","last_became_peered":"2024-04-26T12:30:32.617788+0000","last_unstale":"2024-04-26T12:36:09.984957+0000","last_undegraded":"2024-04-26T12:36:09.984957+0000","last_fullsized":"2024-04-26T12:36:09.984957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2065","last_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_deep_scrub":"80'2065","last_deep_scrub_stamp":"2024-04-26T12:36:09.984820+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.984820+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:04.882200+0000","scrub_duration":0.013017881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":29956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":97,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.285733+0000","last_change":"2024-04-26T12:36:14.285733+0000","last_active":"2024-04-26T12:36:14.285733+0000","last_peered":"2024-04-26T12:36:14.285733+0000","last_clean":"2024-04-26T12:36:14.285733+0000","last_became_active":"2024-04-26T12:35:26.163291+0000","last_became_peered":"2024-04-26T12:35:26.163291+0000","last_unstale":"2024-04-26T12:36:14.285733+0000","last_undegraded":"2024-04-26T12:36:14.285733+0000","last_fullsized":"2024-04-26T12:36:14.285733+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.285570+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.285570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:22.599518+0000","scrub_duration":0.0020305150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"80'6083","reported_seq":6197,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:12.085358+0000","last_change":"2024-04-26T12:37:12.085358+0000","last_active":"2024-04-26T12:37:12.085358+0000","last_peered":"2024-04-26T12:37:12.085358+0000","last_clean":"2024-04-26T12:37:12.085358+0000","last_became_active":"2024-04-26T12:35:06.901523+0000","last_became_peered":"2024-04-26T12:35:06.901523+0000","last_unstale":"2024-04-26T12:37:12.085358+0000","last_undegraded":"2024-04-26T12:37:12.085358+0000","last_fullsized":"2024-04-26T12:37:12.085358+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'6083","last_scrub_stamp":"2024-04-26T12:37:12.085213+0000","last_deep_scrub":"80'6083","last_deep_scrub_stamp":"2024-04-26T12:37:12.085213+0000","last_clean_scrub_stamp":"2024-04-26T12:37:12.085213+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:20.355830+0000","scrub_duration":0.010905646999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18094,"num_write_kb":89460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:54.828732+0000","last_change":"2024-04-26T12:35:54.828732+0000","last_active":"2024-04-26T12:35:54.828732+0000","last_peered":"2024-04-26T12:35:54.828732+0000","last_clean":"2024-04-26T12:35:54.828732+0000","last_became_active":"2024-04-26T12:35:03.166374+0000","last_became_peered":"2024-04-26T12:35:03.166374+0000","last_unstale":"2024-04-26T12:35:54.828732+0000","last_undegraded":"2024-04-26T12:35:54.828732+0000","last_fullsized":"2024-04-26T12:35:54.828732+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:54.828605+0000","last_clean_scrub_stamp":"2024-04-26T12:35:54.828605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:29.226278+0000","scrub_duration":0.001515267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.033778+0000","last_change":"2024-04-26T12:36:22.033778+0000","last_active":"2024-04-26T12:36:22.033778+0000","last_peered":"2024-04-26T12:36:22.033778+0000","last_clean":"2024-04-26T12:36:22.033778+0000","last_became_active":"2024-04-26T12:35:03.184085+0000","last_became_peered":"2024-04-26T12:35:03.184085+0000","last_unstale":"2024-04-26T12:36:22.033778+0000","last_undegraded":"2024-04-26T12:36:22.033778+0000","last_fullsized":"2024-04-26T12:36:22.033778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:22.033620+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.033620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:08.740609+0000","scrub_duration":0.0020642659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"80'8","reported_seq":70,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:21.255056+0000","last_change":"2024-04-26T12:36:21.255056+0000","last_active":"2024-04-26T12:36:21.255056+0000","last_peered":"2024-04-26T12:36:21.255056+0000","last_clean":"2024-04-26T12:36:21.255056+0000","last_became_active":"2024-04-26T12:35:26.163526+0000","last_became_peered":"2024-04-26T12:35:26.163526+0000","last_unstale":"2024-04-26T12:36:21.255056+0000","last_undegraded":"2024-04-26T12:36:21.255056+0000","last_fullsized":"2024-04-26T12:36:21.255056+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:21.254895+0000","last_clean_scrub_stamp":"2024-04-26T12:36:21.254895+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:45.147934+0000","scrub_duration":0.0093846899999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:54.092774+0000","last_change":"2024-04-26T12:36:54.092893+0000","last_active":"2024-04-26T12:36:54.092774+0000","last_peered":"2024-04-26T12:36:54.092774+0000","last_clean":"2024-04-26T12:36:54.092774+0000","last_became_active":"2024-04-26T12:35:03.180059+0000","last_became_peered":"2024-04-26T12:35:03.180059+0000","last_unstale":"2024-04-26T12:36:54.092774+0000","last_undegraded":"2024-04-26T12:36:54.092774+0000","last_fullsized":"2024-04-26T12:36:54.092774+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:54.092735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:54.092735+0000","last_clean_scrub_stamp":"2024-04-26T12:36:54.092735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:40.809083+0000","scrub_duration":0.001976303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":122,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:06.197816+0000","last_change":"2024-04-26T12:37:06.197958+0000","last_active":"2024-04-26T12:37:06.197816+0000","last_peered":"2024-04-26T12:37:06.197816+0000","last_clean":"2024-04-26T12:37:06.197816+0000","last_became_active":"2024-04-26T12:35:03.184810+0000","last_became_peered":"2024-04-26T12:35:03.184810+0000","last_unstale":"2024-04-26T12:37:06.197816+0000","last_undegraded":"2024-04-26T12:37:06.197816+0000","last_fullsized":"2024-04-26T12:37:06.197816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:37:06.197792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:37:06.197792+0000","last_clean_scrub_stamp":"2024-04-26T12:37:06.197792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:02.633118+0000","scrub_duration":0.0019428410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"80'9","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:49.289630+0000","last_change":"2024-04-26T12:36:49.289630+0000","last_active":"2024-04-26T12:36:49.289630+0000","last_peered":"2024-04-26T12:36:49.289630+0000","last_clean":"2024-04-26T12:36:49.289630+0000","last_became_active":"2024-04-26T12:35:03.187351+0000","last_became_peered":"2024-04-26T12:35:03.187351+0000","last_unstale":"2024-04-26T12:36:49.289630+0000","last_undegraded":"2024-04-26T12:36:49.289630+0000","last_fullsized":"2024-04-26T12:36:49.289630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:49.289463+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:49.289463+0000","last_clean_scrub_stamp":"2024-04-26T12:36:49.289463+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:56.753704+0000","scrub_duration":0.0072399329999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:14.903484+0000","last_change":"2024-04-26T12:36:14.903484+0000","last_active":"2024-04-26T12:36:14.903484+0000","last_peered":"2024-04-26T12:36:14.903484+0000","last_clean":"2024-04-26T12:36:14.903484+0000","last_became_active":"2024-04-26T12:35:03.166423+0000","last_became_peered":"2024-04-26T12:35:03.166423+0000","last_unstale":"2024-04-26T12:36:14.903484+0000","last_undegraded":"2024-04-26T12:36:14.903484+0000","last_fullsized":"2024-04-26T12:36:14.903484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:14.903354+0000","last_clean_scrub_stamp":"2024-04-26T12:36:14.903354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:16.770079+0000","scrub_duration":0.0017945649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:31.324893+0000","last_change":"2024-04-26T12:36:31.324893+0000","last_active":"2024-04-26T12:36:31.324893+0000","last_peered":"2024-04-26T12:36:31.324893+0000","last_clean":"2024-04-26T12:36:31.324893+0000","last_became_active":"2024-04-26T12:30:32.154034+0000","last_became_peered":"2024-04-26T12:30:32.154034+0000","last_unstale":"2024-04-26T12:36:31.324893+0000","last_undegraded":"2024-04-26T12:36:31.324893+0000","last_fullsized":"2024-04-26T12:36:31.324893+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:31.324737+0000","last_clean_scrub_stamp":"2024-04-26T12:36:31.324737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:42.977856+0000","scrub_duration":0.0020696540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"80'5","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:25.039601+0000","last_change":"2024-04-26T12:36:25.039601+0000","last_active":"2024-04-26T12:36:25.039601+0000","last_peered":"2024-04-26T12:36:25.039601+0000","last_clean":"2024-04-26T12:36:25.039601+0000","last_became_active":"2024-04-26T12:35:03.194600+0000","last_became_peered":"2024-04-26T12:35:03.194600+0000","last_unstale":"2024-04-26T12:36:25.039601+0000","last_undegraded":"2024-04-26T12:36:25.039601+0000","last_fullsized":"2024-04-26T12:36:25.039601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:25.039404+0000","last_clean_scrub_stamp":"2024-04-26T12:36:25.039404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:58.902069+0000","scrub_duration":0.0099267869999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":125,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:58.126359+0000","last_change":"2024-04-26T12:36:58.126508+0000","last_active":"2024-04-26T12:36:58.126359+0000","last_peered":"2024-04-26T12:36:58.126359+0000","last_clean":"2024-04-26T12:36:58.126359+0000","last_became_active":"2024-04-26T12:35:03.183886+0000","last_became_peered":"2024-04-26T12:35:03.183886+0000","last_unstale":"2024-04-26T12:36:58.126359+0000","last_undegraded":"2024-04-26T12:36:58.126359+0000","last_fullsized":"2024-04-26T12:36:58.126359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:58.126323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:58.126323+0000","last_clean_scrub_stamp":"2024-04-26T12:36:58.126323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:08.517108+0000","scrub_duration":0.002073723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"98'159","reported_seq":310,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:48.982871+0000","last_change":"2024-04-26T12:36:48.982998+0000","last_active":"2024-04-26T12:36:48.982871+0000","last_peered":"2024-04-26T12:36:48.982871+0000","last_clean":"2024-04-26T12:36:48.982871+0000","last_became_active":"2024-04-26T12:30:26.800412+0000","last_became_peered":"2024-04-26T12:30:26.800412+0000","last_unstale":"2024-04-26T12:36:48.982871+0000","last_undegraded":"2024-04-26T12:36:48.982871+0000","last_fullsized":"2024-04-26T12:36:48.982871+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'159","last_scrub_stamp":"2024-04-26T12:36:48.982845+0000","last_deep_scrub":"98'159","last_deep_scrub_stamp":"2024-04-26T12:36:48.982845+0000","last_clean_scrub_stamp":"2024-04-26T12:36:48.982845+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:53.161246+0000","scrub_duration":0.0049176230000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:00.886361+0000","last_change":"2024-04-26T12:36:00.886361+0000","last_active":"2024-04-26T12:36:00.886361+0000","last_peered":"2024-04-26T12:36:00.886361+0000","last_clean":"2024-04-26T12:36:00.886361+0000","last_became_active":"2024-04-26T12:35:03.162742+0000","last_became_peered":"2024-04-26T12:35:03.162742+0000","last_unstale":"2024-04-26T12:36:00.886361+0000","last_undegraded":"2024-04-26T12:36:00.886361+0000","last_fullsized":"2024-04-26T12:36:00.886361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:00.886200+0000","last_clean_scrub_stamp":"2024-04-26T12:36:00.886200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:12.777562+0000","scrub_duration":0.0021566559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"80'5","reported_seq":96,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:15.226719+0000","last_change":"2024-04-26T12:37:15.226842+0000","last_active":"2024-04-26T12:37:15.226719+0000","last_peered":"2024-04-26T12:37:15.226719+0000","last_clean":"2024-04-26T12:37:15.226719+0000","last_became_active":"2024-04-26T12:35:28.213994+0000","last_became_peered":"2024-04-26T12:35:28.213994+0000","last_unstale":"2024-04-26T12:37:15.226719+0000","last_undegraded":"2024-04-26T12:37:15.226719+0000","last_fullsized":"2024-04-26T12:37:15.226719+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:37:15.226676+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:37:15.226676+0000","last_clean_scrub_stamp":"2024-04-26T12:37:15.226676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:53.631775+0000","scrub_duration":0.0093574120000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:59.165931+0000","last_change":"2024-04-26T12:36:59.166091+0000","last_active":"2024-04-26T12:36:59.165931+0000","last_peered":"2024-04-26T12:36:59.165931+0000","last_clean":"2024-04-26T12:36:59.165931+0000","last_became_active":"2024-04-26T12:30:26.800372+0000","last_became_peered":"2024-04-26T12:30:26.800372+0000","last_unstale":"2024-04-26T12:36:59.165931+0000","last_undegraded":"2024-04-26T12:36:59.165931+0000","last_fullsized":"2024-04-26T12:36:59.165931+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:59.165894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:59.165894+0000","last_clean_scrub_stamp":"2024-04-26T12:36:59.165894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:16.495623+0000","scrub_duration":0.001857247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"98'4","reported_seq":91,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.833616+0000","last_change":"2024-04-26T12:35:55.833616+0000","last_active":"2024-04-26T12:35:55.833616+0000","last_peered":"2024-04-26T12:35:55.833616+0000","last_clean":"2024-04-26T12:35:55.833616+0000","last_became_active":"2024-04-26T12:35:03.181486+0000","last_became_peered":"2024-04-26T12:35:03.181486+0000","last_unstale":"2024-04-26T12:35:55.833616+0000","last_undegraded":"2024-04-26T12:35:55.833616+0000","last_fullsized":"2024-04-26T12:35:55.833616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:35:55.833451+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.833451+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:41.021792+0000","scrub_duration":0.003578328,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"80'7980","reported_seq":8102,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:07.544773+0000","last_change":"2024-04-26T12:37:07.544924+0000","last_active":"2024-04-26T12:37:07.544773+0000","last_peered":"2024-04-26T12:37:07.544773+0000","last_clean":"2024-04-26T12:37:07.544773+0000","last_became_active":"2024-04-26T12:35:26.169168+0000","last_became_peered":"2024-04-26T12:35:26.169168+0000","last_unstale":"2024-04-26T12:37:07.544773+0000","last_undegraded":"2024-04-26T12:37:07.544773+0000","last_fullsized":"2024-04-26T12:37:07.544773+0000","mapping_epoch":94,"log_start":"67'3500","ondisk_log_start":"67'3500","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7980","last_scrub_stamp":"2024-04-26T12:37:07.544747+0000","last_deep_scrub":"80'7980","last_deep_scrub_stamp":"2024-04-26T12:37:07.544747+0000","last_clean_scrub_stamp":"2024-04-26T12:37:07.544747+0000","objects_scrubbed":0,"log_size":4480,"log_dups_size":3500,"ondisk_log_size":4480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:29.767928+0000","scrub_duration":0.019747101999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23796,"num_write_kb":117600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:43.256815+0000","last_change":"2024-04-26T12:35:43.256815+0000","last_active":"2024-04-26T12:35:43.256815+0000","last_peered":"2024-04-26T12:35:43.256815+0000","last_clean":"2024-04-26T12:35:43.256815+0000","last_became_active":"2024-04-26T12:35:26.163271+0000","last_became_peered":"2024-04-26T12:35:26.163271+0000","last_unstale":"2024-04-26T12:35:43.256815+0000","last_undegraded":"2024-04-26T12:35:43.256815+0000","last_fullsized":"2024-04-26T12:35:43.256815+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:43.256655+0000","last_clean_scrub_stamp":"2024-04-26T12:35:43.256655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:10.856381+0000","scrub_duration":0.001974197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:59.839864+0000","last_change":"2024-04-26T12:35:59.839864+0000","last_active":"2024-04-26T12:35:59.839864+0000","last_peered":"2024-04-26T12:35:59.839864+0000","last_clean":"2024-04-26T12:35:59.839864+0000","last_became_active":"2024-04-26T12:35:03.166252+0000","last_became_peered":"2024-04-26T12:35:03.166252+0000","last_unstale":"2024-04-26T12:35:59.839864+0000","last_undegraded":"2024-04-26T12:35:59.839864+0000","last_fullsized":"2024-04-26T12:35:59.839864+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:59.839691+0000","last_clean_scrub_stamp":"2024-04-26T12:35:59.839691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:13.298302+0000","scrub_duration":0.0019804599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2011","reported_seq":2108,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:55.150310+0000","last_change":"2024-04-26T12:35:55.150310+0000","last_active":"2024-04-26T12:35:55.150310+0000","last_peered":"2024-04-26T12:35:55.150310+0000","last_clean":"2024-04-26T12:35:55.150310+0000","last_became_active":"2024-04-26T12:35:26.167433+0000","last_became_peered":"2024-04-26T12:35:26.167433+0000","last_unstale":"2024-04-26T12:35:55.150310+0000","last_undegraded":"2024-04-26T12:35:55.150310+0000","last_fullsized":"2024-04-26T12:35:55.150310+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2011","last_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_deep_scrub":"80'2011","last_deep_scrub_stamp":"2024-04-26T12:35:55.150079+0000","last_clean_scrub_stamp":"2024-04-26T12:35:55.150079+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.249254+0000","scrub_duration":0.011542274999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5894,"num_write_kb":29240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"98'4","reported_seq":90,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:41.260010+0000","last_change":"2024-04-26T12:36:41.260010+0000","last_active":"2024-04-26T12:36:41.260010+0000","last_peered":"2024-04-26T12:36:41.260010+0000","last_clean":"2024-04-26T12:36:41.260010+0000","last_became_active":"2024-04-26T12:35:03.194420+0000","last_became_peered":"2024-04-26T12:35:03.194420+0000","last_unstale":"2024-04-26T12:36:41.260010+0000","last_undegraded":"2024-04-26T12:36:41.260010+0000","last_fullsized":"2024-04-26T12:36:41.260010+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:36:41.259810+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:36:41.259810+0000","last_clean_scrub_stamp":"2024-04-26T12:36:41.259810+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:21.428799+0000","scrub_duration":0.003236708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:49.880182+0000","last_change":"2024-04-26T12:35:49.880182+0000","last_active":"2024-04-26T12:35:49.880182+0000","last_peered":"2024-04-26T12:35:49.880182+0000","last_clean":"2024-04-26T12:35:49.880182+0000","last_became_active":"2024-04-26T12:35:03.167670+0000","last_became_peered":"2024-04-26T12:35:03.167670+0000","last_unstale":"2024-04-26T12:35:49.880182+0000","last_undegraded":"2024-04-26T12:35:49.880182+0000","last_fullsized":"2024-04-26T12:35:49.880182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:35:49.880012+0000","last_clean_scrub_stamp":"2024-04-26T12:35:49.880012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.320847+0000","scrub_duration":0.0019327299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"80'8","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:43.274955+0000","last_change":"2024-04-26T12:36:43.274955+0000","last_active":"2024-04-26T12:36:43.274955+0000","last_peered":"2024-04-26T12:36:43.274955+0000","last_clean":"2024-04-26T12:36:43.274955+0000","last_became_active":"2024-04-26T12:35:03.173199+0000","last_became_peered":"2024-04-26T12:35:03.173199+0000","last_unstale":"2024-04-26T12:36:43.274955+0000","last_undegraded":"2024-04-26T12:36:43.274955+0000","last_fullsized":"2024-04-26T12:36:43.274955+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'8","last_scrub_stamp":"2024-04-26T12:36:43.274807+0000","last_deep_scrub":"80'8","last_deep_scrub_stamp":"2024-04-26T12:36:43.274807+0000","last_clean_scrub_stamp":"2024-04-26T12:36:43.274807+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:17.223965+0000","scrub_duration":0.007220705,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:55.109649+0000","last_change":"2024-04-26T12:36:55.109649+0000","last_active":"2024-04-26T12:36:55.109649+0000","last_peered":"2024-04-26T12:36:55.109649+0000","last_clean":"2024-04-26T12:36:55.109649+0000","last_became_active":"2024-04-26T12:30:26.798400+0000","last_became_peered":"2024-04-26T12:30:26.798400+0000","last_unstale":"2024-04-26T12:36:55.109649+0000","last_undegraded":"2024-04-26T12:36:55.109649+0000","last_fullsized":"2024-04-26T12:36:55.109649+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:36:55.109520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:36:55.109520+0000","last_clean_scrub_stamp":"2024-04-26T12:36:55.109520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:09.449647+0000","scrub_duration":0.0018695129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"98'9","reported_seq":96,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:13.902674+0000","last_change":"2024-04-26T12:36:13.902674+0000","last_active":"2024-04-26T12:36:13.902674+0000","last_peered":"2024-04-26T12:36:13.902674+0000","last_clean":"2024-04-26T12:36:13.902674+0000","last_became_active":"2024-04-26T12:35:03.190001+0000","last_became_peered":"2024-04-26T12:35:03.190001+0000","last_unstale":"2024-04-26T12:36:13.902674+0000","last_undegraded":"2024-04-26T12:36:13.902674+0000","last_fullsized":"2024-04-26T12:36:13.902674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'9","last_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_deep_scrub":"98'9","last_deep_scrub_stamp":"2024-04-26T12:36:13.902508+0000","last_clean_scrub_stamp":"2024-04-26T12:36:13.902508+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:02.310643+0000","scrub_duration":0.0037104799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'5","reported_seq":111,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:36.306921+0000","last_change":"2024-04-26T12:36:36.306921+0000","last_active":"2024-04-26T12:36:36.306921+0000","last_peered":"2024-04-26T12:36:36.306921+0000","last_clean":"2024-04-26T12:36:36.306921+0000","last_became_active":"2024-04-26T12:30:32.607745+0000","last_became_peered":"2024-04-26T12:30:32.607745+0000","last_unstale":"2024-04-26T12:36:36.306921+0000","last_undegraded":"2024-04-26T12:36:36.306921+0000","last_fullsized":"2024-04-26T12:36:36.306921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'5","last_scrub_stamp":"2024-04-26T12:36:36.306777+0000","last_deep_scrub":"80'5","last_deep_scrub_stamp":"2024-04-26T12:36:36.306777+0000","last_clean_scrub_stamp":"2024-04-26T12:36:36.306777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:56.292025+0000","scrub_duration":0.0093015630000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":72,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:22.274010+0000","last_change":"2024-04-26T12:36:22.274010+0000","last_active":"2024-04-26T12:36:22.274010+0000","last_peered":"2024-04-26T12:36:22.274010+0000","last_clean":"2024-04-26T12:36:22.274010+0000","last_became_active":"2024-04-26T12:35:26.164050+0000","last_became_peered":"2024-04-26T12:35:26.164050+0000","last_unstale":"2024-04-26T12:36:22.274010+0000","last_undegraded":"2024-04-26T12:36:22.274010+0000","last_fullsized":"2024-04-26T12:36:22.274010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:36:22.273870+0000","last_clean_scrub_stamp":"2024-04-26T12:36:22.273870+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:52.682099+0000","scrub_duration":0.0016147990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"80'2049","reported_seq":2132,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:09.254488+0000","last_change":"2024-04-26T12:36:09.254596+0000","last_active":"2024-04-26T12:36:09.254488+0000","last_peered":"2024-04-26T12:36:09.254488+0000","last_clean":"2024-04-26T12:36:09.254488+0000","last_became_active":"2024-04-26T12:35:26.165558+0000","last_became_peered":"2024-04-26T12:35:26.165558+0000","last_unstale":"2024-04-26T12:36:09.254488+0000","last_undegraded":"2024-04-26T12:36:09.254488+0000","last_fullsized":"2024-04-26T12:36:09.254488+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2049","last_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_deep_scrub":"80'2049","last_deep_scrub_stamp":"2024-04-26T12:36:09.254461+0000","last_clean_scrub_stamp":"2024-04-26T12:36:09.254461+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:25.158195+0000","scrub_duration":0.0084966799999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"98'3","reported_seq":124,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:06.029049+0000","last_change":"2024-04-26T12:36:06.029182+0000","last_active":"2024-04-26T12:36:06.029049+0000","last_peered":"2024-04-26T12:36:06.029049+0000","last_clean":"2024-04-26T12:36:06.029049+0000","last_became_active":"2024-04-26T12:35:03.188656+0000","last_became_peered":"2024-04-26T12:35:03.188656+0000","last_unstale":"2024-04-26T12:36:06.029049+0000","last_undegraded":"2024-04-26T12:36:06.029049+0000","last_fullsized":"2024-04-26T12:36:06.029049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'3","last_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_deep_scrub":"98'3","last_deep_scrub_stamp":"2024-04-26T12:36:06.029025+0000","last_clean_scrub_stamp":"2024-04-26T12:36:06.029025+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:17.682144+0000","scrub_duration":0.0034148149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"80'2040","reported_seq":2170,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:29.961730+0000","last_change":"2024-04-26T12:36:29.961845+0000","last_active":"2024-04-26T12:36:29.961730+0000","last_peered":"2024-04-26T12:36:29.961730+0000","last_clean":"2024-04-26T12:36:29.961730+0000","last_became_active":"2024-04-26T12:35:05.899391+0000","last_became_peered":"2024-04-26T12:35:05.899391+0000","last_unstale":"2024-04-26T12:36:29.961730+0000","last_undegraded":"2024-04-26T12:36:29.961730+0000","last_fullsized":"2024-04-26T12:36:29.961730+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2040","last_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_deep_scrub":"80'2040","last_deep_scrub_stamp":"2024-04-26T12:36:29.961702+0000","last_clean_scrub_stamp":"2024-04-26T12:36:29.961702+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:33.150927+0000","scrub_duration":0.0070304959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5926,"num_write_kb":29384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"98'4","reported_seq":74,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:19.657511+0000","last_change":"2024-04-26T12:37:19.657511+0000","last_active":"2024-04-26T12:37:19.657511+0000","last_peered":"2024-04-26T12:37:19.657511+0000","last_clean":"2024-04-26T12:37:19.657511+0000","last_became_active":"2024-04-26T12:35:26.167282+0000","last_became_peered":"2024-04-26T12:35:26.167282+0000","last_unstale":"2024-04-26T12:37:19.657511+0000","last_undegraded":"2024-04-26T12:37:19.657511+0000","last_fullsized":"2024-04-26T12:37:19.657511+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'4","last_scrub_stamp":"2024-04-26T12:37:19.657379+0000","last_deep_scrub":"98'4","last_deep_scrub_stamp":"2024-04-26T12:37:19.657379+0000","last_clean_scrub_stamp":"2024-04-26T12:37:19.657379+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:33.997506+0000","scrub_duration":0.0033757969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"80'7","reported_seq":127,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:41.966293+0000","last_change":"2024-04-26T12:35:41.966428+0000","last_active":"2024-04-26T12:35:41.966293+0000","last_peered":"2024-04-26T12:35:41.966293+0000","last_clean":"2024-04-26T12:35:41.966293+0000","last_became_active":"2024-04-26T12:35:03.180448+0000","last_became_peered":"2024-04-26T12:35:03.180448+0000","last_unstale":"2024-04-26T12:35:41.966293+0000","last_undegraded":"2024-04-26T12:35:41.966293+0000","last_fullsized":"2024-04-26T12:35:41.966293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'7","last_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_deep_scrub":"80'7","last_deep_scrub_stamp":"2024-04-26T12:35:41.966266+0000","last_clean_scrub_stamp":"2024-04-26T12:35:41.966266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:47.286627+0000","scrub_duration":0.011530692,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":88,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:50.849631+0000","last_change":"2024-04-26T12:35:50.849631+0000","last_active":"2024-04-26T12:35:50.849631+0000","last_peered":"2024-04-26T12:35:50.849631+0000","last_clean":"2024-04-26T12:35:50.849631+0000","last_became_active":"2024-04-26T12:35:03.171874+0000","last_became_peered":"2024-04-26T12:35:03.171874+0000","last_unstale":"2024-04-26T12:35:50.849631+0000","last_undegraded":"2024-04-26T12:35:50.849631+0000","last_fullsized":"2024-04-26T12:35:50.849631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T12:35:50.849501+0000","last_clean_scrub_stamp":"2024-04-26T12:35:50.849501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:53.832051+0000","scrub_duration":0.002006037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"80'4070","reported_seq":4193,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:07.266994+0000","last_change":"2024-04-26T12:36:07.266994+0000","last_active":"2024-04-26T12:36:07.266994+0000","last_peered":"2024-04-26T12:36:07.266994+0000","last_clean":"2024-04-26T12:36:07.266994+0000","last_became_active":"2024-04-26T12:35:26.165621+0000","last_became_peered":"2024-04-26T12:35:26.165621+0000","last_unstale":"2024-04-26T12:36:07.266994+0000","last_undegraded":"2024-04-26T12:36:07.266994+0000","last_fullsized":"2024-04-26T12:36:07.266994+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4070","last_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_deep_scrub":"80'4070","last_deep_scrub_stamp":"2024-04-26T12:36:07.266853+0000","last_clean_scrub_stamp":"2024-04-26T12:36:07.266853+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:12.587214+0000","scrub_duration":0.013959829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12069,"num_write_kb":59592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"98'6","reported_seq":93,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:08.980266+0000","last_change":"2024-04-26T12:36:08.980266+0000","last_active":"2024-04-26T12:36:08.980266+0000","last_peered":"2024-04-26T12:36:08.980266+0000","last_clean":"2024-04-26T12:36:08.980266+0000","last_became_active":"2024-04-26T12:35:03.194726+0000","last_became_peered":"2024-04-26T12:35:03.194726+0000","last_unstale":"2024-04-26T12:36:08.980266+0000","last_undegraded":"2024-04-26T12:36:08.980266+0000","last_fullsized":"2024-04-26T12:36:08.980266+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'6","last_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_deep_scrub":"98'6","last_deep_scrub_stamp":"2024-04-26T12:36:08.980132+0000","last_clean_scrub_stamp":"2024-04-26T12:36:08.980132+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:12.661795+0000","scrub_duration":0.0093908959999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"80'2067","reported_seq":2178,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:55.290401+0000","last_change":"2024-04-26T12:36:55.290401+0000","last_active":"2024-04-26T12:36:55.290401+0000","last_peered":"2024-04-26T12:36:55.290401+0000","last_clean":"2024-04-26T12:36:55.290401+0000","last_became_active":"2024-04-26T12:35:26.167078+0000","last_became_peered":"2024-04-26T12:35:26.167078+0000","last_unstale":"2024-04-26T12:36:55.290401+0000","last_undegraded":"2024-04-26T12:36:55.290401+0000","last_fullsized":"2024-04-26T12:36:55.290401+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2067","last_scrub_stamp":"2024-04-26T12:36:55.290208+0000","last_deep_scrub":"80'2067","last_deep_scrub_stamp":"2024-04-26T12:36:55.290208+0000","last_clean_scrub_stamp":"2024-04-26T12:36:55.290208+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:58.479433+0000","scrub_duration":0.015349889,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6124,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"80'9","reported_seq":130,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:12.000253+0000","last_change":"2024-04-26T12:36:12.000253+0000","last_active":"2024-04-26T12:36:12.000253+0000","last_peered":"2024-04-26T12:36:12.000253+0000","last_clean":"2024-04-26T12:36:12.000253+0000","last_became_active":"2024-04-26T12:35:03.180134+0000","last_became_peered":"2024-04-26T12:35:03.180134+0000","last_unstale":"2024-04-26T12:36:12.000253+0000","last_undegraded":"2024-04-26T12:36:12.000253+0000","last_fullsized":"2024-04-26T12:36:12.000253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'9","last_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_deep_scrub":"80'9","last_deep_scrub_stamp":"2024-04-26T12:36:12.000111+0000","last_clean_scrub_stamp":"2024-04-26T12:36:12.000111+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:02.393567+0000","scrub_duration":0.017651467000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"80'12","reported_seq":86,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:35:56.855547+0000","last_change":"2024-04-26T12:35:56.855547+0000","last_active":"2024-04-26T12:35:56.855547+0000","last_peered":"2024-04-26T12:35:56.855547+0000","last_clean":"2024-04-26T12:35:56.855547+0000","last_became_active":"2024-04-26T12:35:03.162886+0000","last_became_peered":"2024-04-26T12:35:03.162886+0000","last_unstale":"2024-04-26T12:35:56.855547+0000","last_undegraded":"2024-04-26T12:35:56.855547+0000","last_fullsized":"2024-04-26T12:35:56.855547+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'12","last_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_deep_scrub":"80'12","last_deep_scrub_stamp":"2024-04-26T12:35:56.855396+0000","last_clean_scrub_stamp":"2024-04-26T12:35:56.855396+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:59.203820+0000","scrub_duration":0.0078982099999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"80'1986","reported_seq":2040,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:26.308957+0000","last_change":"2024-04-26T12:36:26.308957+0000","last_active":"2024-04-26T12:36:26.308957+0000","last_peered":"2024-04-26T12:36:26.308957+0000","last_clean":"2024-04-26T12:36:26.308957+0000","last_became_active":"2024-04-26T12:35:26.168339+0000","last_became_peered":"2024-04-26T12:35:26.168339+0000","last_unstale":"2024-04-26T12:36:26.308957+0000","last_undegraded":"2024-04-26T12:36:26.308957+0000","last_fullsized":"2024-04-26T12:36:26.308957+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'1986","last_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_deep_scrub":"80'1986","last_deep_scrub_stamp":"2024-04-26T12:36:26.308823+0000","last_clean_scrub_stamp":"2024-04-26T12:36:26.308823+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:41.739629+0000","scrub_duration":0.010363702000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5861,"num_write_kb":29052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"80'2031","reported_seq":2145,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:37:03.047838+0000","last_change":"2024-04-26T12:37:03.047838+0000","last_active":"2024-04-26T12:37:03.047838+0000","last_peered":"2024-04-26T12:37:03.047838+0000","last_clean":"2024-04-26T12:37:03.047838+0000","last_became_active":"2024-04-26T12:35:05.897556+0000","last_became_peered":"2024-04-26T12:35:05.897556+0000","last_unstale":"2024-04-26T12:37:03.047838+0000","last_undegraded":"2024-04-26T12:37:03.047838+0000","last_fullsized":"2024-04-26T12:37:03.047838+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2031","last_scrub_stamp":"2024-04-26T12:37:03.047680+0000","last_deep_scrub":"80'2031","last_deep_scrub_stamp":"2024-04-26T12:37:03.047680+0000","last_clean_scrub_stamp":"2024-04-26T12:37:03.047680+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:18.660703+0000","scrub_duration":0.0080994900000000009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6022,"num_write_kb":29800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"80'2044","reported_seq":2150,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T12:36:37.258311+0000","last_change":"2024-04-26T12:36:37.258311+0000","last_active":"2024-04-26T12:36:37.258311+0000","last_peered":"2024-04-26T12:36:37.258311+0000","last_clean":"2024-04-26T12:36:37.258311+0000","last_became_active":"2024-04-26T12:30:32.613448+0000","last_became_peered":"2024-04-26T12:30:32.613448+0000","last_unstale":"2024-04-26T12:36:37.258311+0000","last_undegraded":"2024-04-26T12:36:37.258311+0000","last_fullsized":"2024-04-26T12:36:37.258311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2044","last_scrub_stamp":"2024-04-26T12:36:37.258151+0000","last_deep_scrub":"80'2044","last_deep_scrub_stamp":"2024-04-26T12:36:37.258151+0000","last_clean_scrub_stamp":"2024-04-26T12:36:37.258151+0000","objects_scrubbed":0,"log_size":2044,"log_dups_size":0,"ondisk_log_size":2044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:27.651607+0000","scrub_duration":0.0086302089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":30264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384039,"num_write_kb":1957642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119017,"ondisk_log_size":119017,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":285440,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":152,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":570880,"data_compressed":5950,"data_compressed_allocated":16384,"data_compressed_original":57344,"omap_allocated":5485,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12120,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738461,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1142980,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":1141822,"kb_avail":93228860,"statfs":{"total":96636764160,"available":95466352640,"internally_reserved":0,"allocated":1175552,"data_stored":1279189,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1169226182},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:37:09 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.377,"5min":0.316,"15min":0.316},"max":{"1min":0.58599999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47499999999999998,"15min":0.47399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Apr 26 12:37:43 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.45800000000000002,"15min":0.44500000000000001},"min":{"1min":0.373,"5min":0.19400000000000001,"15min":0.186},"max":{"1min":0.65200000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.45700000000000002,"15min":0.44900000000000001},"min":{"1min":0.39000000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.503}]}]},{"osd":0,"up_from":85,"seq":365072220197,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52660,"kb_used_data":812,"kb_used_omap":6,"kb_used_meta":51833,"kb_avail":94319180,"statfs":{"total":96636764160,"available":96582840320,"internally_reserved":0,"allocated":831488,"data_stored":405605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7079,"internal_metadata":53077081},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.35899999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Apr 26 12:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.628},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.58399999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738462,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1511164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":1510014,"kb_avail":92860676,"statfs":{"total":96636764160,"available":95089332224,"internally_reserved":0,"allocated":1167360,"data_stored":1280080,"data_compressed":9035,"data_compressed_allocated":45056,"data_compressed_original":602112,"omap_allocated":1594,"internal_metadata":1546254790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35099999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.48499999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.45200000000000001,"15min":0.44600000000000001},"min":{"1min":0.30099999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48099999999999998,"15min":0.45400000000000001},"min":{"1min":0.31900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.66400000000000003,"5min":1.137,"15min":1.137},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6060,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5485,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":284218,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":285440,"data_compressed":2975,"data_compressed_allocated":8192,"data_compressed_original":28672,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:38:01.037 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T12:38:01.470 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T12:38:01.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:38:01.889 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:38:01.889 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:30:32.589261+0000","modified":"2024-04-26T12:30:35.618890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6803/1003606543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1003606543},{"type":"v1","addr":"172.21.15.38:6803","nonce":1003606543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:38:01.892 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2024-04-26T12:38:01.905 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:38:02.321 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:38:02.321 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:30:32.589261+0000","modified":"2024-04-26T12:30:35.618890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4190},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4190":{"gid":4190,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.38:6803/1003606543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":1003606543},{"type":"v1","addr":"172.21.15.38:6803","nonce":1003606543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:38:02.325 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2024-04-26T12:38:02.338 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:38:02.702 INFO:teuthology.orchestra.run.smithi038.stdout: 2024-04-26T12:38:02.702 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":98,"fsid":"64cc8c72-72d6-4335-8e3d-3304aaa6cad9","created":"2024-04-26T12:30:16.108777+0000","modified":"2024-04-26T12:35:29.214507+0000","last_up_change":"2024-04-26T12:35:02.136525+0000","last_in_change":"2024-04-26T12:30:17.865270+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:30:25.029168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:30:25.763407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:30:30.379996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:30:31.544710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1699999570846558,"score_stable":1.1699999570846558,"optimal_score":1,"raw_score_acting":1.1699999570846558,"raw_score_stable":1.1699999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25a1a54a-7d63-4c77-a385-f8147232ba3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":63,"up_from":85,"up_thru":89,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":5978},{"type":"v1","addr":"172.21.15.98:6801","nonce":5978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":5978},{"type":"v1","addr":"172.21.15.98:6803","nonce":5978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":5978},{"type":"v1","addr":"172.21.15.98:6807","nonce":5978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":5978},{"type":"v1","addr":"172.21.15.98:6805","nonce":5978}]},"public_addr":"172.21.15.98:6801/5978","cluster_addr":"172.21.15.98:6803/5978","heartbeat_back_addr":"172.21.15.98:6807/5978","heartbeat_front_addr":"172.21.15.98:6805/5978","state":["exists","up"]},{"osd":1,"uuid":"2560bbad-5f8c-400e-b7ba-ca2c3eaacfcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":40366},{"type":"v1","addr":"172.21.15.116:6801","nonce":40366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":40366},{"type":"v1","addr":"172.21.15.116:6803","nonce":40366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":40366},{"type":"v1","addr":"172.21.15.116:6807","nonce":40366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":40366},{"type":"v1","addr":"172.21.15.116:6805","nonce":40366}]},"public_addr":"172.21.15.116:6801/40366","cluster_addr":"172.21.15.116:6803/40366","heartbeat_back_addr":"172.21.15.116:6807/40366","heartbeat_front_addr":"172.21.15.116:6805/40366","state":["exists","up"]},{"osd":2,"uuid":"0ddc67e1-ee46-4691-bc16-6366296d9929","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40554},{"type":"v1","addr":"172.21.15.133:6801","nonce":40554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40554},{"type":"v1","addr":"172.21.15.133:6803","nonce":40554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40554},{"type":"v1","addr":"172.21.15.133:6807","nonce":40554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40554},{"type":"v1","addr":"172.21.15.133:6805","nonce":40554}]},"public_addr":"172.21.15.133:6801/40554","cluster_addr":"172.21.15.133:6803/40554","heartbeat_back_addr":"172.21.15.133:6807/40554","heartbeat_front_addr":"172.21.15.133:6805/40554","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.897372+0000","dead_epoch":63},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.974464+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:30:22.873008+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.18","osds":[1,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:38:02.718 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T12:38:03.145 INFO:tasks.ceph.mds.a.smithi038.stderr: -2543> 2024-04-26T12:30:37.930+0000 7fc16825f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T12:38:03.148 INFO:teuthology.orchestra.run.smithi038.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T12:38:03.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T12:38:03.176 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2024-04-26T12:38:04.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T12:38:05.229 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' removed 2024-04-26T12:38:05.244 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T12:38:06.252 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' removed 2024-04-26T12:38:06.267 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T12:38:06.267 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T12:38:06.268 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:38:06.278 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T12:38:06.278 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T12:38:06.278 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T12:38:06.278 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:38:06.311 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T12:38:06.312 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T12:38:06.312 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:38:06.353 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T12:38:06.354 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T12:38:06.354 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:38:06.410 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T12:38:06.410 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T12:38:06.411 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T12:38:06.411 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:38:06.439 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T12:38:06.439 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T12:38:06.439 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:38:06.510 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T12:38:06.511 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T12:38:06.511 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T12:38:06.511 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:38:06.564 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T12:38:06.565 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T12:38:06.565 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:38:06.618 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T12:38:06.618 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T12:38:06.618 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:38:06.672 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T12:38:06.672 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T12:38:06.672 DEBUG:teuthology.orchestra.run.smithi038:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T12:38:06.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-26T12:38:06.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-26T12:38:06.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-26T12:38:06.755 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T12:38:06.755 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T12:38:06.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi116.front.sepia.ceph.com 2024-04-26T12:38:06.897 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T12:38:07.108 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2024-04-26T12:38:07.109 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T12:38:07.352 INFO:tasks.ceph:Archiving mon data... 2024-04-26T12:38:07.353 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/data/mon.a.tgz 2024-04-26T12:38:07.353 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-04-26T12:38:07.375 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.RPl46MUND6 2024-04-26T12:38:07.375 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RPl46MUND6 2024-04-26T12:38:07.556 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.RPl46MUND6 2024-04-26T12:38:07.650 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.RPl46MUND6 is 413KB 2024-04-26T12:38:07.723 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.RPl46MUND6 2024-04-26T12:38:07.744 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/data/mon.b.tgz 2024-04-26T12:38:07.744 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-04-26T12:38:07.805 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.Yfp6KmaJx0 2024-04-26T12:38:07.805 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Yfp6KmaJx0 2024-04-26T12:38:08.002 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.Yfp6KmaJx0 2024-04-26T12:38:08.095 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.Yfp6KmaJx0 is 570KB 2024-04-26T12:38:08.193 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.Yfp6KmaJx0 2024-04-26T12:38:08.215 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/data/mon.c.tgz 2024-04-26T12:38:08.215 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2024-04-26T12:38:08.275 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.j61sQVPE13 2024-04-26T12:38:08.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.j61sQVPE13 2024-04-26T12:38:08.471 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.j61sQVPE13 2024-04-26T12:38:08.564 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.j61sQVPE13 is 570KB 2024-04-26T12:38:08.664 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.j61sQVPE13 2024-04-26T12:38:08.684 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T12:38:08.684 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:38:08.726 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:38:08.729 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:38:08.731 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:38:08.785 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T12:38:08.786 DEBUG:teuthology.orchestra.run.smithi038:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:38:08.800 DEBUG:teuthology.orchestra.run.smithi098:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:38:08.803 DEBUG:teuthology.orchestra.run.smithi116:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:38:08.805 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:38:08.833 INFO:teuthology.orchestra.run.smithi038.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:38:08.834 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:38:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:38:08.846 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:38:08.853 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T12:38:08.854 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi038/crash 2024-04-26T12:38:08.855 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:38:08.917 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi098/crash 2024-04-26T12:38:08.918 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:38:08.956 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi116/crash 2024-04-26T12:38:08.957 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:38:09.005 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi133/crash 2024-04-26T12:38:09.006 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:38:09.055 INFO:tasks.ceph:Compressing logs... 2024-04-26T12:38:09.055 DEBUG:teuthology.orchestra.run.smithi038:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:38:09.058 DEBUG:teuthology.orchestra.run.smithi098:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:38:09.060 DEBUG:teuthology.orchestra.run.smithi116:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:38:09.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:38:11.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-26T12:38:11.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-26T12:38:11.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-26T12:38:24.954 INFO:tasks.ceph:Archiving logs... 2024-04-26T12:38:24.954 DEBUG:teuthology.misc:Transferring archived files from smithi038:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi038/log 2024-04-26T12:38:24.955 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:38:25.350 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi098/log 2024-04-26T12:38:25.351 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:38:26.284 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi116/log 2024-04-26T12:38:26.285 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:38:28.182 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi133/log 2024-04-26T12:38:28.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:38:30.111 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T12:38:30.120 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T12:38:30.120 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:38:30.123 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:38:30.126 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:38:30.128 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:38:30.267 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T12:38:30.279 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T12:38:30.280 DEBUG:teuthology.orchestra.run.smithi038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:38:30.283 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:38:30.286 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:38:30.289 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:38:30.301 INFO:teuthology.orchestra.run.smithi038.stderr:bash: ntpq: command not found 2024-04-26T12:38:30.302 INFO:teuthology.orchestra.run.smithi098.stderr:bash: ntpq: command not found 2024-04-26T12:38:30.305 INFO:teuthology.orchestra.run.smithi116.stderr:bash: ntpq: command not found 2024-04-26T12:38:30.306 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:38:30.306 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2024-04-26T12:38:30.306 INFO:teuthology.orchestra.run.smithi038.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +772us[ +773us] +/- 48ms 2024-04-26T12:38:30.306 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -1309us[-1307us] +/- 67ms 2024-04-26T12:38:30.306 INFO:teuthology.orchestra.run.smithi038.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +435us[ +435us] +/- 88ms 2024-04-26T12:38:30.306 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:38:30.308 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:38:30.308 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-04-26T12:38:30.308 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 177 26 +736us[ +719us] +/- 49ms 2024-04-26T12:38:30.308 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 26 -1341us[-1357us] +/- 67ms 2024-04-26T12:38:30.308 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 27 +405us[ +389us] +/- 88ms 2024-04-26T12:38:30.308 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:38:30.308 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2024-04-26T12:38:30.309 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:38:30.310 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-04-26T12:38:30.310 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +769us[ +772us] +/- 48ms 2024-04-26T12:38:30.310 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -1312us[-1312us] +/- 67ms 2024-04-26T12:38:30.310 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +437us[ +440us] +/- 88ms 2024-04-26T12:38:30.310 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:38:30.314 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:38:30.314 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-04-26T12:38:30.314 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +749us[ +748us] +/- 48ms 2024-04-26T12:38:30.314 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -1332us[-1332us] +/- 67ms 2024-04-26T12:38:30.314 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +415us[ +415us] +/- 88ms 2024-04-26T12:38:30.315 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:38:30.315 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T12:38:30.326 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T12:38:30.326 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T12:38:30.348 DEBUG:teuthology.orchestra.run.smithi038:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:38:30.432 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:38:30.568 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:38:30.643 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:38:30.718 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:38:30.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:38:30.757 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:38:30.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:38:30.794 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:38:30.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:38:30.828 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:38:30.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:38:30.861 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T12:38:30.871 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T12:38:30.923 INFO:teuthology.task.internal:Duration was 1318.866941 seconds 2024-04-26T12:38:30.924 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T12:38:30.956 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T12:38:30.957 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:38:30.960 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:38:30.962 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:38:30.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:38:31.016 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:38:31.017 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:38:31.017 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:38:31.047 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:38:31.348 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T12:38:31.348 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi038.front.sepia.ceph.com 2024-04-26T12:38:31.348 DEBUG:teuthology.orchestra.run.smithi038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:38:31.376 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-04-26T12:38:31.376 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:38:31.403 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-04-26T12:38:31.404 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:38:31.432 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-04-26T12:38:31.432 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:38:31.457 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T12:38:31.457 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:38:31.460 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:38:31.463 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:38:31.475 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:38:31.546 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T12:38:31.546 DEBUG:teuthology.orchestra.run.smithi038:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:38:31.549 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:38:31.551 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:38:31.554 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:38:31.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T12:38:31.651 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T12:38:31.652 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:38:31.684 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:38:31.714 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:38:31.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:38:31.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T12:38:31.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:38:31.782 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:38:31.785 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:38:31.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:38:31.811 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-04-26T12:38:31.814 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = core 2024-04-26T12:38:31.822 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-04-26T12:38:31.835 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-04-26T12:38:31.886 DEBUG:teuthology.orchestra.run.smithi038:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:38:31.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:38:31.907 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:38:31.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:38:31.924 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:38:31.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:38:31.940 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:38:31.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:38:31.956 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T12:38:31.967 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T12:38:31.968 DEBUG:teuthology.misc:Transferring archived files from smithi038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi038 2024-04-26T12:38:31.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:38:32.018 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi098 2024-04-26T12:38:32.018 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:38:32.057 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi116 2024-04-26T12:38:32.057 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:38:32.099 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674216/remote/smithi133 2024-04-26T12:38:32.099 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:38:32.138 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T12:38:32.138 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:38:32.141 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:38:32.143 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:38:32.145 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:38:32.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T12:38:32.202 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T12:38:32.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T12:38:32.246 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T12:38:32.246 DEBUG:teuthology.orchestra.run.smithi038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:38:32.248 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:38:32.251 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:38:32.253 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:38:32.265 INFO:teuthology.orchestra.run.smithi098.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:38 /home/ubuntu/cephtest 2024-04-26T12:38:32.267 INFO:teuthology.orchestra.run.smithi038.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:38 /home/ubuntu/cephtest 2024-04-26T12:38:32.268 INFO:teuthology.orchestra.run.smithi116.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:38 /home/ubuntu/cephtest 2024-04-26T12:38:32.269 INFO:teuthology.orchestra.run.smithi133.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:38 /home/ubuntu/cephtest 2024-04-26T12:38:32.271 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T12:38:32.282 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T12:38:32.343 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} duration: 1318.8669407367706 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T12:38:32.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:38:32.502 INFO:teuthology.run:pass